fix(desktop): stabilize Soniqo realtime transcription#5206
Open
ComputelessComputer wants to merge 13 commits into
Open
fix(desktop): stabilize Soniqo realtime transcription#5206ComputelessComputer wants to merge 13 commits into
ComputelessComputer wants to merge 13 commits into
Conversation
✅ Deploy Preview for old-char ready!
To edit notification comments on pull requests, go to your Netlify project configuration. |
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
ComputelessComputer
force-pushed
the
soniqo
branch
from
7de023b to
0761a88
Compare
ComputelessComputer
force-pushed
the
soniqo
branch
from
0761a88 to
85ae306
Compare
Add Soniqo local speech-swift models for realtime and batch transcription, derive local transcription mode from the selected model, and keep audio retention migrated to expiration-based cleanup.
Remove stale CLI PR workflows now that the cli package is gone, and add fallback content-collection exports used by web typecheck before generated content exists.
Drop stale desktop-bundled CLI artifacts and obsolete CLI/mobile workflows so the desktop app no longer carries the CLI bundle path and PR checks skip removed surfaces.
Recognize local Soniqo models from loopback base URLs in capture and listener mode selection, with tests covering the PR review case.
Add Wikimedia-sourced SVG assets for Qwen, NVIDIA, Meta, and OpenAI local STT model badges.
Route live language checks through shared listener validation, make Hyprnote Soniqo language support model-aware, and drop the unused on-device mode setting.
Move Parakeet TDT v3 language support into hypr-language and reuse it from Soniqo, Cactus, and Hyprnote checks.
Stop local Soniqo live sessions on listener failure and clear stopped supervisors before accepting new capture starts.
Retimes cumulative Soniqo realtime partials so live transcript rows replace previous text instead of appending duplicates.
Drop leftover Soniqo partial snapshots instead of persisting them, and finalize native live sessions before shutdown.
Call the native Soniqo stream finalizer for each source before stopping so model-final text is emitted separately from live partial snapshots.
Treat rewritten Soniqo live partial snapshots as replacements while preserving sliding-window overlap behavior.
Refresh Soniqo timing after internal repeat collapse and represent unavailable Cactus model sizes as unknown through local STT metadata.
ComputelessComputer
force-pushed
the
soniqo
branch
from
19eee34 to
687c3e7
Compare
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 687c3e7. Configure here.
| mut params: SessionParams, | ||
| state: &mut RootState, | ||
| ) -> Result<(), StartSessionError> { | ||
| params.transcription_mode = params.effective_transcription_mode(); |
There was a problem hiding this comment.
Lifecycle event loses original requested transcription mode
Medium Severity
params.transcription_mode is overwritten by effective_transcription_mode() before the SessionLifecycleEvent::Active event is emitted. The event then uses the mutated value for both requested_transcription_mode and current_transcription_mode, making them always identical. The requested_transcription_mode field is meant to capture what the caller originally asked for, but it instead reflects the server-side override.
Additional Locations (1)
Reviewed by Cursor Bugbot for commit 687c3e7. Configure here.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Consolidates the Soniqo realtime transcription work into one branch.
Supersedes #5190, #5201, and #5204.
Note
High Risk
Touches core transcription/session supervision code and introduces a new Swift-linked
transcribe-soniqobackend with live/batch routing, so regressions could break recording/transcription flows or platform-specific builds (macOS Apple Silicon) if edge cases aren’t covered.Overview
Stabilizes on-device STT by adding a new
transcribe-soniqocrate (Swift-linked on macOS) and routing Soniqo models through both live streaming (listener-core) and batch (listener2-core) transcription paths, including loopback URL detection and language support validation.Improves realtime partial handling for Soniqo by normalizing cumulative/overlapping updates in
live_transcriptso repeated text is replaced instead of appended, and updates session supervision to compute an effective transcription mode and stop sessions (instead of silently falling back) when a required Soniqo live listener fails.Extends the desktop UI to surface Soniqo models, model sizes, runtime badges/icons, and realtime vs batch labeling, and adds configurable audio retention (
audio_retention) with scheduled cleanup plus settings migration from legacy booleans.Removes several CLI/mobile-specific GitHub workflows/actions and adjusts
desktop_ciexclusions, and centralizes Parakeet TDT v3 language metadata inlanguagefor reuse across providers.Reviewed by Cursor Bugbot for commit 687c3e7. Bugbot is set up for automated code reviews on this repo. Configure here.