voicebox

AIMIT

voicebox release notes.

Latest v0.5.0 · by voiceboxWritten in TypeScriptWebsitejamiepine/voiceboxRSS

Release activity

Release activity — 10 releases across 7 days since Mar 15, 2026. Each cell is one day; darker means more releases that day. Nothing is recorded before Mar 15, 2026. Older weeks are hidden at this screen width.
JunJulAugSep
SundayNo releases on May 24, 2026No releases on May 31, 2026No releases on Jun 7, 2026No releases on Jun 14, 2026No releases on Jun 21, 2026No releases on Jun 28, 2026No releases on Jul 5, 2026No releases on Jul 12, 2026No releases on Jul 19, 2026No releases on Jul 26, 2026No releases on Aug 2, 2026No releases on Aug 9, 2026No releases on Aug 16, 2026No releases on Aug 23, 2026No releases on Aug 30, 2026No releases on Sep 6, 2026
MondayNo releases on May 25, 2026No releases on Jun 1, 2026No releases on Jun 8, 2026No releases on Jun 15, 2026No releases on Jun 22, 2026No releases on Jun 29, 2026No releases on Jul 6, 2026No releases on Jul 13, 2026No releases on Jul 20, 2026No releases on Jul 27, 2026No releases on Aug 3, 2026No releases on Aug 10, 2026No releases on Aug 17, 2026No releases on Aug 24, 2026No releases on Aug 31, 2026No releases on Sep 7, 2026
TuesdayNo releases on May 26, 2026No releases on Jun 2, 2026No releases on Jun 9, 2026No releases on Jun 16, 2026No releases on Jun 23, 2026No releases on Jun 30, 2026No releases on Jul 7, 2026No releases on Jul 14, 2026No releases on Jul 21, 2026No releases on Jul 28, 2026No releases on Aug 4, 2026No releases on Aug 11, 2026No releases on Aug 18, 2026No releases on Aug 25, 2026No releases on Sep 1, 2026No releases on Sep 8, 2026
WednesdayNo releases on May 27, 2026No releases on Jun 3, 2026No releases on Jun 10, 2026No releases on Jun 17, 2026No releases on Jun 24, 2026No releases on Jul 1, 2026No releases on Jul 8, 2026No releases on Jul 15, 2026No releases on Jul 22, 2026No releases on Jul 29, 2026No releases on Aug 5, 2026No releases on Aug 12, 2026No releases on Aug 19, 2026No releases on Aug 26, 2026No releases on Sep 2, 2026No releases on Sep 9, 2026
ThursdayNo releases on May 28, 2026No releases on Jun 4, 2026No releases on Jun 11, 2026No releases on Jun 18, 2026No releases on Jun 25, 2026No releases on Jul 2, 2026No releases on Jul 9, 2026No releases on Jul 16, 2026No releases on Jul 23, 2026No releases on Jul 30, 2026No releases on Aug 6, 2026No releases on Aug 13, 2026No releases on Aug 20, 2026No releases on Aug 27, 2026No releases on Sep 3, 2026No releases on Sep 10, 2026
FridayNo releases on May 29, 2026No releases on Jun 5, 2026No releases on Jun 12, 2026No releases on Jun 19, 2026No releases on Jun 26, 2026No releases on Jul 3, 2026No releases on Jul 10, 2026No releases on Jul 17, 2026No releases on Jul 24, 2026No releases on Jul 31, 2026No releases on Aug 7, 2026No releases on Aug 14, 2026No releases on Aug 21, 2026No releases on Aug 28, 2026No releases on Sep 4, 2026
SaturdayNo releases on May 30, 2026No releases on Jun 6, 2026No releases on Jun 13, 2026No releases on Jun 20, 2026No releases on Jun 27, 2026No releases on Jul 4, 2026No releases on Jul 11, 2026No releases on Jul 18, 2026No releases on Jul 25, 2026No releases on Aug 1, 2026No releases on Aug 8, 2026No releases on Aug 15, 2026No releases on Aug 22, 2026No releases on Aug 29, 2026No releases on Sep 5, 2026

10 releases since Mar 15, 2026, busiest day 3

Changelog

v0.5.0

Latest
Added 18
  • Global hotkey capture allows speaking anywhere on the machine with a customizable chord to dictate text into the focused application
  • Push-to-talk and toggle modes each with their own configurable chord, with ability to upgrade a push-to-talk hold into a hands-free session by tapping Space mid-hold
  • Auto-paste feature that synthesizes dictation into the text field that had focus when the hotkey chord was initiated, with clipboard preservation
  • Chord picker UI in Settings to customize hotkey combinations with visual left/right modifier badges
  • Voice profiles can now carry an optional personality description up to 2000 characters that shapes how the voice speaks
  • Compose button powered by local Qwen3 LLM that generates in-character lines based on voice personality
Changed 1
  • Voicebox transforms from a voice-cloning studio into a full AI voice studio with bidirectional agent communication

From voicebox

The Capture release.

Voicebox stops being just a voice-cloning studio and becomes a full AI voice studio. Hold a key anywhere on your machine, speak, release — the transcript lands in the focused text field. Flip the primitive around and any MCP-aware agent — Claude Code, Cursor, Spacebot — speaks back through an on-screen pill in one of your cloned voices. A local LLM sits between the two, so transcripts come out clean and voice profiles can carry a personality that reshapes what the agent says before it gets spoken.

Dictation — speak anywhere, paste anywhere
  • Global hotkey capture. Hold a customizable chord anywhere on your machine (defaults: right-Cmd + right-Option on macOS, right-Ctrl + right-Shift on Windows), speak, release. A floating on-screen pill walks through recording → transcribing → refining → done with a live elapsed timer. The transcript lands as clean text.
  • Push-to-talk and toggle modes, each with its own chord. The default toggle chord adds Space to the push-to-talk chord. Holding PTT and tapping Space mid-hold upgrades a hold into a hands-free session without a gap in the recording.
  • Auto-paste into the focused app. Once transcription finishes, Voicebox synthesizes a paste into whatever text field had focus when you started the chord — not wherever focus drifted while you were talking. Works across Dvorak / AZERTY layouts. Your clipboard is saved before and restored after.
  • Chord picker UI. Customize either chord from Settings → Captures by holding the keys you want. Left/right modifier badges show whether a key is the left or right variant.
  • Defaults stay out of your way. macOS defaults avoid left-hand Cmd+Option chords so the system shortcuts they collide with stay yours. Windows defaults route around AltGr collisions on German / French / Spanish layouts.
  • Accessibility permission is scoped. If macOS Accessibility isn't granted, dictation still runs and transcripts still land in the Captures tab — only synthetic paste is disabled. The permission prompt lives inline next to the auto-paste toggle, not as a global banner.
Personality — voice profiles that speak for themselves

Voice profiles now carry an optional personality — a free-form description of who this voice is, up to 2000 characters. When set, two new controls appear next to the generate button, each powered by a new Qwen3 LLM running entirely locally:

  • Compose — the shuffle button drops a fresh in-character line into the textarea. Click again for variety, edit before speaking.
  • Speak in character — the wand toggle runs your input through the personality LLM before TTS, preserving every idea but delivering it in the character's voice.

The same LLM doubles as the refinement model, so there's one local LLM in the app, not two.

API surface. POST /generate, POST /speak, and the MCP voicebox.speak tool accept personality: bool. POST /profiles/{id}/compose powers the shuffle button. MCP client bindings carry a default_personality: bool that applies when personality isn't passed explicitly.

Agents — any MCP-aware agent gets a voice

Voicebox ships a built-in Model Context Protocol server at http://127.0.0.1:17493/mcp so Claude Code, Cursor, Windsurf, Cline, VS Code MCP extensions — any MCP-aware agent — can call into your local Voicebox install. Four tools ship with dotted names:

  • voicebox.speak — speak text in any voice profile, with optional personality: true to run through the profile's personality LLM first

  • voicebox.transcribe — Whisper transcription of a base64 blob or an absolute local path. Path mode is restricted to loopback callers so a Voicebox bound on 0.0.0.0 doesn't double as an unauthenticated arbitrary-local-file read primitive.

  • voicebox.list_captures — recent captures with their transcripts

  • voicebox.list_profiles — available voice profiles (cloned + preset)

  • Streamable HTTP as primary transport. Cursor / Windsurf / VS Code / Claude Code all support it out of the box — drop a mcpServers block with the URL and an X-Voicebox-Client-Id header.

  • Stdio shim for clients that don't speak HTTP MCP. A voicebox-mcp binary ships inside the app bundle as a Tauri sidecar. The Settings page renders the install snippet with the right absolute path pre-filled.

  • Per-client voice binding. Pin Claude Code to Morgan, Cursor to Scarlett, Cline to its own voice — the X-Voicebox-Client-Id header resolves to a bound voice whenever speak is called without an explicit profile. Managed in Settings → MCP.

  • Profile resolution precedence. Explicit profile arg (name or id, case-insensitive) → per-client binding → global default from capture_settings.default_playback_voice_id → error with a pointer to Settings.

  • Speaking pill. Agent-initiated speech surfaces the same on-screen pill as dictation, in a speaking state with the profile name and an elapsed timer. Silent background TTS is a trust hazard — the pill always shows what's coming out of your machine.

  • POST /speak REST wrapper. Same code path and voice resolution for shell scripts, ACP, A2A, GitHub Actions, or anything else that isn't MCP-native.

Claude Code one-liner:

claude mcp add voicebox --transport http --url http://127.0.0.1:17493/mcp --header "X-Voicebox-Client-Id: claude-code"
Refinement

A clean transcript needs more than Whisper. Each capture flows through a small Qwen3 LLM that strips fillers, fixes punctuation, and optionally rewrites self-corrections — all on-device.

  • Loop-stripping before the LLM sees the transcript. Whisper's "thanks for watching thanks for watching thanks for watching…" hallucination loops are collapsed at a six-identical-tokens threshold (case-insensitive) so a small refinement model can't echo them back. Coverage spans single-word runs, multi-word phrases, CJK character runs, and Japanese emphasis patterns; legitimate repetition ("no, no, no, no, no") doesn't cross the threshold.
  • Per-capture flag snapshot. smart_cleanup, self_correction, and preserve_technical are stored on each capture, so refinement can be re-run later with different flags without losing the raw transcript.
  • Model picker — Qwen3 0.6B (400 MB, very fast), 1.7B (1.1 GB, fast), 4B (2.5 GB, full quality). 0.6B is the default; 1.7B is the sweet spot for transcripts with code identifiers.
Captures tab + settings

Settings → Captures is now the home for the whole dictation flow:

  • Dictation: global shortcut toggle, push-to-talk chord picker, toggle chord picker, live pill preview, auto-paste into focused field (with inline accessibility prompt).
  • Transcription: model picker (Whisper Base / Small / Medium / Large / Turbo), language lock.
  • Refinement: auto-refine toggle, model picker, smart cleanup, remove self-corrections, preserve technical terms.
  • Playback: default voice for the Captures tab's "Play as" action — picking a voice from the split-button persists the choice across tab switches and restarts.
  • Storage: captures folder quick-open.
Stories — timeline editor

The Stories tab graduates from a TTS sequencer into a real timeline editor. Same generation-row backing, but clips now compose with imported audio, per-clip levels, and a flexible track stack.

  • Import external audio. Drag a music file onto the story content area or pick one from the new "Import audio" entry in the add-clip popover. Accepted formats: wav / mp3 / flac / ogg / m4a / aac / webm, capped at 200 MB. Imported clips show their filename instead of a profile name and skip the regenerate / version-picker controls — there's nothing to regenerate.
  • Per-clip volume. A Volume2 icon in the clip-edit toolbar opens a 0–200% slider. Adjustments apply live and to exports. Split and duplicate carry the volume forward into the new clips.
  • Regenerate from both the clip's chat-list dropdown and the track-editor toolbar. Re-runs the underlying generation through the same path the History tab uses, with completion tracked in the global pending set.
  • Add empty tracks above or below the timeline via tiny + strips at the top of the topmost label cell and the bottom of the bottommost. Sticky in the label column so they follow horizontal scroll.
  • Zoom bar tracks the project. Min scope is 10 seconds visible (zoomed in cap), max is the entire project (zoomed out cap), default lands on 60 s. Both the +/− buttons and the scrollbar edge-drag handles clamp to those dynamic bounds.
Interface
  • Theme selector. Light / dark / system in Settings → General, persisted across sessions. System mode listens for OS-level appearance changes and flips live without a restart.
  • Scrubbable waveform player on captures. The capture detail card now embeds a WaveSurfer waveform with click-to-seek and a current / total timestamp pair, replacing the static duration label.
  • Capture pill light mode. The on-screen pill gets a dedicated light palette so it stays legible against bright windows.
  • Readiness checklist in the Captures settings sidebar. The same six-gate checklist the Captures empty state uses mirrors into Settings → Captures so a red gate can't hide behind a green toggle. Hidden once every gate is green. macOS-only rows (Input Monitoring, Accessibility) hide entirely on Windows and Linux.
Windows parity

Same dictation flow on Windows. Right-hand default chord (Ctrl+Shift) avoids AltGr collisions on layouts where Ctrl+Alt is the compose key. Focus is captured at chord-start so paste lands in the original field even if focus drifts during transcribe/refine.

View originalPermalink
How v0.5.0 went

v0.4.5

Fixed 3
  • Load no longer fails with "offline mode is enabled" error by wrapping transformers tokenizer metadata checks to catch and handle HuggingFace failures gracefully
  • Removed load-time offline guards that were causing crashes for cached online users after the inference-path guard was removed
  • Eliminated 30-second pause when generating without network access by handling HuggingFace metadata timeout at the source

From voicebox

Second hotfix for the "offline mode is enabled" crash on model load. 0.4.4 reverted the inference-path offline guards but kept the same trap on the load path, so users who updated to 0.4.4 kept hitting the exact error the release was supposed to fix (#526). This release removes the load-path guards and patches the transformers tokenizer load to be robust to HuggingFace metadata failures at the source, so the class of bug can't recur.

Reliability
  • Load no longer fails with "offline mode is enabled" (#530, fixes #526). transformers 4.57.x added an unconditional huggingface_hub.model_info() call inside AutoTokenizer.from_pretrained (via _patch_mistral_regex) that runs for every non-local repo load, regardless of cache state or whether the target model is actually a Mistral variant. The load-time HF_HUB_OFFLINE guard from 0.4.2 turned that into a hard crash for cached online users the moment 0.4.4 removed the inference-path guard that had been masking the problem. Fix wraps _patch_mistral_regex so any exception from the HF metadata check is caught and the tokenizer is returned unchanged — matching the success-path behavior for non-Mistral repos. The wrapper installs at backend.backends import time so it covers Qwen Base, Qwen CustomVoice, TADA, and every other transformers-backed engine on Windows, Linux, and CUDA alike. The load-time force_offline_if_cached guards were removed — with the wrapper in place they provide zero value and only risk re-introducing the same failure mode.
  • No more 30s pause when generating without a network. The HuggingFace metadata timeout called out as a known caveat in 0.4.4 is covered by the same patch; offline users no longer wait for the check to time out before load completes.
View originalPermalink
How v0.4.5 went

v0.4.4

Fixed 1
  • Inference no longer fails with "offline mode is enabled" while online by reverting inference-path guards that blocked legitimate metadata calls

From voicebox

Hotfix for a regression in 0.4.3 where generation and transcription could fail outright with "offline mode is enabled" even when the user was online.

Reliability
  • Inference no longer fails with "offline mode is enabled" while online (#524, reverts the inference-path guards from #503). 0.4.3 wrapped every inference body (generate, transcribe, create_voice_clone_prompt) with a process-wide HF_HUB_OFFLINE flip to stop lazy HuggingFace lookups from hanging when the network drops mid-inference (#462). That flag also blocks legitimate metadata calls (e.g. HfApi().model_info for revision resolution) so online users started seeing generation fail outright. Inference now runs with the process's default HF state. Load-time offline guards — which weren't the source of the regression — stay in place.

Known caveat: users generating without an internet connection may see brief pauses during inference while HuggingFace metadata lookups time out (typically ~30s, after which the library recovers). A proper offline-mode toggle is planned for 0.4.5.

View originalPermalink
How v0.4.4 went
v0.4.3

voicebox v0.4.3

Fixed 2
  • macOS DMGs are now notarized and stapled to resolve Gatekeeper rejection on macOS 15 Sequoia and spurious "app isn't signed" dialogs on older Intel Macs
  • Kokoro Japanese voices no longer crash on fresh installs by replacing unidic with unidic-lite for MeCab dictionary bundling

From voicebox

A patch focused on two user-impacting reliability fixes: macOS DMG notarization (unblocks brew install voicebox on macOS 15 Sequoia and fixes spurious "app isn't signed" Gatekeeper dialogs on older Intel Macs) and Kokoro Japanese voice initialization on fresh installs.

macOS
  • DMGs are now notarized and stapled (#523). Tauri's bundler notarizes the .app inside the DMG but ships the DMG wrapper itself unnotarized. Gatekeeper rejects that on macOS 15 Sequoia (confirmed by Homebrew Cask CI failing on both arm and intel Sequoia runners) and causes the "the app is not signed" dialog on older Intel Macs when Apple's notarization servers are slow or unreachable (#509). The release workflow now submits each DMG to notarytool, staples the ticket, verifies with spctl, and overwrites the draft-release asset tauri-action uploaded. Adds ~5-10 min per macOS job.
Backend
  • Kokoro Japanese voices no longer crash on fresh installs (#521, fixes #514). misaki[ja] pulls in fugashi, which needs a MeCab dictionary on disk. The unidic package that was being installed ships no data and expects a ~526MB runtime download that just setup doesn't run (and which wouldn't survive PyInstaller anyway). Swapped to unidic-lite, which bundles a MeCab-compatible dict inside the wheel (~50MB). Collected in build_binary.py so frozen builds pick up unidic_lite/dicdir/.
View originalPermalink
How v0.4.3 went
v0.4.2

voicebox v0.4.2

Added 5
  • Localize entire app with English, Simplified Chinese, Traditional Chinese, and Japanese across all tabs, modals, dialogs, and toasts with 559 translation keys per locale
  • Add in-app language switcher with tree re-rendering on locale change
  • Localize relative dates via date-fns locale objects
  • Make dev-build version suffix locale-aware
  • Add new /download page for first-time visitors
Changed 4
  • HF_HUB_OFFLINE now guards every inference path to prevent HuggingFace metadata roundtrips when offline mode is enabled
  • Preprocess Chatterbox reference samples instead of rejecting them when outside expected sample rate or channel layout
  • Use public origin instead of localhost for download redirects behind reverse proxies
  • Update MDX docs to remove stale single-engine assumptions
Fixed 3
  • Fix MLX Qwen 0.6B repo path to point at mlx-community repo
  • Fix macOS system audio capture that was silenced when app lost focus due to WKWebView audio session teardown
  • Pin MLX backend miniaudio dependency for runtime requirement

From voicebox

This release localizes the entire app. English, Simplified Chinese (zh-CN), Traditional Chinese (zh-TW), and Japanese (ja) are wired up end-to-end across every tab, modal, dialog, and toast — 559 translation keys per locale, parity verified. Plus a batch of reliability fixes: offline-mode now actually stays offline, Chatterbox accepts reference samples it used to reject, MLX Qwen 0.6B points at the right repo, and macOS system audio survives backgrounding.

Internationalization (#508)
  • i18next foundation with an in-app language switcher that re-renders the tree on change — lazy-loaded components were holding stale strings without an explicit key-bump on the React root.
  • Four locales at full coverage: English, Simplified Chinese, Traditional Chinese, Japanese. No partial/English-fallback surfaces.
  • Every user-visible surface translated: Stories (list, content editor, dialogs, toasts), Effects (list, detail, chain editor, built-in preset names), Voices (table, search, inspector, Create/Edit modal, audio sample panels), Audio Channels (list, dialogs, device picker), history + story dropdown menus, ProfileCard / ProfileList / HistoryTable, and the unsupported-model note.
  • Relative dates localize via date-fns locale objects (3 days ago3 天前 / 3 日前) — Intl.RelativeTimeFormat doesn't produce the phrasing we use in the history table.
  • Dev-build version suffix (v0.4.2 (dev) / (开发版) / (開發版) / (開発版)) is now locale-aware.
  • 559 translation keys across all four locales.
Reliability
  • HF_HUB_OFFLINE now guards every inference path (#503) — some engines were still attempting a HuggingFace metadata roundtrip on first load when offline mode was enabled, causing hangs on airgapped or flaky networks.
  • Chatterbox reference samples are preprocessed instead of rejected (#502) — samples outside the expected sample rate or channel layout are resampled to match, rather than failing with an opaque error.
  • MLX Qwen 0.6B repo path fixed (#501) — now points at the published mlx-community repo so the model actually downloads on Apple Silicon.
  • macOS system audio survives backgrounding (#486, closes #41) — WKWebView was tearing down the audio session when the app lost focus, silently killing system-audio capture.
  • MLX backend miniaudio dependency pinned (#506) — mlx_audio.stt needs it at runtime and nothing else transitively pulled it in, so --no-deps installs were breaking on first use.
Landing / Docs
  • New /download page (#487) — no more dumping first-time visitors onto the GitHub releases list. The API example snippet on the landing page also got an accuracy pass.
  • Download redirects work behind reverse proxies (#498) — uses the public origin instead of localhost when resolving platform-specific installer URLs.
  • MDX docs audited against the multi-engine backend (#484) — stale single-engine assumptions removed.
  • Three more tutorials + mobile navbar / hero CTA fixes (#483).
Linux
  • Still not shipping. The re-enable attempt (#488) landed on main but CI still hangs in the tauri-action bundler step on ubuntu-22.04 — no output for 25+ minutes after rpm bundling, even with createUpdaterArtifacts: false and --bundles deb,rpm. The matrix entry is disabled again for 0.4.2; the ubuntu-specific setup steps stay in the workflow so re-enabling is a one-line change once we identify the hang. Next release will take another pass.
New Contributors
View originalPermalink
How v0.4.2 went

v0.4.1

Added 3
  • Cancel queued or running generations via new /generate/{id}/cancel endpoint and Stop button on the history row while generating
  • Linux system audio capture now uses pactl get-default-sink + pactl list short sources and routes via PULSE_SOURCE, with name-based search as fallback when pactl is absent
  • PR-time type checking via new .github/workflows/ci.yml running bun run typecheck + bun run build:web on every PR
Changed 5
  • .spec paths are now repo-relative instead of absolute, making the generated spec portable across machines and CI
  • Serial queue now tracks per-ID state (queued / running / cancelled) so queued jobs are skipped before worker pickup and running jobs are cancelled mid-flight
  • Storage-change flow now surfaces a toast when there's nothing to migrate instead of proceeding with a no-op move
  • Widened apiClient.migrateModels() return type to include moved and errors so the storage-change handler typechecks against the real backend response
  • Clarified in Quick Start and README that paralinguistic tags ([laugh], [sigh]) only work with Chatterbox Turbo; other engines read them as literal text
Fixed 11
  • Kokoro now bundles .py sources alongside .pyc via --collect-all kokoro so transformers' _can_set_attn_implementation regex scan can read them, fixing FileNotFoundError: kokoro/modules.py in production builds
  • Chatterbox Multilingual now bundles spacy_pkuseg/dicts/default.pkl and native .so extensions via --collect-all spacy_pkuseg, fixing FileNotFoundError on Chinese word segmenter load
  • scipy.stats._distn_infrastructure runtime hook source-patches the trailing del obj to globals().pop('obj', None), unblocking librosa → scipy.signal → scipy.stats for TTS engines
  • transformers.masking_utils runtime hook forces _is_torch_greater_or_equal_than_2_6 = False to select the older sdpa_mask_older_torch path, avoiding torch._dynamo graph transform issues
  • torch._dynamo no-op stub prevents the torch._numpy._ufuncs import crash that blocked Kokoro and engines pulling in flex_attention
  • run_generation now catches CancelledError and marks the row failed with a cancelled error
Removed 1
  • Removed 100+ lines of dead ModelItem code from ModelManagement.tsx

From voicebox

A fast follow-up to 0.4.0 focused on making the new engines actually load in the production binary — plus generation cancellation, Linux system-audio capture, and the repo's first PR-time type check. Five first-time contributors shipped in this release.

0.4.0 introduced three new TTS engines, but the frozen PyInstaller binary tripped over several Python-ecosystem quirks that don't show up in the dev venv: transformers opening .py sources at runtime, scipy.stats._distn_infrastructure hitting a frozen-importer NameError, and chatterbox-multilingual failing to find its Chinese segmenter dictionary. This release patches all of those in one sweep.

Frozen-Binary Reliability (#438)
  • Kokoro now bundles .py sources alongside .pyc via --collect-all kokoro so transformers' _can_set_attn_implementation regex scan can read them — previously FileNotFoundError: kokoro/modules.py killed Kokoro loading in production builds
  • Chatterbox Multilingual now bundles spacy_pkuseg/dicts/default.pkl and the package's native .so extensions via --collect-all spacy_pkuseg — previously the Chinese word segmenter crashed with FileNotFoundError on first load
  • scipy.stats._distn_infrastructure — new runtime hook source-patches the trailing del obj (which raises NameError under PyInstaller's frozen importer because the preceding list comprehension evaluates empty) to globals().pop('obj', None), unblocking librosascipy.signalscipy.stats for every TTS engine that depends on librosa
  • transformers.masking_utils — same runtime hook forces _is_torch_greater_or_equal_than_2_6 = False so the older sdpa_mask_older_torch path is selected; the 2.6+ path uses TransformGetItemToIndex(), a real torch._dynamo graph transform our permissive stub can't reproduce
  • torch._dynamo — no-op stub replaces the real module before transformers imports it, preventing the torch._numpy._ufuncs import crash (NameError: name 'name' is not defined) that blocked Kokoro and every engine pulling in flex_attention
  • .spec paths are now repo-relative instead of absolute, so the generated spec is portable across machines and CI
Generation
  • Cancel queued or running generations (#444) — new /generate/{id}/cancel endpoint and a Stop button on the history row while generating. The serial queue now tracks per-ID state (queued / running / cancelled) so queued jobs are skipped before the worker picks them up and running jobs are .cancel()-ed mid-flight; run_generation catches CancelledError and marks the row failed with a "cancelled" error.
  • Legacy data/ path prefix resolution (#440) — generations stored with the old data/ prefix under pre-0.4 installs now resolve correctly after the storage root moved, fixing 404s for historical audio.
Model Migration
  • Migration dialog no longer hangs when the cache is empty (#439) — the backend now emits a completion SSE event even when zero models are moved.
  • Storage-change flow surfaces a toast when there's nothing to migrate (#433) instead of proceeding with a no-op move and restarting the server.
  • Deleting all generations from a voice profile now deletes the associated version files and DB rows too (#447) — previously orphaned versions accumulated in storage.
Platform
  • Linux system audio capture (#457) — cpal's ALSA backend doesn't expose PulseAudio/PipeWire monitor sources by name, so the previous device-name search never matched and silently fell back to the microphone. Detection now uses pactl get-default-sink + pactl list short sources and routes via PULSE_SOURCE, with the name-based search retained as a fallback when pactl is absent.
Frontend CI
  • First PR-time quality gate (#418) — new .github/workflows/ci.yml runs bun run typecheck + bun run build:web on every PR. Fixed pre-existing type issues that were being suppressed with @ts-expect-error, cleaned up a dep-array typo ([platform.metadata.isTauricheckOnMountcheckForUpdates]) in useAutoUpdater, and removed 100+ lines of dead ModelItem code from ModelManagement.tsx.
  • Follow-up: widened apiClient.migrateModels() return type to include moved and errors so the storage-change handler typechecks against the real backend response (#470).
Docs
  • Clarified in the Quick Start + README that paralinguistic tags ([laugh], [sigh]) only work with Chatterbox Turbo; other engines read them as literal text (#450).
New Contributors
View originalPermalink
How v0.4.1 went

v0.4.0

Added 6
  • Added HumeAI TADA engine with tada-1b (English) and tada-3b-ml (multilingual) backends
  • Added Kokoro 82M engine with a new voice profile type system that distinguishes preset voices from cloned profiles
  • Added qwen-custom-voice preset engine backed by Qwen3-TTS
  • Added first-class Intel Arc (XPU) support across all PyTorch-based backends with device-aware seeding and XPU detection in the GPU status panel
  • Added check_cuda_compatibility() to compare the current device's compute capability against the bundled PyTorch's architecture list
  • Added gpu_compatibility_warning field to the health endpoint so the UI can surface GPU mismatches
Changed 8
  • Replaced descript-audio-codec with a lightweight DAC shim to cut dependencies in HumeAI TADA
  • Switched audio decoding to soundfile to sidestep torchcodec bundling issues in HumeAI TADA
  • Upgraded the CUDA backend from cu126 to cu128 for RTX 50-series support
  • Split CUDA backend into two independently versioned archives: a small server binary and a large libs archive, so upgrading no longer redownloads the ~4 GB of PyTorch/CUDA DLLs
  • Voice profile grid now grey-outs unsupported profiles instead of filtering them, with all profiles always visible and a compatibility hint shown for unsupported ones
  • Clicking a greyed-out profile now selects it AND switches the engine to a compatible one
  • Instruct toggle is now conditionally exposed only for Qwen CustomVoice which was trained for instruction-based style control
  • Supported profiles now sort first in the voice profile grid, and the grid scrolls the selected profile into view after engine or sort changes
Fixed 5
  • Fixed tokenizer patch that was corrupting AutoTokenizer for other engines in HumeAI TADA
  • Fixed TorchScript error in frozen builds for HumeAI TADA
  • Fixed engine desync on tab navigation by initializing the form engine from the store
  • Fixed the disabled-and-selected card click edge case by bouncing selection to re-trigger auto-switch
  • Added asyncio.Lock around download_cuda_binary() so auto-update and manual download cannot race on the same temp file

From voicebox

The biggest Voicebox release yet. Three new TTS engines bring the lineup to seven — HumeAI TADA, Kokoro 82M, and Qwen CustomVoice join Qwen3-TTS, LuxTTS, Chatterbox Multilingual, and Chatterbox Turbo. GPU support broadens to Intel Arc (XPU) and NVIDIA Blackwell (RTX 50-series), with runtime diagnostics that warn when your PyTorch build doesn't match your GPU. The CUDA backend is now split into independently versioned server and library archives, so upgrading no longer redownloads 4 GB of PyTorch/CUDA DLLs.

This release also marks a big community moment: 13 new contributors shipped fixes and features in 0.4.0. Thirty-plus bug fixes target the most-reported issues in the tracker — numpy 2.x TTS crashes, Windows background-server reliability, macOS 11 launch failures, audio playback silence, Stories clip-splitting races, history status staleness, and more.

New TTS Engines
HumeAI TADA — Expressive English & Multilingual (#296)
  • Added tada-1b (English) and tada-3b-ml (multilingual) backends
  • Replaced descript-audio-codec with a lightweight DAC shim to cut dependencies
  • Switched audio decoding to soundfile to sidestep torchcodec bundling issues
  • Redirected gated Llama tokenizer lookups to an ungated mirror so model loading works out of the box
  • Fixed tokenizer patch that was corrupting AutoTokenizer for other engines
  • Fixed TorchScript error in frozen builds
Kokoro 82M — Fast Lightweight TTS (#325)
  • Added Kokoro 82M engine with a new voice profile type system that distinguishes preset voices from cloned profiles
  • Profile grid now handles engine compatibility directly — removed redundant dropdown filtering
  • Tightened Kokoro profile handling so preset voices can't be edited like cloned profiles
Qwen CustomVoice (#328)
  • Added qwen-custom-voice preset engine backed by Qwen3-TTS
  • Enforced preset/profile engine compatibility across the generation flow
  • Floating generator now shows all engines instead of silently filtering
Voice Profile UX

Until 0.4, every engine in Voicebox was a cloning model, so every voice profile was usable with every engine and the profile grid just showed them all. Introducing Kokoro and Qwen CustomVoice — which work from preset voices rather than cloned samples — broke that assumption for the first time. An early cut on main filtered the grid by the selected engine, which left users running pre-release builds thinking their cloned voices had vanished whenever they switched to a preset-only engine.

This release ships the resolution before it ever reaches a tagged version:

  • Grey-out instead of filter — all profiles are always visible; unsupported ones render dimmed with a compatibility hint at the bottom of the grid
  • Auto-switch on selection — clicking a greyed-out profile selects it AND switches the engine to a compatible one, instead of silently doing nothing
  • Instruct toggle restored for Qwen CustomVoice — the floating generate box now reveals a delivery-instructions input (tone, emotion, pace) when CustomVoice is selected. Hidden across the board while the new multi-engine lineup was stabilizing because most engines don't honor the kwarg; now conditionally exposed only for the one engine that was actually trained for instruction-based style control
  • Supported profiles sort first; the grid scrolls the selected profile into view after engine/sort changes
  • Fixed engine desync on tab navigation — the form now initializes its engine from the store
  • Fixed the disabled-and-selected card click edge case by bouncing selection to re-trigger the auto-switch
  • Cleaned up scroll effect timers (requestAnimationFrame + setTimeout) to prevent stale DOM writes on unmount or rapid selection changes
GPU & Platform
Intel Arc (XPU) Support (#320)
  • First-class Intel Arc support across all PyTorch-based backends
  • Device-aware seeding, XPU detection in the GPU status panel, and setup flow detection
  • Reports correct device name and VRAM in settings
Blackwell / RTX 50-series Support (#316, #401)
  • Upgraded the CUDA backend from cu126 → cu128 for RTX 50-series support
  • Added sm_120+PTX to the CUDA build via TORCH_CUDA_ARCH_LIST for forward-compatibility with Blackwell architectures (closes 5 open reports: #386, #395, #396, #399, #400)
  • GPU settings UI fixes around install/uninstall state
GPU Compatibility Diagnostics (#367, adapted)
  • New check_cuda_compatibility() compares the current device's compute capability against the bundled PyTorch's architecture list
  • Health endpoint exposes a gpu_compatibility_warning field so the UI can surface mismatches
  • Startup logs a WARN when the installed PyTorch build doesn't support the detected GPU
  • GPU status label shows [UNSUPPORTED - see logs] — no more silent "no kernel image" failures
Split CUDA Backend (#298)
  • CUDA backend now ships as two independently versioned archives: a small server binary and a large libs archive (the ~4 GB of PyTorch/CUDA DLLs)
  • Upgrading Voicebox no longer redownloads the libs archive when only the server binary changed
  • Added asyncio.Lock around download_cuda_binary() so auto-update and manual download can't race on the same temp file (#428)
  • Updated package_cuda.py for PyInstaller 6.18 onedir layout
  • Temp archives are always cleaned up on failure, even when the install aborts mid-extract
Bug Fixes
Critical: TTS Generation
  • numpy 2.x torch.from_numpy crash (#361) — torch compiled against numpy 1.x ABI fails silently when paired with numpy 2.x, causing RuntimeError: Numpy is not available / Unable to create tensor on every TTS request in bundled macOS Intel / Rosetta builds. Pinned numpy<2.0 in requirements and added a PyInstaller runtime hook with a ctypes.memmove fallback as belt-and-suspenders. Hardened afterward to raise on unknown dtypes instead of silently reinterpreting bytes as float32.
Platform Reliability
  • Windows background server (#402) — "keep server running after close" now actually keeps the server running. The HTTP /watchdog/disable request could lose the race against process exit on Windows; added a .keep-running sentinel file as a synchronous fallback, with stale-sentinel cleanup on startup to avoid orphan server processes
  • macOS 11 launch crash (#424) — weak-linked ScreenCaptureKit so the app can launch on macOS < 12.3 instead of crashing at dyld resolution. Gated system audio capture behind a real sw_vers version check so unsupported systems cleanly advertise "not available" rather than crashing at runtime
  • macOS Intel (x86_64) setup (#416) — relaxed torch>=2.7.0torch>=2.2.0. PyTorch dropped pre-built x86_64 wheels after 2.2.2, so Intel Mac devs could no longer pip install. Now resolves to the latest compatible torch per platform
  • Offline model loading (#318) — Qwen TTS and Whisper force offline mode when loading cached models, so startup works without network access
  • GUI startup with external server (#319) — fixed GUI launch when pointed at a remote/external server, and added data refresh on server switch; hardened health validation and error handling
  • Qwen3-TTS cache split on Windows (adapted from #218) — route Qwen3TTSModel.from_pretrained through hf_constants.HF_HUB_CACHE so the speech tokenizer and preprocessor_config.json resolve from a single cache root
  • Qwen3-TTS bundling (#305) — bundle qwen_tts source files in the PyInstaller build to fix inspect.getsource errors in frozen builds
  • Backend import paths (#345) — moved lazy imports to top-level with absolute paths to resolve the "Failed to Save" preset error caused by ModuleNotFoundError in production builds
  • Effects service import (#384) — fixed ModuleNotFoundError on preset create/update by switching to relative imports (#349)
Audio & Playback
  • cpal stream silent playback (#405) — cpal::Stream was dropped on function return immediately after play(), causing every playback to fall silent. Now holds the stream until either the buffer drains or the stop flag fires (#404)
Stories & History
  • Clip-splitting race (#403) — rapid double-clicks on split could race through split_story_item with inconsistent state. Added with_for_update() row locking on the backend and an isPending guard on the frontend (#366)
  • History status staleness (#394) — GET /history/{id} was hardcoding status="completed" regardless of the DB row, breaking any client polling for job completion. Now returns status, error, engine, model_size, and is_favorited from the actual row
  • "Clear failed" bulk button (#412) — new DELETE /history/failed endpoint and a header strip showing "N failed generations" with a Clear button, complementing the per-row trash icon added in #321 (#410)
  • Delete failed generations (#321) — added a trash icon next to the retry button so failed entries can be cleaned up without having to retry first
Security & Safety
  • Voice prompt cache hardening (#429) — torch.load(weights_only=True) on cached voice prompts per PyTorch 2.6 recommendation; replaced string-based SPA path guard with Path.is_relative_to() for more robust path-traversal protection
Infrastructure & Docker
  • Docker web build (#344) — include CHANGELOG.md in the Docker web build so the in-app changelog page works in Docker deployments
  • Docker numba cache (#425) — set NUMBA_CACHE_DIR in docker-compose so numba can write its JIT cache in container runtime (#308)
  • Relative media paths (#332) — media paths now stored relative to the configured data dir rather than resolved against CWD, so the data directory is portable between installs
Developer Tooling
  • New triage-prs agent skill — encodes the end-to-end PR-speedrun workflow (classification → triage doc → rebase → squash-merge → follow-ups) so future release cycles can reproduce it
  • Rewrote the TTS engine guide with the patterns learned from adding TADA and Kokoro
  • Added the API refactor plan and CUDA libs addon design doc
  • Fixed broken links in the Get Started section (#332)
New Contributors

Huge thank you to everyone who contributed their first PR to Voicebox in this release:

@liorshahverdi, @nicoschtein, @ArfianID, @aimaaaimaa, @maxmcoding, @Khalodddd, @LuisSambrano, @shaun0927, @malletfils, @mvanhorn, @kuishou68, @txhno, @MukundaKatta

View originalPermalink
How v0.4.0 went

v0.3.0

Added 8
  • Added live server log viewer with auto-scroll in settings
  • Added in-app changelog page that parses CHANGELOG.md at build time
  • Added About page with version info, license, and generation folder quick-open
  • Added model loading status indicator in UI
  • Added effects preset dropdown
  • Added Whisper model selection (base, small, medium, large, turbo) and expanded language support to /transcribe endpoint
  • Upgraded CUDA backend build from cu121 to cu126 for RTX 50-series GPU support
  • Added 50 MB upload size limit with chunked reads to prevent unbounded memory allocation on sample uploads
Changed 3
  • Rewrote backend into modular architecture with domain routers, services layer, and database package; reduced main.py from ~3,100 lines to ~10
  • Split settings into routed sub-pages: General, Generation, GPU, Logs, Changelog, About
  • Migrated documentation site from Mintlify to Fumadocs
Fixed 10
  • Fixed audio player freezing during playback
  • Fixed sample uploads crashing the server by running audio decoding in thread pool instead of blocking async event loop
  • Fixed generation list not updating when a generation completes by switching to refetchQueries and adding SSE error fallback
  • Fixed error toasts showing [object Object] instead of actual error message
  • Fixed startup database session leak with proper rollback and cleanup in finally block
  • Fixed take-label race condition during regeneration

From voicebox

This release rewrites the backend into a modular architecture, overhauls the settings UI into routed sub-pages, fixes audio player freezing, migrates documentation to Fumadocs, and ships a batch of bug fixes targeting the most-reported issues from the tracker.

The backend's 3,000-line monolith main.py has been decomposed into domain routers, a services layer, and a proper database package. A style guide and ruff configuration now enforce consistency. On the frontend, settings have been split into dedicated routed pages with server logs, a changelog viewer, and an about page. The audio player no longer freezes mid-playback, and model loading status is now visible in the UI. Seven user-reported bugs have been fixed, including server crashes during sample uploads, generation list staleness, cryptic error messages, and CUDA support for RTX 50-series GPUs.

Settings Overhaul (#294)
  • Split settings into routed sub-tabs: General, Generation, GPU, Logs, Changelog, About
  • Added live server log viewer with auto-scroll
  • Added in-app changelog page that parses CHANGELOG.md at build time
  • Added About page with version info, license, and generation folder quick-open
  • Extracted reusable SettingRow component for consistent setting layouts
Audio Player Fix (#293)
  • Fixed audio player freezing during playback
  • Improved playback UX with better state management and listener cleanup
  • Fixed restart race condition during regeneration
  • Added stable keys for audio element re-rendering
  • Improved accessibility across player controls
Backend Refactor (#285)
  • Extracted all routes from main.py into 13 domain routers under backend/routes/main.py dropped from ~3,100 lines to ~10
  • Moved CRUD and service modules into backend/services/, platform detection into backend/utils/
  • Split monolithic database.py into a database/ package with separate models, session, migrations, and seed modules
  • Added backend/STYLE_GUIDE.md and pyproject.toml with ruff linting config
  • Removed dead code: unused _get_cuda_dll_excludes, stale studio.py, example_usage.py, old Makefile
  • Deduplicated shared logic across TTS backends into backends/base.py
  • Improved startup logging with version, platform, data directory, and database stats
  • Fixed startup database session leak — sessions now rollback and close in finally block
  • Isolated shutdown unload calls so one backend failure doesn't block the others
  • Handled null duration in story_items migration
  • Reject model migration when target is a subdirectory of source cache
Documentation Rewrite (#288)
  • Migrated docs site from Mintlify to Fumadocs (Next.js-based)
  • Rewrote introduction and root page with content from README
  • Added "Edit on GitHub" links and last-updated timestamps on all pages
  • Generated OpenAPI spec and auto-generated API reference pages
  • Removed stale planning docs (CUDA_BACKEND_SWAP, EXTERNAL_PROVIDERS, MLX_AUDIO, TTS_PROVIDER_ARCHITECTURE, etc.)
  • Sidebar groups now expand by default; root redirects to /docs
  • Added OG image metadata and /og preview page
UI & Frontend
  • Added model loading status indicator and effects preset dropdown (3187344)
  • Fixed take-label race condition during regeneration
  • Added accessible focus styling to select component
  • Softened select focus indicator opacity
  • Addressed 4 critical and 12 major issues from CodeRabbit review
Bug Fixes (#295)
  • Fixed sample uploads crashing the server — audio decoding now runs in a thread pool instead of blocking the async event loop (#278)
  • Fixed generation list not updating when a generation completes — switched to refetchQueries for reliable cache busting, added SSE error fallback, and page reset on completion (#231)
  • Fixed error toasts showing [object Object] instead of the actual error message (#290)
  • Added Whisper model selection (base, small, medium, large, turbo) and expanded language support to the /transcribe endpoint (#233)
  • Upgraded CUDA backend build from cu121 to cu126 for RTX 50-series (Blackwell) GPU support (#289)
  • Handled client disconnects in SSE and streaming endpoints to suppress [Errno 32] Broken Pipe errors (#248)
  • Fixed Docker build failure from pip hash mismatch on Qwen3-TTS dependencies (#286)
  • Added 50 MB upload size limit with chunked reads to prevent unbounded memory allocation on sample uploads
  • Eliminated redundant double audio decode in sample processing pipeline
Platform Fixes
  • Replaced netstat with TcpStream + PowerShell for Windows port detection (#277)
  • Fixed Docker frontend build and cleaned up Docker docs
  • Fixed macOS download links to use .dmg instead of .app.tar.gz
  • Added dynamic download redirect routes to landing site
Release Tooling
  • Added draft-release-notes and release-bump agent skills
  • Wired CI release workflow to extract notes from CHANGELOG.md for GitHub Releases
  • Backfilled changelog with all historical releases
View originalPermalink
How v0.3.0 went

v0.2.3

Added 2
  • Add hidden imports for chatterbox, chatterbox_turbo, luxtts, and zipvoice backends
  • Add multiprocessing.freeze_support() to fix resource_tracker subprocess crash in frozen binary
Changed 2
  • Apply --noconsole only on Windows; macOS and Linux retain stdout/stderr for Tauri sidecar log capture
  • Update tauri-action to v0.6 to fix updater JSON and .sig generation
Fixed 13
  • Model downloading and loading now work correctly in PyInstaller bundled builds for Chatterbox, Chatterbox Turbo, and LuxTTS
  • Real-time download progress bars now function in production builds by force-enabling huggingface_hub's internal counter regardless of logger level
  • Upgraded Python to 3.12.13 to resolve Python 3.12.0 code.replace() bug that caused NameError crashes during scipy/torch imports in macOS builds
  • Collect all inflect files to fix LuxTTS 'could not get source code' error caused by typeguard's @typechecked decorator
  • Collect all perth files to bundle the pretrained watermark model needed by Chatterbox at runtime
  • Collect all piper_phonemize files to bundle espeak-ng-data for LuxTTS text-to-phoneme conversion

From voicebox

The "it works in dev but not in prod" release. This version fixes a series of PyInstaller bundling issues that prevented model downloading, loading, generation, and progress tracking from working in production builds.

Model Downloads Now Actually Work

The v0.2.1/v0.2.2 builds could not download or load models that weren't already cached from a dev install. This release fixes the entire chain:

  • Chatterbox, Chatterbox Turbo, and LuxTTS all download, load, and generate correctly in bundled builds
  • Real-time download progress — byte-level progress bars now work in production. The root cause: huggingface_hub silently disables tqdm progress bars based on logger level, which prevented our progress tracker from receiving byte updates. We now force-enable the internal counter regardless.
  • Fixed Python 3.12.0 code.replace() bug — the macOS build was on Python 3.12.0, which has a known CPython bug that corrupts bytecode when PyInstaller rewrites code objects. This caused NameError: name 'obj' is not defined crashes during scipy/torch imports. Upgraded to Python 3.12.13.
PyInstaller Fixes
  • Collect all inflect files — typeguard's @typechecked decorator calls inspect.getsource() at import time, which needs .py source files, not just bytecode. Fixes LuxTTS "could not get source code" error.
  • Collect all perth files — bundles the pretrained watermark model (hparams.yaml, .pth.tar) needed by Chatterbox at runtime
  • Collect all piper_phonemize files — bundles espeak-ng-data/ (phoneme tables, language dicts) needed by LuxTTS for text-to-phoneme conversion
  • Set ESPEAK_DATA_PATH in frozen builds so the espeak-ng C library finds the bundled data instead of looking at /usr/share/espeak-ng-data/
  • Collect all linacodec files — fixes inspect.getsource error in Vocos codec
  • Collect all zipvoice files — fixes source code lookup in LuxTTS voice cloning
  • Copy metadata for requests, transformers, huggingface-hub, tokenizers, safetensors, tqdm — fixes importlib.metadata lookups in frozen binary
  • Add hidden imports for chatterbox, chatterbox_turbo, luxtts, zipvoice backends
  • Add multiprocessing.freeze_support() to fix resource_tracker subprocess crash in frozen binary
  • --noconsole now only applied on Windows — macOS/Linux need stdout/stderr for Tauri sidecar log capture
  • Hardened sys.stdout/sys.stderr devnull redirect to test writability, not just None check
Updater
  • Fixed updater artifact generation with v1Compatible for tauri-action signature files
  • Updated tauri-action to v0.6 to fix updater JSON and .sig generation
Other Fixes
  • Full traceback logging on all backend model loading errors (was just str(e) before)
View originalPermalink
How v0.2.3 went

v0.2.2

Added 2
  • Auto-update CUDA binary when app version changes
  • Add CUDA download progress bar
Changed 1
  • Hide console window when running CUDA binary on Windows
Fixed 3
  • Fix Chatterbox model support in bundled builds
  • Fix LuxTTS/ZipVoice support in bundled builds
  • Fix server process staying alive on macOS with SIGHUP handling and watchdog grace period

From voicebox

UPDATE: I'm working on a rewrite of the model downloading, it's absolute hell and takes a while to test as it always works in dev and never in prod builds. Will have a solution up ASAP. If you're eager to test 0.2.x please compile from source. Next update will solve model downloading and the updater issue for good.

  • Fix Chatterbox model support in bundled builds [SIKE fixed in 0.2.3]
  • Fix LuxTTS/ZipVoice support in bundled builds [SIKE fixed in 0.2.3]
  • Auto-update CUDA binary when app version changes
  • CUDA download progress bar
  • Fix server process staying alive on macOS (SIGHUP handling, watchdog grace period)
  • Hide console window when running CUDA binary on Windows
View originalPermalink
How v0.2.2 went
View all

Discussion

If you publish voicebox, you can claim this product by proving you administer its repository.