Handy v0.10.0 transcribes audio files and detects your language with every model

1 hour ago

Handy, the open-source speech-to-text app, now transcribes audio files and detects your language with every model. This release also grades each model per language, keeps running when a model crashes, adds AirPods Mode on macOS and a transcription hook, and drops ONNX models for GGUF versions. https://github.com/cjpais/Handy/releases/tag/v0.10.0 https://github.com/cjpais/Handy/compare/v0.9.8...v0.10.0

Ask about this presentation

Chapters

  1. 0:00Transcribe audio files
  2. 0:13Long audio chunking
  3. 0:26Picking a model
  4. 0:28New onboarding
  5. 0:40Preferred languages and model grades
  6. 0:54Auto language detection
  7. 1:08Language in the menu bar
  8. 1:19Custom words for more models
  9. 1:32When something goes wrong
  10. 1:34Transcription in its own process
  11. 1:47Errors and loading
  12. 2:02AirPods Mode
  13. 2:16For power users
  14. 2:18Transcription hook
  15. 2:34Anthropic Messages API
  16. 2:49What’s gone
  17. 2:51ONNX models removed
  18. 3:05Next: stability
Show transcript
  1. Handy now transcribes audio files as well as your voice. Click Transcribe File in History, or drag a file onto Handy's window, and the text lands in your history.

    Slide text
    Handy
    01 · FILES

    Handy v0.10.0 transcribes audio files and detects your language with every model

    Handy's History tab with the Transcribe File button
    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  2. Long audio is now cut into chunks by default, with voice detection finding the breaks. That speeds up long transcriptions and stops some models from crashing. You can switch it off under Advanced.

    Slide text
    Handy
    01 · FILES

    Long recordings are split into chunks before they’re transcribed

    On by default. Switch it off in Advanced → Long Audio Chunking.

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  3. Getting started, and picking a model.

    Slide text
    02
  4. First-time users get a new onboarding. It walks through permissions, picking a model and a first try at dictation, so a speech model on your own computer is easier to start with.

    Slide text
    Handy
    02 · MODELS

    New users get a rebuilt onboarding for local models

    Welcome Permissions Model Try it
    Source: cjpais/Handy · release-notes/0.10.0.md · src/components/onboarding
  5. Tell Handy which languages you speak, under Preferred Languages. The rebuilt model picker grades every model in each of those languages, and marks one Recommended, one Faster and one More accurate.

    Slide text
    Handy
    02 · MODELS

    Every model gets a grade from A to F in each of your languages

    Set them in General → Preferred Languages.

    Handy's Models page with accuracy grades for English and Chinese
    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  6. Auto language detection now works with every model. Models that can't tell the language use a small detector that downloads when you pick Auto. An experimental setting limits Auto to your preferred languages.

    Slide text
    Handy
    02 · MODELS

    Auto language detection works with every model

    Models that can’t tell the language use a small detector, downloaded when you pick Auto.

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  7. You can switch the dictation language from the menu bar, without opening settings. Auto detect sits at the top, followed by up to five languages you used recently.

    Slide text
    Handy
    02 · MODELS

    Switch the dictation language from the menu bar

    • Auto detect always first
    • Recent your last five languages
    • The label names the active language
    Source: cjpais/Handy · GitHub release v0.10.0 · PR #1319
  8. Custom words are the names and terms you add so Handy spells them right. They used to help only Whisper. Now Qwen3 ASR, Granite and other models get them directly.

    Slide text
    Handy
    02 · MODELS

    Custom words now reach Qwen3 ASR, Granite and more

    Before this release, only Whisper models used them.

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  9. When something goes wrong.

    Slide text
    03
  10. Transcription now runs in a separate process. If the model or your GPU crashes or hangs, Handy keeps running and recovers. When the GPU was the cause, it retries on the CPU.

    Slide text
    Handy
    03 · STABILITY

    Transcription runs in its own process, so a model crash leaves Handy running

    If the GPU caused it, Handy retries on the CPU.

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md
  11. Errors now appear in the recording overlay right away, and in a tray inside the app. A model that's still loading says so. And if post-processing comes back blank, Handy keeps your dictation.

    Slide text
    Handy
    03 · STABILITY

    Errors show up the moment they happen

    • Errors in the overlay and in a tray in the app
    • Model loading shown instead of a stuck “Transcribing…”
    • Blank post-processing keeps your original dictation
    Source: cjpais/Handy · GitHub release v0.10.0 · PRs #2372, #2227, #2290
  12. On macOS, AirPods could give Handy a silent recording while your iPhone played audio through them. The experimental AirPods Mode fixes that, and the iPhone's playback stops when you start recording, as it does in Voice Memos.

    Slide text
    Handy
    03 · STABILITY

    AirPods Mode stops silent recordings while your iPhone plays audio

    macOS · experimental · iPhone playback stops when you start recording

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md · PR #1991
  13. For power users.

    Slide text
    04
  14. On macOS and Linux, Handy can pass every transcription through a script of your own before pasting. Whatever the script prints is what gets pasted. If it fails or runs past 30 seconds, the original text goes in.

    Slide text
    Handy
    04 · POWER USERS

    A transcription hook runs your own script before Handy pastes

    macOS and Linux · the script’s output is what gets pasted

    Source: cjpais/Handy · README.md, Transcription hook · PR #930
  15. If a language model cleans up your dictation, the Custom provider now speaks Anthropic's Messages API, as well as OpenAI's format. So Claude works directly, even in Microsoft Foundry, without a proxy like LiteLLM.

    Slide text
    Handy
    04 · POWER USERS

    The Custom post-processing provider speaks Anthropic’s Messages API

    Claude, including Claude in Microsoft Foundry, with no proxy in between.

    Source: cjpais/Handy · GitHub release v0.10.0 · PR #2257
  16. What's gone.

    Slide text
    05
  17. Handy no longer runs ONNX models. If you still use one, such as Parakeet V3, Moonshine or Canary, Handy offers its GGUF version and guides you through the switch. It should run as well on your machine, or better.

    Slide text
    Handy
    05 · REMOVED

    ONNX models are gone, replaced by GGUF versions

    Parakeet V2 Parakeet V3 Moonshine SenseVoice GigaAM v3 Canary Cohere

    Handy offers the GGUF replacement when it starts.

    Source: cjpais/Handy · src/content/release-notes/0.10.0.md · src-tauri/src/managers/model.rs
  18. This release makes Handy roughly feature complete, and the next ones fix issues and polish the app on the way to version one. For dictating on your own computer, Handy is what I'd use.

    Slide text
    Handy

    Next for Handy: stability and polish on the way to V1

    Full list: Handy’s release notes on GitHub, and What’s New in the app.

    Source: github.com/cjpais/Handy/releases/tag/v0.10.0

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built with ❤️ in New York