OpenWhisper 0.5 transcribes as you talk and spells your jargon right

3 hours ago

OpenWhisper is a menu bar app that turns your voice into text and pastes it into whatever app you're using, all on your Mac. Version 0.5 adds models that transcribe while you're still talking, and a vocabulary that gets names and jargon right. Apple's built-in engine, though, needs macOS 26.

Ask about this presentation

Chapters

  1. 0:00OpenWhisper 0.5
  2. 0:20Streaming
  3. 0:36Thirteen engines
  4. 0:56Vocabulary tab
  5. 1:16Corrections
  6. 1:35Smaller fixes
  7. 1:57Tests
  8. 2:19Before you switch
  9. 2:41Upgrade
Show transcript
  1. OpenWhisper is a menu bar app that turns your voice into text and pastes it into whatever app you're using, all on your Mac. Version 0.5 adds models that transcribe while you're still talking, and a vocabulary that gets names and jargon right. Apple's built-in engine, though, needs macOS 26.

    Slide text
    OpenWhisper app icon

    OpenWhisper 0.5 transcribes as you talk and spells your jargon right

    9 streaming models · a Vocabulary tab · Press & Hold
    OpenWhisper 0.5.0
  2. The four Whisper models wait until you stop, then transcribe the whole recording. The new streaming models transcribe the audio as it arrives, and the main window's status line shows the latest words while you speak. When you stop, the app finishes that same stream.

    Slide text

    Streaming models transcribe while you're still talking

    Whisper 4 batch models
    transcribes the whole clip
    Streaming 9 models
    transcribing as the audio arrives
    finish
    OpenWhisper 0.5.0
  3. Settings now has a searchable Voice Model picker. Apple's engine sits on top, then eight downloadable streaming models, then Whisper, which adds a Large option at 1.1 gigabytes. Parakeet Unified scores highest on accuracy, and Moonshine Tiny is the smallest and fastest, at 50 megabytes.

    Slide text

    Settings now offers 13 speech engines

    Voice model Size Accuracy Speed Languages
    Apple (built in) built in not scored not scored set by macOS
    Parakeet Unified 0.6B 609 MB 90 79 English
    Moonshine Medium 296 MB 87 83 English
    Voxtral Mini 4B Realtime 2.8 GB 87 11 13 + auto
    Multitalker Parakeet 0.6B 617 MB 86 96 English
    Nemotron Speech EN 0.6B 475 MB 86 80 English
    Moonshine Small 199 MB 84 95 English
    Nemotron 3.5 ASR 0.6B 496 MB 82 84 28 + auto
    Moonshine Tiny 50 MB 74 100 English
    Whisper Medium 568 MB 84 42 99 + auto
    Whisper Large 1.1 GB 84 23 99 + auto
    Whisper Small 163 MB 80 78 99 + auto
    Whisper Base 148 MB 71 99 99 + auto
    new in 0.5 · Scores out of 100 from Handy's model catalog; speed measured on a PC
    OpenWhisper 0.5.0
  4. A new Vocabulary tab holds the names and terms you use, on top of about 230 built-in ones like PostgreSQL and OAuth. Your list stays on this Mac. Whisper and Apple's engine get those terms as a hint. Then a local pass corrects close misses in the final text, whichever engine you picked.

    Slide text

    A new Vocabulary tab for names and jargon

    Add terms, e.g. AcmeDB, PostgreSQL, NYSE
    Stays on this Mac.
    Sits on top of about 230 built-in terms.
    Your terms typed or pasted, one per line or comma
    Hint Whisper and Apple's engine get the terms before they decode
    Correct a local pass fixes close misses in the final text, on every engine
    OpenWhisper 0.5.0
  5. If you say PostgreSQL and the model hears "poster SQL", you still get PostgreSQL. A garbled NYSE gets fixed too. Add AcmeDB to your list, and a lowercase acmedb comes out spelled your way. Ordinary prose is left alone, so Jason stays Jason.

    Slide text

    “poster SQL” now comes out as PostgreSQL

    Use poster SQL PostgreSQL for the database.
    I trade on Nyzi NYSE.
    connect to acmedb AcmeDBafter you add AcmeDB to your list
    Jason wrote a note.left alone, though JSON is a built-in term
    OpenWhisper 0.5.0
  6. A new Recording Mode, Press and Hold, records while you hold the hotkey and transcribes when you let go. Toggle stays the default. You can now cancel while the app is processing. Cleanup removes only sound markers like blank audio, so a TODO in brackets survives. And if Accessibility access is off, the app says so, and your text waits in History.

    Slide text

    Press & Hold recording, and three smaller fixes

    Press & Hold Hold the hotkey to record, release to transcribe. Toggle stays the default.
    Cancel while processing Your cancel hotkey now works during Processing, and the menu bar has Cancel Transcription.
    [TODO] stays in Cleanup removes only sound markers like [BLANK_AUDIO] or (music).
    Paste needs Accessibility Without it, the app says so and the text waits in History.
    OpenWhisper 0.5.0
  7. Three of the four pull requests in this release are about testing and review. Every pull request now feeds recorded audio through Whisper. Silence has to come out empty, noise nearly empty, and a short English clip has to come back with its key phrases. Alongside that come unit tests, UI tests that click through the app, and automated code and security review.

    Slide text

    Every pull request now runs real speech through Whisper

    Recording Expected transcript
    silence.wav empty
    background-noise.wav empty, or nearly empty
    english-e2e-test-1.m4a “Hello, this is me testing that OpenWhisper end-to-end tests work properly.”
    + unit tests, UI tests that click through the app, and automated code and security review on pull requests
    OpenWhisper 0.5.0
  8. Nothing here is marked as breaking, and an existing install keeps its Whisper model. Before you switch, know that Apple's engine needs macOS 26 and may download its speech model the first time. Six of the new models are English only. Voxtral is a 2.8 gigabyte download. And Multitalker Parakeet doesn't label speakers.

    Slide text

    Check these before you switch models

    Nothing in 0.5 is marked breaking, and an existing install keeps its Whisper model.

    Apple's engine needs macOS 26, and the first run can download Apple's speech model
    English only Parakeet Unified, Moonshine, Nemotron Speech EN and Multitalker
    Big downloads Voxtral 2.8 GB, Whisper Large 1.1 GB
    No speaker labels Multitalker Parakeet transcribes, but doesn't say who spoke
    OpenWhisper 0.5.0
  9. To upgrade, choose Check for Updates in the menu bar, or download the disk image from the Releases page. Then try a streaming model on your own voice, because those speed scores came from a PC, and add your team's names to the Vocabulary tab. That's OpenWhisper 0.5, transcribing as you talk and spelling your jargon right.

    Slide text

    Upgrade to 0.5.0, then try a streaming model on your own voice

    1
    Check for Updates… in the menu bar or download OpenWhisper.dmg from the Releases page
    2
    Settings → Voice Model, then Vocabulary pick a streaming model and add your team's names
    github.com/richardwu/openwhisper/releases/tag/v0.5.0
    OpenWhisper 0.5.0

What happened in AI today, in your inbox

One short email each evening. Read it and you’re caught up.

Built in New York with ❤️