Local AI Weekly #10: Say It, Don't Type It

Ubuntu now ships local dictation, and my inbox is full of open source voice tools. This week, I look at what happens between your mouth and your cursor

I have said it in the past and I am saying it again. Voice is going to be the preferred input method in the future, be it smartphones or desktop computers.

And Voice is one of the best cases for local AI. Speech models are small enough to run on an ordinary laptop. And your voice is about as personal as data gets. After all, you surely don't want every half-formed sentence you mutter going to someone else's server to train their AI.

🐧 Linux gets a voice (input)

Ubuntu 26.10 shipped Myna, Canonical's speech-to-text tool. You press a shortcut, speak, and the text appears in whatever app you're using.

It runs Parakeet, Whisper or FunASR locally and needs no internet once the model is downloaded.

Myna is not the only such tool. There are many other tools like Vocalinux and TuxTalk. Commercial tools like Superwhisper are also available for Linux but they are not really local.

Most dictation tools, from Myna to Superwhisper, do the same four things.

First, something decides when you're actually speaking and trims the silence. Then a speech model, usually Whisper or Parakeet, turns your audio into raw text. Some tools pass that text through a local LLM to fix punctuation, terms and formatting. Finally, the tool types the result into your active window.

The cleanup step is optional, and it isn't free. A second model means more RAM in use and a longer wait before your text appears. For short messages, raw Whisper output is often good enough.

🔍 Discover AI tools

WhisPaste 1.5 came out on 16 November. This MIT-licensed app transcribes on your machine with whisper.cpp or Parakeet, and cloud providers are optional. The new version can transcribe audio and video files locally too, from MP3 and FLAC to MKV and WebM. Your history and notes are now stored encrypted.

Koe is the one that does the LLM cleanup step locally. It's written in Rust and MIT-licensed. Speech goes through whisper.cpp, and the transcript is then tidied up by a model running in Ollama. The developer built it for writing Japanese on Ubuntu, but speech recognition covers any language Whisper does.

🧪 On my desk

I use Proton's ecosystem at It's FOSS. I use their email service for @itsfoss emails, their VPN, cloud storage and password manager. The entire Proton ecosystem is built on the privacy promise.

Proton also offers its own private AI called Lumo. Up until now, it was boring and wasn't of much use, it was just a chatbot, like what chatGPT was back in 2024.

But yesterday, Proton revamped Lumo with a desktop app and it now has the options for skills, connectors and accessing system files and shell.

And now it is actually useful. Your data stays private and yet you can use it for email triaging, GitHub management and several other tasks.

It still has a long way to go, but at least Proton has taken the step in the right direction.

🗂 AI jargon: VAD

VAD stands for voice activity detection. It's a tiny model that listens to your microphone and decides whether a sound is speech or just noise, your fan or the keyboard.

Dictation tools use it to cut silence before the audio reaches the speech model. Less audio means faster transcription. It also means Whisper doesn't get the chance to "hear" words in silence, which it's known to do. Silero VAD is the common choice, and Koe supports it.

⚡ Quick Tip

Most of these tools let you choose which Whisper model to download. Bigger isn't always better for dictation.

If you only dictate in English, pick a model ending in .en, like base.en or small.en. These English-only versions tend to be more accurate than the multilingual model of the same size, especially at the smaller sizes.

On a laptop without a good GPU, start with small.en and move up only if it keeps getting your words wrong. A model that's slow to respond will annoy you more than the occasional typo.

See you next week 🙂

About the author
Abhishek Prakash

Abhishek Prakash

Created It's FOSS 13 years ago to share my Linux adventures. Have a Master's degree in Engineering and years of IT industry experience. Huge fan of Agatha Christie detective mysteries 🕵️‍♂️

Become a Better Linux User

With the FOSS Weekly Newsletter, you learn useful Linux tips, discover applications, explore new distros and stay updated with the latest from Linux world

itsfoss happy penguin

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to It's FOSS.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.