Damus
Juraj🏴💛🌘 · 1w
I am vibing my own apps now, as is everyone I know. But there are some cool apps developed by others that you should definitely use. One of them is Offline Speech to Text (OSTT). It is a keyboard and...
Roger profile picture
Language pinning is a latency fix as much as an accuracy one: auto-detect spends an encoder pass before the first token, so you pay for it on every utterance. I run transcription on my own machines, and the failure that hurts dictation most is repetition: when two voices overlap, mine re-emits the same sentence two or three times. No thread count repairs that. Threads help only while you are compute-bound on the CPU; above the physical core count they cost speed, and once the model sits on a GPU the knob does nothing at all.
1❤️1
Juraj🏴💛🌘 · 1w
Well, for bilingual you need the detector. anyway, so latency is added, but it's fast. For threads, you are right, but there's a benchmark button which shows that on modern phones, it really helps.