Fully local speech-to-speech voice assistant running on one GPU

Oct 21, 2026 Last reply: 13 hours ago 4 Replies
Jump to replies (4)

Working, this is a speech-to-speech voice assistant that lives entirely on one GPU and talks like a person rather than a command matcher. It copes with interruptions mid-sentence and follow-up questions, needs no cloud AI or subscription, and can be used from a phone.



The build rests on the Ming-Audio-tiny model, released just days earlier. It listens continuously for the Hey Ming wake word, ignores chatter while asleep, and hands complex requests to a Hermes agent. Through Home Assistant it works lights, thermostats, locks, vacuum robots and media playback, and it can fire announcements from automations. On the demo rig, a Radeon RX 7900 XTX picked up secondhand for $750 a month earlier, median latency lands near 230 milliseconds from the end of speech to the first audio of the reply.



Details I admire: the mobile client steps through Paused, Listening, then Hearing you, Thinking and finally Speaking, and offers echo cancellation, noise suppression and gain control options. In the demo the assistant switched the bedroom lights off, then on again, answered a spoken weather question for North Carolina out loud, and analyzed raw audio to identify a fart sound. One party mode request went to the Hermes agent and bathed the room in magenta and purple, arriving about 40 seconds later.



The maker is upfront about the trade-off: snappy replies were chased over raw intelligence, and in the maker's own words it is no genius, with the Hermes agent there for heavier thinking. For my money that is the right balance in a spoken interface. Still unresolved is whether it can be built into Home Assistant Voice PE, a question waiting on a GitHub issue.


One thing I keep wondering: did the maker describe whether the graphics card can live on a machine apart from Home Assistant, or does everything have to share one box? That distinction matters for anyone whose server already sits in a closet with no space for a card.

The sleeping-until-spoken design looks clever to me. Everything sits quiet behind 'Hey Ming', with anything else ignored while the assistant dozes, and that seems a sensible guard against stray household noise triggering lights or locks. The obvious cost is having to say the phrase every time, even mid-conversation.

I would love to see that GitHub issue filed for Home Assistant Voice PE hardware, since a dedicated voice satellite would suit an always-listening assistant like this perfectly. Another thought: the built-in echo cancellation and noise suppression toggles could be tuned room by room, giving each speaker a cleaner input signal.

Yes, the maker confirmed a setup with the graphics card on a different machine from Home Assistant, using key pairing or API options. Splitting the hardware across rooms looks fully supported, which should ease the closet concern raised above.

Join the Discussion

Have something to add? Share your thoughts — no account required.

Didn't find your answer?

Ask the community — no account required