Discussions

Ask a Question
Back to all

LiveAvatar FULL mode: Hindi speech input not recognized properly (STT transcribes wrong/garbled)

Hey guys,

I'm using LiveAvatar in FULL mode with ElevenLabs TTS (Hindi-capable voice selected), but when I speak in Hindi during interactive sessions, the STT/ASR seems to default to English or poor auto-detect.

It transcribes my Hindi input completely wrong (e.g., turns "नमस्ते, कैसे हो?" into random English words or gibberish), so the avatar doesn't understand/respond correctly in Hindi.

I've added a strong prompt in the context:

  • "Always respond in Hindi. Understand user input as Hindi only."
  • Text input in Hindi works fine (Devanagari recognized, responses in Hindi via ElevenLabs).
  • But voice input fails consistently.

From the docs/FAQ, FULL mode uses Deepgram (or AssemblyAI) for STT by default, and there's no visible language selector in the dashboard for Full mode.

  • Is there any hidden/undocumented way in FULL mode to force STT language to Hindi ("hi" or "hi-IN") without going Custom?
  • For Hindi input specifically, has anyone had success in FULL mode, or is Custom mode basically required for reliable non-English STT?
  • If switching to Custom: Can I keep ElevenLabs TTS and just override STT (e.g., to Gladia) + set language "hi", without building my own full pipeline?

Appreciate any tips, workarounds, or confirmation from the team. Happy to share more setup details/logs if needed.

Thanks!