Skip to content

Bananaflow MCP is live.

Read the docs

Hinglish Voice Agents for Mixed-Language Calls

Jaseem Abbas, founder of Bananaflow, in glasses and a dark top against a pale background.Jaseem Abbas

Published
Updated
Cover for "Hinglish Voice Agents for Mixed-Language Calls": a white line diagram of one sentence in two languages: a caller speaks one unbroken wave, its first half labelled Hindi and its bold second half labelled English, which runs along an arrow into a lit node labelled Hears it as said, drawn over a soft, out-of-focus bellflower in muted aqua, its open bells blurred into veils, with a sky blue haze at one end and a dusty rose glow at the other.

A customer in Lucknow calls about her washing machine. "Mera machine start nahi ho raha, error E4 aa raha hai, aur warranty mein hai ya nahi?" In one breath she used Hindi grammar, English nouns, a code and a question. A person on the helpline follows without effort. A voice agent has to do three hard things at once: hear the mix, understand it and answer in the right mix.

This guide is for teams building voice agents for Indian callers. It covers what Hinglish is, why it is hard for machines, and what works for scripts, numbers, names and mid-call switching. It is part of our guides on AI calling.

What is Hinglish?

Hinglish is the everyday mix of Hindi and English in a single sentence or conversation. Linguists call it code-mixing or code-switching. A speaker uses Hindi for the sentence's structure and English for some of its words, or moves to full English sentences and back, without noticing.

Look at three examples of how real callers talk:

  • "Mera order abhi tak deliver nahi hua." The structure is Hindi. "Order" and "deliver" are English.
  • "Haan, I will pay tomorrow, kal shaam tak." The call moves between two full clauses.
  • "Booking cancel kar do, refund kab tak aayega?" Two questions, one language, two origins.

Hinglish can be written in two ways. Devanagari writes Hindi in its own script: "मेरा ऑर्डर अभी तक डिलीवर नहीं हुआ।" Roman letters write the same sounds in English letters: "Mera order abhi tak deliver nahi hua." On phone calls, the script matters for the agent's written text. The caller never sees it, but the agent's speech-to-text writes it down and its prompt reads it.

Why is Hinglish hard for a voice agent?

It is hard because the agent has to recognise two languages' sounds in one stream, often inside one sentence, on a phone line with noise. A system trained on clean Hindi or clean English alone can fail on the mix. Our guide to what to check in an Indian LLM covers the model side.

Published research says so directly. A paper presenting a Hindi-English code-switching speech corpus explains that switching can happen inside a sentence (intra-sentential) or at the boundary between sentences (inter-sentential), and that English pronunciation variation together with code-switching makes recognition a challenging task. The 2021 multilingual and code-switching ASR challenge shows the same gap in numbers. Its baseline system reached a word error rate of 30.73% on the multilingual task and 32.45% on the code-switching task, across Indian languages including Hindi-English. Those are research baselines, not products, but they show where the difficulty is. A further paper on end-to-end Hindi-English code-switching recognition names two obstacles: more output labels because two languages are involved, and too little suitable training data. The same errors carry into speech analytics on recorded calls. Phone audio itself makes it harder still, as our guide to Hindi speech to text on calls explains.

The practical lessons are three:

  • Speech recognition is the first weak point. If the words are heard wrongly, every later step suffers.
  • Pronunciation varies by region and by person. "Warranty" and "appointment" come out differently from Pune to Patna.
  • Text and voice are different problems. A script that reads well on a page can sound stiff when spoken.

How do you write a Hinglish script?

Write it the way your callers speak, not the way a textbook would. Use Hindi for the sentence and the usual English words for the nouns. Aim for short sentences with one idea each.

Choose what stays in English

Callers say some words in English even when they speak Hindi to everyone else. The usual ones: order, appointment, payment, refund, booking, delivery, address, pin code, OTP, EMI, policy, account. Translating them into formal Hindi makes the agent sound like a government notice. "Bhugtan" for "payment" is correct and few callers use it on the phone.

A good test is to read the line aloud to a colleague. If they smile, it is too formal.

Pick a script for the agent's text

Tell the agent which letters to use for each language, in the prompt. For example: "Write Hindi in Devanagari. English words stay in English letters." Bananaflow's languages page describes this as naming the scripts in the prompt, so replies come back in the letters you expect. This matters because a text-to-speech voice reads the characters it is given. In our tests the voice mispronounced English words written in a native script, so keep common English words in English letters. For a fuller guide to writing the prompt itself, read how to write a voice agent prompt.

Here is the same line in three styles:

  • Style: Formal Hindi

    Line
    "आपके द्वारा किया गया भुगतान प्राप्त हो गया है।"
    Spoken sound
    Stiff. Few callers speak this way on the phone.
  • Style: Hinglish, English word in English letters

    Line
    "आपका payment मिल गया है।"
    Spoken sound
    Natural. Hindi in Devanagari, the English noun in English letters. In our tests the voice said this more clearly than the noun in Devanagari.
  • Style: Roman Hinglish

    Line
    "Aapka payment mil gaya hai."
    Spoken sound
    Natural. Good for notes and logs. Check how your voice reads Roman letters.

For more lines in this style, see telecalling scripts in Hindi.

How should a voice agent say numbers in Hinglish?

Say amounts, dates and times as English words, the Indian way, and read long numbers in small groups. In our tests, Hindi number words were harder for callers to follow and slipped in where we did not want them. Every number in English words worked better, in every reply language. Write this as a rule in the prompt, and keep the same style for the whole call. Do not put a quoted example number in the prompt, because the voice tends to copy it.

Practical rules:

  • Phone numbers and codes: digit by digit, in groups of three or four, in English digits ("nine eight seven... five four three...").
  • Pin codes: six digits, one by one, or two groups of three.
  • Amounts: as English words, the Indian way: lakh and crore, and "fifteen hundred rupees" for 1,500. Avoid Hindi number words, and avoid the Western "one million" style.
  • Dates: the day and the month name in English words, "twelfth of December", and not "12/12".
  • Times: as English words, "four thirty" for 4:30. A caller who says it in Hindi should still hear it back in English words.
  • Read back and confirm. After reading a number back, have the agent check with the caller that it is right. This costs three seconds and saves a wrong record. In our tests a quoted tag question in a prompt was copied into other languages almost word for word, so describe the habit in the prompt instead of quoting a line.

How should a voice agent handle names?

Names are where voices fail most visibly. A text-to-speech voice may read a Roman-letter name in the English way, so a caller named "Ananya" or "Venkataraman" hears something odd. Bananaflow has a speech-to-text word list for brand names and jargon, which helps the agent hear them. To control how the voice says a name, respell it in the prompt.

So what do you do?

  • Test every name you care about by voice. Brand names, product names, city names, the common first names in your customer list.
  • Rewrite in the script if needed. If a voice mangles a name written in English letters, try the same name in Devanagari in the script, and listen again.
  • Use the word list for hearing. Add your brand names and jargon so the agent recognises them when callers say them.
  • Avoid reading out a stranger's full name. Use the first name only, and ask the caller to confirm who they are.

How should a voice agent switch language mid-call?

It should follow the caller's language once it is clear, and not before. A caller who says "haan" or "OK" in the middle of a Hindi call has not changed language. A caller who answers a full sentence in Tamil has.

On Bananaflow, the agent greets in the starting language you set, then follows the caller's language from their first clear sentence, on inbound and outbound calls. Mixed speech alone never switches the call to another language. With English and one Indian language, speech-to-text listens in the Indian language for the whole call and still writes English words as English. Switching works on Bananaflow's managed voices, on voice calls, for agents set to two or more languages. With two or more Indian languages, a short first word such as "haan" can be misheard until the first full sentence.

The switch covers English and 10 Indian languages, so a Hinglish agent can also move on to Tamil or Bengali when a caller does. The languages page has the detail.

One call, three moments. A Hindi sentence with English words stays in Hindi. A single 'haan' changes nothing. A full sentence in Tamil moves the call to Tamil.

What about "haan" and "ruko"?

Backchannel words are the small sounds callers make while the agent talks. "Haan" means go on. "Ruko" means stop. A good agent lets "haan" pass and stops for "ruko". Bananaflow keeps a list of words to ignore and words that stop the agent, with starter lists for all 11 languages. The Hindi, English and Malayalam lists were built from real calls, and you can edit any list. For why agents stop for the wrong words, and how to tune turn-taking, see our guide to endpointing and turn detection.

How do you test a Hinglish agent?

Test with the people who sound like your callers. A script that passes in your office can fail on a caller from a different city.

  1. Test by voice in the browser. Call the agent once in each language it speaks.
  2. Say it three ways. Formal Hindi, Hinglish and full English, for the same request.
  3. Use real names and numbers. Customer names, a pin code, a 10-digit phone number, an amount.
  4. Interrupt it. Say "haan" while it speaks and then "ruko". Check which one it stops for.
  5. Read the transcripts. After each test call, read what speech-to-text wrote. Where it misheard a word, add it to the word list or change the script.
  6. Listen to the recordings with someone native. Ask them if it sounds like a person on your team.

Keep a small set of test calls and run it again after every script change. Our guide to how to test a voice agent turns that set into a full test plan.

What should you avoid?

  • Over-formal Hindi. It sounds like a notice.
  • Switching the whole call on one English word. "OK" is not a language change.
  • Long numbers in one breath. Group them.
  • Assuming one voice speaks every language equally. Each voice speaks only its own subset, so pick the voice for the languages the line needs. See how Indian-language voices sound on a call.
  • Skipping the test. The voice is where small mistakes show.

How Bananaflow fits

Bananaflow is an AI voice agent platform for Indian businesses. It speaks English and 10 Indian languages, hears Hindi mixed with English as it was said (see the Hindi AI voice agent page), and follows the caller's language during a call. You set the languages for each agent, test each one by voice in your browser, and publish. Read about it on the languages page, or see how it fits a customer support line. For the basics of how a voice agent works on a call, read what is conversational AI.

FAQ

Frequently asked questions

  • What is Hinglish?

    Hinglish is the everyday mix of Hindi and English in one sentence or conversation, such as "Mera order abhi tak deliver nahi hua". Linguists call it code-mixing. It is how many urban Indian callers speak on the phone.

  • Should a Hinglish script be in Devanagari or Roman letters?

    For the agent's spoken lines, tell it which script to use for each language, for example Devanagari for Hindi and English letters for English words. In our tests the voice mispronounced English words written in a native script. Roman letters are handy for team notes and logs. Test how your chosen voice reads each style.

  • How should a voice agent read numbers in Hinglish?

    Read phone numbers and pin codes digit by digit in small groups, and say amounts, dates and times as English words the Indian way (lakh, crore, "fifteen hundred rupees"). In our tests this worked better than Hindi number words, in every language. Have the agent check the number back with the caller. Keep one style for the whole call.

  • When should a voice agent switch language mid-call?

    When the caller moves to another language for a full sentence, not for one word. On Bananaflow the agent follows the caller's language from their first clear sentence, and mixed speech alone never switches the call.

  • Why is Hinglish hard for speech recognition?

    Switching happens inside sentences, English words are pronounced in many local ways, and phone audio is noisy. A 2021 research challenge reported baseline word error rates of about 30 to 32 percent on multilingual and code-switching tests.

  • Can I control how the voice pronounces names?

    Not with a dictionary: Bananaflow has a speech-to-text word list that helps the agent hear brand names, but it does not change how the voice says them. Test names by voice and adjust the script wording.

Written by

  • Jaseem Abbas, founder of Bananaflow, in glasses and a dark top against a pale background.

    Jaseem Abbas

    Founder, Bananaflow

    Jaseem founded Bananaflow to build voice AI that understands how people in India really speak, including the switch between languages in the middle of a call.

Similar articles

Bring us one process. We'll pilot it on your real calls, with your team as the fallback.

Plan a pilot