Skip to content
Operon AI
All resources
EngineeringApril 21, 2026 · 8 min read

Why 400 milliseconds is the line between a conversation and a phone tree

Human turn-taking has a rhythm. Cross it and callers start talking over your agent, repeating themselves, and asking for a person. An engineering breakdown of our voice path.

RC
Ravi Chandrasekhar
Principal Engineer, Voice

In natural conversation, the gap between one speaker finishing and the next beginning averages around 200 milliseconds. Push past 500 and the listener starts to fill the silence. Push past 800 and they assume the line dropped.

Where the milliseconds go

A voice turn is not one model call. It is endpoint detection, transcription, retrieval against the Brain, reasoning, tool calls into the scheduling system, speech synthesis, and network transit. Any one of those can eat your entire budget.

  • Endpointing: 90ms with a streaming VAD tuned per-vertical
  • Transcription: streamed, first partial in 60ms
  • Retrieval and reasoning: 180ms median with a warm cache
  • Synthesis: first audio frame at 70ms

The trick is not speed, it is overlap

We start synthesizing the opening of a response while the reasoning for the rest of it is still running. Callers hear a natural start, and the remainder arrives before they notice a seam.