Handled well: no error, or one a front desk would shrug off. Graded against
a written rubric and the booking system's final state, checked by hand on 15
calls.
Wrong on our voices: a surname, date of birth or phone number captured wrong
without asking again, on 59 lines recorded by two of us. The three-part
stack asked again on 15 of 59 instead.
Wait: the median, from the end of the caller's speech.
Blind listen, two of us on 10 clips a voice (naturalness out of 5; share fit
for patients): ElevenLabs Agents 4.7, 100%; the three-part stack 3.8, 100%;
Gemini 2.1, 45%; OpenAI realtime 1.9, 50%. 12 live calls by two of us on
Gemini and the three-part stack: none broke, and one on the three-part stack
went wrong.
Synthetic data: a simulated patient and a fictional practice. No client
data.
Full study on request:
hugo@jayn.app