Soham Ray
Speaker

Soham Ray

Research Engineer @Sierra, Previously Research Engineer at ASAPP and Conducted NLP Research at Cornell

Soham Ray is a Research Engineer at Sierra, where he works on voice and agents and leads work on τ-bench and τ-voice, benchmarks for evaluating agent capability in realistic conversational settings. 

Before Sierra, he spent three and a half years as a Research Engineer at ASAPP, working with Prof. Kilian Weinberger on customer service AI automation and building production customer support agents. He previously conducted NLP research at Cornell with Prof. Claire Cardie on NLP-assisted automated theorem systems, and worked as a Data Scientist at Afiniti. He holds a CS degree from Cornell University and is based in the San Francisco Bay Area.

Session

Benchmarking Voice Agents in the Wild: Mapping the Capability Gap Between Text and Voice

Text-based language agents have gotten very good at reasoning and tool calling, and that success carries over to voice — but only under ideal acoustic conditions. Once you put an agent into a realistic, full-duplex conversation, performance falls off a cliff.

Read more →