Lei Pan
Speaker

Lei Pan

Software Engineer @Baseten

Lei Pan is a software engineer at Baseten, where he builds infrastructure for voice AI and multimodal inference. His work focuses on model serving, distributed systems, and performance optimization, with an emphasis on latency, throughput, and reliability. Previously, he worked on GenAI infrastructure at Pinterest, including serving vision-language models for conversational applications. His experience spans optimizing model runtimes and building large-scale real-time GenAI products.

Session

From Speech Models to Voice Agents

Voice agents bring natural conversation to everyday workflows by coordinating three distinct workloads: speech recognition processes continuous audio, a language model reasons and calls tools, and speech synthesis generates audio that must keep pace with playback.

Read more →