Lei Pan
Software Engineer @Baseten
Lei Pan is a software engineer at Baseten, where he builds infrastructure for voice AI and multimodal inference. His work focuses on model serving, distributed systems, and performance optimization, with an emphasis on latency, throughput, and reliability. Previously, he worked on GenAI infrastructure at Pinterest, including serving vision-language models for conversational applications. His experience spans optimizing model runtimes and building large-scale real-time GenAI products.
From Speech Models to Voice Agents
Voice agents bring natural conversation to everyday workflows by coordinating three distinct workloads: speech recognition processes continuous audio, a language model reasons and calls tools, and speech synthesis generates audio that must keep pace with playback.