Tag
Latency
Deep dives on agent platforms, real-time systems, and evaluation. RSS
Python Is Lying to You: Async Pitfalls in Real-Time Audio Pipelines
Why async def doesn’t mean non-blocking: CPU-bound guardrails, blocking loggers, and GIL contention that degrade production voice AI audio, and the fixes.
Cutting 600ms from Every Voice AI Turn with Local VAD
Replacing OpenAI Realtime API server-side turn detection with local VAD cut perceived latency by 689ms per substantive turn in a controlled 100-turn test over production telephony.