DualTurn · Learning turn-taking from dual-channel generative speech pretraining
Shangeth Rajaa (Anyreach AI). Accepted at Interspeech 2026. arXiv:2603.08216.
Agent-action wF1, Switchboard (higher is better)
What we built
A 0.5B backbone pretrained to predict both speakers’ future audio, then lightweight heads for five agent actions.
Why it matters
The first use of speech-to-speech generative pretraining for explicit turn-taking in modular ASR-LLM-TTS pipelines.
- “The backbone is the vessel, not the source.”
- 56% of turn-end signal is semantic, 26% prosody
- Continuous embeddings beat discrete tokens
- Code, model and datasets are open