Skip to content

fix: exclude agent speech from dynamic endpointing pauses - #7061

Open
chenghao-mou wants to merge 2 commits into
chenghao/fix/AGT-3352-restore-endpointing-overlapfrom
chenghao/fix/AGT-3416-preserve-agent-speech-marker
Open

fix: exclude agent speech from dynamic endpointing pauses#7061
chenghao-mou wants to merge 2 commits into
chenghao/fix/AGT-3352-restore-endpointing-overlapfrom
chenghao/fix/AGT-3416-preserve-agent-speech-marker

Conversation

@chenghao-mou

@chenghao-mou chenghao-mou commented Aug 31, 2026

Copy link
Copy Markdown
Member

Problem: An overlap ending before agent playout cleared the agent speech timestamps. Dynamic endpointing then learned the remaining agent audio as an intra-user pause.

Behavior: Preserve the active agent speech interval until playout ends, and pass interruption state as true, false, or unknown. The completed interval prevents agent audio from being learned as a user pause.

Depends on #6939. Original report: #7057. Addresses AGT-3416.

Initial prompt and agent context

Model: GPT-5.6

can you investigate https://linear.app/livekit/issue/AGT-3416/dynamicendpointing-backchannel-during-agent-speech-makes-agent-audio?

okay, then we can bring in the tristate instead

if an user speech outlives an agent speech, that should be considered an input for the next turn, and therefore is not backchannel.

can you create a PR and stack it on 6939?

should we keep the start value by checking _agent_speaking?

yes please add this to the PR

@chenghao-mou
chenghao-mou requested a review from a team as a code owner August 31, 2026 13:48

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note

This report is out of date. Scroll down for Devin Review's latest report on this PR.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

@chenghao-mou
chenghao-mou force-pushed the chenghao/fix/AGT-3416-preserve-agent-speech-marker branch 2 times, most recently from 8b07c18 to 00d1803 Compare August 31, 2026 15:02
@chenghao-mou
chenghao-mou force-pushed the chenghao/fix/AGT-3416-preserve-agent-speech-marker branch from 00d1803 to 195f770 Compare August 31, 2026 15:09
devin-ai-integration[bot]

This comment was marked as resolved.

@chenghao-mou
chenghao-mou force-pushed the chenghao/fix/AGT-3416-preserve-agent-speech-marker branch from 26054ce to 5400f37 Compare September 1, 2026 11:51
@chenghao-mou
chenghao-mou force-pushed the chenghao/fix/AGT-3416-preserve-agent-speech-marker branch from 5400f37 to d44bdb0 Compare September 1, 2026 12:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant