Visitar URL original
[Fix] function_call: stream multiple DeepSeek V3.1 tool calls correctly by davrens101 · Pull Request #49107 · sgl-project/sglang · GitHub
Skip to content

[Fix] function_call: stream multiple DeepSeek V3.1 tool calls correctly - #49107

Open
davrens101 wants to merge 2 commits into
sgl-project:mainfrom
davrens101:fix/deepseekv31-streaming-multi-call
Open

davrens101 wants to merge 2 commits into
sgl-project:mainfrom
davrens101:fix/deepseekv31-streaming-multi-call

Conversation

@davrens101

@davrens101 davrens101 commented Nov 8, 2026 •

Copy link
Copy Markdown

Fixes #42138

DeepSeekV31Detector's streaming parser used a greedy name regex and did not handle a delta that carries the end of one call plus the start of the next, so the first call's arguments were dropped and the second call's arguments were attached to the first call. Stream calls incrementally and finalize each call on its end marker.


CI States

Latest PR Test (Base): ❌ Run #42434707388
Latest PR Test (Extra): ❌ Run #42434707309
Latest PR Test (AMD ROCm 10): ❌ Run #42434707324

Tip

Base CI only covers the core cases, and its workload may not exercise your change. Use /rerun-test to run the tests your change touches, or copy this prompt for an agent:

Find the registered tests this PR affects and run them with /rerun-test, following https://github.com/sgl-project/sglang/blob/main/.agents/skills/rerun-test/SKILL.md

Signed-off-by: Davis Rens <166565828+davrens101@users.noreply.github.com>

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

@github-actions

This comment has been minimized.

@davrens101 davrens101 changed the title fix(function_call): stream multiple DeepSeek V3.1 tool calls correctly [Fix] function_call: stream multiple DeepSeek V3.1 tool calls correctly Nov 8, 2026
Signed-off-by: Davis Rens <166565828+davrens101@users.noreply.github.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] deepseekv31 detector (streaming): greedy name regex drops a call and attaches the next call's arguments to it

1 participant