Support logprobs in two-batch overlap (sgl-project#7709)

fzyzcjy · web-flow · commit a291439a59d9 · 2025-07-05T19:05:32.000-07:00
diff --git a/python/sglang/srt/two_batch_overlap.py b/python/sglang/srt/two_batch_overlap.py
@@ -550,6 +550,8 @@ def filter_batch(
                 top_p_normalized_logprobs=False,
                 top_p=None,
                 mm_inputs=None,
+                top_logprobs_nums=None,
+                token_ids_logprobs=None,
             )
         )
 

Original file line number	Diff line number	Diff line change
`@@ -550,6 +550,8 @@ def filter_batch(`
`550`	`550`	`top_p_normalized_logprobs=False,`
`551`	`551`	`top_p=None,`
`552`	`552`	`mm_inputs=None,`
	`553`	`+ top_logprobs_nums=None,`
	`554`	`+ token_ids_logprobs=None,`
`553`	`555`	`)`
`554`	`556`	`)`
`555`	`557`