Skip to content

Commit d172eb4

Browse files
whybeyoungxwu-intel
authored andcommitted
[PD] Fix Assertion failed: /DeepEP/csrc/kernels/internode.cu:483, condition: ibgda_get_state()->num_rc_per_pe >= num_channels sgl-project#134 (sgl-project#5830)
1 parent a4c14cf commit d172eb4

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

python/sglang/srt/layers/moe/ep_moe/token_dispatcher.py

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -84,9 +84,7 @@ def get_deepep_buffer(
8484
num_nvl_bytes,
8585
num_rdma_bytes,
8686
low_latency_mode=deepep_mode.enable_low_latency(),
87-
num_qps_per_rank=(
88-
num_experts // group.size() if deepep_mode.enable_low_latency() else 1
89-
),
87+
num_qps_per_rank=(max(num_experts // group.size(), Buffer.num_sms // 2)),
9088
)
9189
return cls._buffer
9290

0 commit comments

Comments
 (0)