[GCU] Enable gcu CI #3190
Merged
[GCU] Enable gcu CI #3190
+87
−45
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
from
800027d to
069474d
Compare
|
Thanks for your contribution! |
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
20 times, most recently
from
03f8018 to
00a565f
Compare
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
5 times, most recently
from
f75d8eb to
5d9aa0c
Compare
yongqiangma
previously approved these changes
Aug 11, 2025
| @@ -675,7 +675,7 @@ def initialize_attn_backend(self) -> None: | |||
| ) | |||
| self.share_inputs["decoder_batch_ids"] = paddle.full([int(decode_max_tile_size)], 0, dtype="int32") | |||
| self.share_inputs["decoder_tile_ids_per_batch"] = paddle.full([int(decode_max_tile_size)], 0, dtype="int32") | |||
| self.share_inputs["decoder_num_blocks_cpu"] = paddle.full([1], 0, dtype="int32").pin_memory() | |||
There was a problem hiding this comment.
这里为什么直接删掉了，删掉后变成一个gpu tensor 了。不使用pinned memory 的话也应该加上.cpu() ？
There was a problem hiding this comment.
这个 tensor 最终会在 get_block_shape_and_split_kv_block kernel 中被用到
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
from
cce50d4 to
8395c3a
Compare
yuanlehome
reviewed
Aug 11, 2025
| self.seq_lens_this_time_buffer[:num_running_requests].copy_( | ||
| self.share_inputs["seq_lens_this_time"][:num_running_requests], False | ||
| ) | ||
| self.seq_lens_this_time_buffer.copy_(self.share_inputs["seq_lens_this_time"], False) |
There was a problem hiding this comment.
-
这里主要是为了配合 第
300行 的修改，更新完整的数据：
self.share_inputs["seq_lens_this_time"] = self.seq_lens_this_time_buffer -
暂时在
GCU上没有采用real_bsz的原因：
AttentionBackend以及预处理后处理算子(update_inputs_gcu/set_value_by_flags_and_idx_gcu等)使用了seq_lens_this_time的shape做了一些操作，应该需要统一整改。 -
real_bsz这一改动对与GCU可能带来的影响：
- 对调度系统，应该需要保证本次调度到的
num_running_requests个请求集中排在整个task列表的前面？ - 对自定义算子等需要使用到
seq_lens_this_time的地方有了约束的变更，需要排查整改?
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
from
81eef32 to
f4d1206
Compare
EnflameGCU
force-pushed
the
enable_gcu_ci
branch
from
f4d1206 to
c10d2b5
Compare
yuanlehome
approved these changes
Aug 13, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
使能
GCU CI