Skip to content

Commit 7c39e8a

Browse files
authored
Fix Bug 'get_cpu_copy not Implemented' in pd offloading mode (sgl-project#7982)
1 parent d969504 commit 7c39e8a

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

python/sglang/srt/mem_cache/allocator.py

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -526,6 +526,12 @@ def clear(self):
526526
self.is_not_in_free_group = True
527527
self.free_group = []
528528

529+
def get_cpu_copy(self, indices):
530+
return self._kvcache.get_cpu_copy(indices)
531+
532+
def load_cpu_copy(self, kv_cache_cpu, indices):
533+
return self._kvcache.load_cpu_copy(kv_cache_cpu, indices)
534+
529535

530536
def alloc_extend_kernel_ascend(
531537
prefix_lens,

0 commit comments

Comments
 (0)