File tree Expand file tree Collapse file tree 2 files changed +2
-2
lines changed Expand file tree Collapse file tree 2 files changed +2
-2
lines changed Original file line number Diff line number Diff line change @@ -236,7 +236,7 @@ Please consult the documentation below and [server_args.py](https://github.com/s
236
236
| ` --enable-hierarchical-cache ` | Enable hierarchical cache. | False |
237
237
| ` --hicache-ratio ` | The ratio of the size of host KV cache memory pool to the size of device pool. | 2.0 |
238
238
| ` --hicache-size ` | The size of the hierarchical cache. | 0 |
239
- | ` --hicache-write-policy ` | The write policy for hierarchical cache. | write_through_selective |
239
+ | ` --hicache-write-policy ` | The write policy for hierarchical cache. | write_through |
240
240
| ` --hicache-io-backend ` | The IO backend for hierarchical cache. | |
241
241
| ` --hicache-storage-backend ` | The storage backend for hierarchical cache. | None |
242
242
Original file line number Diff line number Diff line change @@ -286,7 +286,7 @@ class ServerArgs:
286
286
enable_hierarchical_cache : bool = False
287
287
hicache_ratio : float = 2.0
288
288
hicache_size : int = 0
289
- hicache_write_policy : str = "write_through_selective "
289
+ hicache_write_policy : str = "write_through "
290
290
hicache_io_backend : str = "kernel"
291
291
hicache_mem_layout : str = "layer_first"
292
292
hicache_storage_backend : Optional [str ] = None
You can’t perform that action at this time.
0 commit comments