Skip to content

Commit 001f519

Browse files
[HiCache] change the default policy to write through (#9772)
1 parent 5ad296b commit 001f519

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

docs/advanced_features/server_arguments.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -236,7 +236,7 @@ Please consult the documentation below and [server_args.py](https://github.com/s
236236
| `--enable-hierarchical-cache` | Enable hierarchical cache. | False |
237237
| `--hicache-ratio` | The ratio of the size of host KV cache memory pool to the size of device pool. | 2.0 |
238238
| `--hicache-size` | The size of the hierarchical cache. | 0 |
239-
| `--hicache-write-policy` | The write policy for hierarchical cache. | write_through_selective |
239+
| `--hicache-write-policy` | The write policy for hierarchical cache. | write_through |
240240
| `--hicache-io-backend` | The IO backend for hierarchical cache. | |
241241
| `--hicache-storage-backend` | The storage backend for hierarchical cache. | None |
242242

python/sglang/srt/server_args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -286,7 +286,7 @@ class ServerArgs:
286286
enable_hierarchical_cache: bool = False
287287
hicache_ratio: float = 2.0
288288
hicache_size: int = 0
289-
hicache_write_policy: str = "write_through_selective"
289+
hicache_write_policy: str = "write_through"
290290
hicache_io_backend: str = "kernel"
291291
hicache_mem_layout: str = "layer_first"
292292
hicache_storage_backend: Optional[str] = None

0 commit comments

Comments
 (0)