Skip to content

Commit e3f2266

Browse files
committed
fix max_block_num and max_num_batched_tokens setting
1 parent 2821642 commit e3f2266

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

fastdeploy/engine/args_utils.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,7 @@
1818
from dataclasses import asdict, dataclass
1919
from dataclasses import fields as dataclass_fields
2020
from typing import Any, Dict, List, Optional
21+
import os
2122

2223
from fastdeploy.config import (
2324
CacheConfig,

0 commit comments

Comments
 (0)