Skip to content

Commit d3e1522

Browse files
author
liuzichang01
committed
fix docs
1 parent 164b83a commit d3e1522

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/zh/features/speculative_decoding.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -108,7 +108,7 @@ python -m fastdeploy.entrypoints.openai.api_server \
108108
```
109109

110110
## 🧠 使用 Ngram 解码
111-
该算法通过 n-gram 窗口从 prompt 和已生成的 Token 中进行匹配生成草稿 Token,适合输入和输出有很大 overlap 的场景如代码编辑、文档查询等查看论文地址
111+
该算法通过 n-gram 窗口从 prompt 和已生成的 Token 中进行匹配生成草稿 Token,适合输入和输出有很大 overlap 的场景,如代码续写、文档查询等
112112
> 使用 4×H100;量化方式选择 WINT4
113113
> 配置文件:benchmarks/yaml/eb45t-32k-wint4-mtp-h100-tp4.yaml
114114
```

0 commit comments

Comments
 (0)