【BugFix】completion接口echo回显支持 #3470
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
本次支持了completion 接口的单/多prompt的echo回显:
具体而言,针对于v1/completion接口
请求:
curl -X POST http://127.0.0.1:8566/v1/completions \ -H "Content-Type: application/json" \ -d '{ "prompt": "以下是你的自我介绍:", "echo": true }'结果:(能够做到prompt拼接在回复文本之前)
..."text":"以下是你的自我介绍:\n这是我的第一篇博客,欢迎大家来阅读。\n我是来自2018级计算机科学与技术专业的刘文博。"...实现相同功能,能够做到prompt拼接在第一包返回的文本之前。