Skip to content

[Feature] Pass through the chat_template_kwargs to the data processing module #3421

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Aug 19, 2025

Conversation

luukunn
Copy link
Collaborator

@luukunn luukunn commented Aug 15, 2025

功能说明: chat_template_kwargs 下所有参数将透传到数据处理模块, 提供给 chat_template 进行拼接。

请求示例:
curl 请求, 直接增加 chat_template_kwargs 参数,如下:
"chat_template_kwargs": {"enable_thinking": false}
"chat_template_kwargs": {"enable_thinking": false, "optinos":{"parallel_tool_calls":false}}

openai client 请求,增加到 extra_body 中,如下:
extra_body={"chat_template_kwargs": {"enable_thinking": False}}

Copy link

paddle-bot bot commented Aug 15, 2025

Thanks for your contribution!

@paddle-bot paddle-bot bot added the contributor External developers label Aug 15, 2025
LiqinruiG
LiqinruiG previously approved these changes Aug 15, 2025
@CLAassistant
Copy link

CLAassistant commented Aug 15, 2025

CLA assistant check
All committers have signed the CLA.

@gzy19990617
Copy link
Collaborator

辛苦能否规范一下PR,并提供一下使用方法和示例~

@luukunn
Copy link
Collaborator Author

luukunn commented Aug 18, 2025

修复chat_template_kwargs中参数未透传问题:
1.透传chat_template_kwargs所有参数,并将所有参数解包塞到request中去进行拼接。
2.设置enable_thinking默认值为True。
3.修改多模关思考断言。
使用方式:
1.所有拼接相关参数都可以放进chat_template_kwargs参数中,例如{"chat_template_kwargs": "enable_thinking": true}
2.使用openai client可以将参数放入extra_body中

@LiqinruiG LiqinruiG changed the title fix chat_template_args [Feature] Pass through the chat_template_kwargs to the data processing module Aug 18, 2025
@Jiang-Jia-Jun Jiang-Jia-Jun merged commit 3a7a20d into PaddlePaddle:develop Aug 19, 2025
12 of 15 checks passed
luukunn added a commit to luukunn/FastDeploy that referenced this pull request Aug 19, 2025
…ing module (PaddlePaddle#3421)

* fix chat_template_args

* fix args

* add offline

* add offline

* fix

* fix

* fix default enable_thinking value

* fix default enable_thinking value

* modify condition

* Revert "modify condition"

This reverts commit 26430bd.

* fix unit test
Jiang-Jia-Jun pushed a commit that referenced this pull request Aug 19, 2025
…ing module (#3421) (#3469)

* fix chat_template_args

* fix args

* add offline

* add offline

* fix

* fix

* fix default enable_thinking value

* fix default enable_thinking value

* modify condition

* Revert "modify condition"

This reverts commit 26430bd.

* fix unit test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contributor External developers
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants