Skip to content

Support chat_template_kwargs.thinking for DeepSeekV3.1 in ContentGenerationPipeline #1644

Description

@ryanxie113

What would you like to be added?

背景
当前 ContentGenerationPipeline 对 DeepSeekV3.1 模型的支持中,pipeline 的 buildRequest / execute / executeStream 方法并未处理 chat_template_kwargs 参数。
DeepSeekV3.1 的 thinking 模式需要通过 chat_template_kwargs: { thinking: true } 显式传入,但现有实现中:

buildReasoningConfig() 返回空 {}

buildRequest() 没有将 request.config.chat_template_kwargs 转换到 OpenAI.Chat.ChatCompletionCreateParams

因此,尽管用户在请求中传入了 thinking: true,pipeline 并不会将其下发给模型,导致 thinking 模式无法生效。

Why is this needed?

A clear and concise description of why this enhancement is needed:

DeepSeekV3.1 的 thinking 模式需要通过 chat_template_kwargs.thinking 显式传入

现有 pipeline 忽略了该参数,导致用户无法启用模型思考功能

支持此参数可以让 pipeline 完全支持 DeepSeekV3.1 的 reasoning 特性,提高模型输出的智能性与灵活性

Additional context

No response

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions