Possible to disable thinking via a karg?

#7
by SuperbEmphasis - opened

I am testing out this model for a tool that adds it's own prompts. Unfortunately for some of the parts it does not parse the thinking tags correctly.

Is it possible to disable thinking in the API without having to add /no_think or the system prompt? Something like enable_thinking: False or something?

Actually after thinking about the models thinking.....

I think I can just change the chat template, and change the second line to set enable_thinking to false.... which is actually nice because /think should still work.

Sign up or log in to comment