GGUF
vllm
mistral-common
unsloth
conversational

Reasoning block not working in IQ2_M because of wrong default settings: <think> </think> instead of [THINK] [/THINK]

#3
by illtellyoulater - opened

For the iq2_m version of the model, in LM Studio, the default thinking block tokens are erroneously set to instead of [THINK] [/THINK].
Fixing this makes the reasoning block work correctly.

Sign up or log in to comment