Can't seem to correctly generate structured output
#3
by
kldzj
- opened
It looks like this model isn't outputting thinking tags correctly, or somehow vLLM fails to remove all thinking traces. When generating structured output, it seems to output it including the thinking traces, which is why the output isn't JSON-parseable. Is anybody facing the same issue?