Chat template fixes + Q&A

pinned

by danielhanchen - opened about 23 hours ago

Unsloth AI org about 23 hours ago

•

Hey everyone! We worked with the Kimi K2 team to fix the default system prompt of You are Kimi, an AI assistant created by Moonshot AI. not appearing in the first turn! See https://huggingface.co/moonshotai/Kimi-K2-Thinking/discussions/12 for more details.

All GGUFs, imatrix calibrated GGUFs and uploads are all updated with these fixes.

You may notice that there are no thinking tags when you run the model. This is normal and intended behavior. To enable it you will need to add --special.

Don't forget to read our guide for more details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

danielhanchen pinned discussion about 23 hours ago

danielhanchen changed discussion title from Chat template and bug fixes to Chat template bug fixes about 23 hours ago

danielhanchen changed discussion title from Chat template bug fixes to Chat template fixes + Q&A about 20 hours ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment