Thinking is broken
#3
by
ChuckMcSneed
- opened
This model repeats itself like crazy when thinking is enabled.
Q8 is work for me, no repeats.
Strange. When I converted it, it complained about infinite value. Could it be a random bitflip? Did you make gguf yourself?