mlabonne

/

gemma-3-27b-it-abliterated

like 242

Would love to see a QAT version of Gemma 3 as well.

same, hope it makes it

please make the qat version

Please, sir :)

Hey good news, I abliterated all the QAT unquantized models:

https://huggingface.co/mlabonne/gemma-3-1b-it-qat-abliterated
https://huggingface.co/mlabonne/gemma-3-4b-it-qat-abliterated
https://huggingface.co/mlabonne/gemma-3-12b-it-qat-abliterated
https://huggingface.co/mlabonne/gemma-3-27b-it-qat-abliterated

They need to be quantized but the checkpoints are available.

Thanks for flagging this @TheDevilishOne, it should be fixed now. It's something I couldn't see because the outputs I check are truncated. Hopefully, this new version behaves better.

Ah, interesting. Are you talking about the 4B and 12B v1 or v2?

Thanks a lot for this comparison @TheDevilishOne!