Minthy/ToriiGate-v0.4-2B
It's queued!
This model was already attempted long ago and failed, but we will try again.
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#ToriiGate-v0.4-2B-GGUF for quants to appear.
That model was such a pain. They referencing non-existing files inside thair model.safetensors.index.json. To fix that I simply deleted model.safetensors.index.json. Luckily that made it complete successfully.
Thank you nico =)
It seems I got why other versions were quantized by you but not that, thanks
Nice, it seems like it finished quantizing, feel free to try it!
https://hf.tst.eu/model#ToriiGate-v0.4-2B-GGUF
https://huggingface.co/mradermacher/ToriiGate-v0.4-2B-i1-GGUF
https://huggingface.co/mradermacher/ToriiGate-v0.4-2B-GGUF