Do you mind uploading Q5_K_M quant?
#1
by
rustyjelly
- opened
Hi! Thank you so much for uploading this and having a working llama.cpp fork! Would you mind uploading a Q5_K_M quantization?
Uploading in progress
Hi! Thank you so much for uploading this and having a working llama.cpp fork! Would you mind uploading a Q5_K_M quantization?
Uploading in progress