rudrashah/RLM_hingu

#1496
by Abhi99999 - opened

Please quantities model q4k_m

https://huggingface.co/rudrashah/RLM_hingu

Sorry but I'm almost certain that this model is not compatible with llama.cpp. I don't even see an architecture listed inside config.json: https://huggingface.co/rudrashah/RLM_hingu/blob/main/config.json . By the way this is also the first time I saw HuggingFace flagging config.json as unsafe (not that it means anything as their scanner is useless).

Sign up or log in to comment