How what this built?
#2
by
svnflow
- opened
I want to fine-tune devstral with vision enabled, but I'm missing something.
I do a finetune of Devstral-Small-2505-unsloth-bnb-4bit but I can't generate the mmproj using commands from convert_hf_to_gguf.py
#create mmproj files (mistral not supported? doesnt work)
python convert_hf_to_gguf.py ../Devstral-Small-2505-finetuned --outtype f16 --mmproj --outfile mmproj-Devstral-Small-2505-finetuned.gguf
returns an error that mistral base model is not supported for mmproj outputting