metadata
quantized_by: quantflex
pipeline_tag: text-generation
license: mit
base_model_relation: quantized
base_model: XiaomiMiMo/MiMo-7B-RL
language:
- zh
- en
---- NOTE -----
I have deleted the mtp layers in order to make it work with llama.cpp. Quality might be degraded.
A proper implementation would be better, but this will work until that is implemented.
For more information feel free to open a discussion here.
---- NOTE -----
GGUF Quants for: XiaomiMiMo/MiMo-7B-RL
Model by: XiaomiMiMo
Quants by: quantflex
Run with llama.cpp:
./llama-cli -m MiMo-7B-RL-nomtp-Q5_K_M.gguf -cnv