| --- | |
| base_model: PleIAs/monad | |
| tags: | |
| - llama-cpp | |
| --- | |
| # typeof/monad-gguf | |
| This model was converted to GGUF format from [`PleIAs/monad`](https://huggingface.co/PleIAs/monad) using llama.cpp. | |
| Refer to the [original model card](https://huggingface.co/PleIAs/monad) for more details on the model. | |
| ## Use with llama.cpp | |
| ``` | |
| Invoke the llama.cpp server or the CLI. | |
| ### CLI: | |
| ```bash | |
| llama-cli --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -p "The meaning to life and the universe is" | |
| ``` | |
| ### Server: | |
| ```bash | |
| llama-server --hf-repo typeof/monad-gguf --hf-file monad-Q4_K_M.gguf -c 2048 | |
| ``` | |