Transformers
GGUF
English
creative
Uncensored
Abliterated
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
llama-3
llama3
llama-3.2
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
brainstorm 40x
swearing
rp
128k context
horror
llama 3.2
finetune
Not-For-All-Audiences
imatrix
conversational
auto-patch README.md
Browse files
README.md
CHANGED
|
@@ -92,6 +92,7 @@ more details, including on how to concatenate multi-part files.
|
|
| 92 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.3 | optimal size/speed/quality |
|
| 93 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended |
|
| 94 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | |
|
|
|
|
| 95 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K |
|
| 96 |
|
| 97 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
|
|
|
| 92 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q4_K_S.gguf) | i1-Q4_K_S | 4.3 | optimal size/speed/quality |
|
| 93 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q4_K_M.gguf) | i1-Q4_K_M | 4.5 | fast, recommended |
|
| 94 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q5_K_S.gguf) | i1-Q5_K_S | 5.1 | |
|
| 95 |
+
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q5_K_M.gguf) | i1-Q5_K_M | 5.2 | |
|
| 96 |
| [GGUF](https://huggingface.co/mradermacher/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B-i1-GGUF/resolve/main/L3.2-Rogue-Creative-Instruct-DARK-HORROR-Uncensored-Abliterated-7B.i1-Q6_K.gguf) | i1-Q6_K | 6.0 | practically like static Q6_K |
|
| 97 |
|
| 98 |
Here is a handy graph by ikawrakow comparing some lower-quality quant
|