Smoothie-qwen applied version of ByteDance-Seed/Seed-OSS-36B-Instruct

imatrix is created with bartowski's dataset

Tools used

What is Smoothie-Qwen?

By analyzing and adjusting token weights particularly those associated with specific Unicode ranges it helps mitigate unintended biases toward certain languages while preserving the model’s core capabilities.

Notes

  • Use --temp 1.1 --top-p 0.95 --jinja for llama.cpp
  • --chat_template_kwargs "{\"thinking_budget\": 0}" disables thinking
Downloads last month
34
GGUF
Model size
36B params
Architecture
seed_oss
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for hell0ks/Smoothie-Seed-OSS-36B-Instruct-GGUF

Quantized
(42)
this model