Hugging Face's logo

JasmineBBB
/
Kimi-Linear-48B-A3B-Instruct-bnb-4bit

Text Generation
Safetensors
kimi_linear
sglang
vllm
conversational
custom_code
4-bit precision
bitsandbytes
Model card Files
xet
Community

Kimi-Linear-48B-A3B-Instruct BNB - FP4

Model Details

  • Quantization Method: BNB
  • Bits: 4
  • Compute Dtype: bfloat16
Downloads last month
57
Safetensors
Model size
49B params
Tensor type
F32
路
F16
路
U8
路
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for JasmineBBB/Kimi-Linear-48B-A3B-Instruct-bnb-4bit

Base model

moonshotai/Kimi-Linear-48B-A3B-Instruct
Quantized
(16)
this model