Deepseek MoE BF16 for ik_llama quants
Collection
Upscaled BF16 quants and imatrix for Deepseek models. GGUFs are moving to Modelscope, Imatrix and Readme.md remain.
•
6 items
•
Updated
DeepSeek-R1-0528-256x21B-BF16
Files Available
Imatrix: imatrix-DeepSeek-R1-0528.dat
- Reuploaded from ubergarm/DeepSeek-R1-0528-GGUF
GGUF files: Moved to ModelScope (see below)
Why ModelScope?
Due to new storage limits introduced by HuggingFace, the GGUF files (30 × 46GB = ~1.38TB) have been moved to ModelScope.
Download
Python SDK
pip install modelscope
from modelscope import snapshot_download
model_dir = snapshot_download('quantzor/DeepSeek-R1-0528-256x21B-BF16')
Direct Link
🔗 https://modelscope.cn/models/quantzor/DeepSeek-R1-0528-256x21B-BF16
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for gghfez/DeepSeek-R1-0528-256x21B-BF16
Base model
deepseek-ai/DeepSeek-R1-0528