Toots' MLX Quants - a mrtoots Collection

mrtoots 's Collections

Toots' MLX Quants

Evaluation Leaderboards

Video Gen Spaces

Image Diffusion Spaces

Gen Audio Spaces

LLM Train & Merge & Tune & Analyze

Image Diffusion Repos

Video Gen Repos

Gen Audio Repos

Uncategorized Spaces

Toots' MLX Quants

updated about 15 hours ago

Various MLX quants for testing on Mac systems.

mrtoots/unsloth-GLM-4.6-mlx-3Bit

Text Generation • 353B • Updated Oct 1 • 580
mrtoots/unsloth-Qwen3-Coder-30B-A3B-Instruct-mlx-8Bit

Text Generation • 31B • Updated Aug 30 • 258
mrtoots/Tongyi-DeepResearch-30B-A3B-mlx-8Bit

Text Generation • 31B • Updated Sep 17 • 62
mrtoots/unsloth-GLM-4.5-MLX-3Bit

Text Generation • 353B • Updated Sep 1 • 70 • 1
mrtoots/unsloth-DeepSeek-V3.1-MLX-2Bit

Text Generation • 671B • Updated Aug 29 • 84
mrtoots/unsloth-gpt-oss-120b-mlx-8Bit

Text Generation • 117B • Updated Aug 31 • 149
mrtoots/unsloth-GLM-4.5-Air-MLX-8Bit

Text Generation • 107B • Updated Sep 1 • 89
mrtoots/Wayfarer-Large-70B-Llama-3.3-mlx-8Bit

Text Generation • 71B • Updated Aug 28 • 28
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-8Bit

123B • Updated Aug 29 • 26
mrtoots/unsloth-GLM-4.5-MLX-2Bit

Text Generation • 353B • Updated Aug 28 • 64
mrtoots/TheDrummer-Behemoth-R1-123B-v2-MLX-4Bit

123B • Updated Aug 29 • 24
mrtoots/Wayfarer_Eris_Noctis-12B-mlx-6Bit

Text Generation • 3B • Updated Aug 28 • 8
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-8Bit

107B • Updated Aug 29 • 44
mrtoots/L3.3-GeneticLemonade-Unleashed-70B-mlx-8Bit

Text Generation • 71B • Updated Aug 29 • 32
mrtoots/TheDrummer-GLM-Steam-106B-A12B-v1-MLX-4Bit

107B • Updated Sep 10 • 49
mrtoots/CharGen-v3-mini-mlx-fp16

Text Generation • 5B • Updated Aug 30 • 5
mrtoots/Impish_Nemo_12B-mlx-8Bit

12B • Updated Aug 30 • 20 • 1
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-8Bit

12B • Updated Aug 31 • 15
mrtoots/unsloth-gpt-oss-20b-mlx-fp16

Text Generation • 21B • Updated Aug 31 • 127
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-8Bit

123B • Updated Aug 31 • 32
mrtoots/TheDrummer-Behemoth-X-123B-v2-mlx-4Bit

123B • Updated Aug 31 • 50
mrtoots/CaptainErisNebula-12B-Chimera-v1.1-mlx-6Bit

12B • Updated Sep 1 • 12
mrtoots/Nova-70B-Llama-3.3-mlx-8Bit

Text Generation • 71B • Updated Sep 4 • 33
mrtoots/Wayfarer-2-12B-mlx-8Bit

Text Generation • 12B • Updated Sep 4 • 20
mrtoots/Nova-70B-Llama-3.3-mlx-fp16

Text Generation • 71B • Updated Sep 4 • 18
mrtoots/Wayfarer-2-12B-mlx-6Bit

Text Generation • 12B • Updated Sep 4 • 16
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-8Bit

123B • Updated Sep 10 • 41
mrtoots/unsloth-Hermes-4-405B-mlx-2Bit

Text Generation • 406B • Updated Sep 10 • 36
mrtoots/TheDrummer-Behemoth-ReduX-123B-v1-mlx-4Bit

123B • Updated Sep 10 • 34
mrtoots/unsloth-Hermes-4-405B-mlx-3Bit

Text Generation • 406B • Updated Sep 11 • 58
mrtoots/Steelskull-L3.3-Nevoria-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 40
mrtoots/Hermes-3-Llama-3.1-405B-mlx-2Bit

Text Generation • 406B • Updated Sep 14 • 65
mrtoots/Steelskull-L3.3-Cu-Mai-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 21
mrtoots/Steelskull-L3.3-MS-Nevoria-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 54
mrtoots/Steelskull-L3.3-Electra-R1-70b-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 27
mrtoots/Steelskull-L3.3-Shakudo-70b-mlx-8Bit

71B • Updated Sep 14 • 34
mrtoots/BruhzWater-Sapphira-L3.3-70b-0.1-mlx-8Bit

Text Generation • 71B • Updated Sep 14 • 43
mrtoots/unsloth-Qwen3-235B-A22B-Thinking-2507-mlx-4Bit

Text Generation • 235B • Updated Sep 14 • 64
mrtoots/unsloth-Qwen3-235B-A22B-Instruct-2507-mlx-4Bit

Text Generation • 235B • Updated Sep 14 • 91
mrtoots/unsloth-Magistral-Small-2509-mlx-8Bit

24B • Updated Sep 17 • 60 • 1
mrtoots/SimpleChat-30BA3B-V2-mlx-8Bit

Text Generation • 31B • Updated Sep 20 • 17 • 1
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-3Bit

Text Generation • 671B • Updated Sep 23 • 200
mrtoots/unsloth-DeepSeek-V3.1-Terminus-mlx-2Bit

Text Generation • 671B • Updated Sep 23 • 240
mrtoots/unsloth-GLM-4.6-mlx-4Bit

Text Generation • 353B • Updated Oct 2 • 537
mrtoots/TheDrummer-Skyfall-31B-v4-mlx-4Bit

31B • Updated Oct 6 • 82