nightmedia commited on
Commit
f63e424
·
verified ·
1 Parent(s): dba0783

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -40,6 +40,18 @@ pipeline_tag: text-generation
40
 
41
  # Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx
42
 
 
 
 
 
 
 
 
 
 
 
 
 
43
  This model [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx](https://huggingface.co/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx) was
44
  converted to MLX format from [DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG](https://huggingface.co/DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG)
45
  using mlx-lm version **0.28.3**.
 
40
 
41
  # Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx
42
 
43
+ This is a new-old-stock version of the model, with embeddings at 6 bit.
44
+
45
+ The original [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx](https://huggingface.co/nightmedia/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx) is using 4 bit embeddings
46
+
47
+ ```bash
48
+ Perplexity: 4.455 ± 0.031
49
+ Peak memory: 32.84 GB
50
+ ```
51
+
52
+ Metrics coming soon. If this proves better than the qx64-hi, it will replace it in the catalog.
53
+
54
+ -G
55
  This model [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx](https://huggingface.co/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-qx64x-hi-mlx) was
56
  converted to MLX format from [DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG](https://huggingface.co/DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG)
57
  using mlx-lm version **0.28.3**.