ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
Paper
• 2511.10645 • Published
• 7
ParoQuant
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
-
-
z-lab/Qwen3.5-27B-PARO
Image-Text-to-Text • 6B • Updated • 5 -
z-lab/Qwen3.5-9B-PARO
Image-Text-to-Text • 3B • Updated • 3.82k • 34 -
z-lab/Qwen3.5-4B-PARO
Image-Text-to-Text • 1B • Updated • 1.11k • 12 -
z-lab/Qwen3.5-2B-PARO
Image-Text-to-Text • 1B • Updated • 183 • 2 -
z-lab/Qwen3.5-0.8B-PARO
Image-Text-to-Text • 0.4B • Updated • 378 • 1 -
z-lab/Qwen3-14B-PARO
Text Generation • 2B • Updated • 301 • 2 -
z-lab/Qwen3-8B-PARO
Text Generation • 1B • Updated • 1.01k • 1 -
z-lab/Qwen3-4B-PARO
Text Generation • 0.9B • Updated • 574 • 1 -
z-lab/Qwen3-1.7B-PARO
Text Generation • 0.5B • Updated • 191 • 1 -
z-lab/Qwen3-0.6B-PARO
Text Generation • 0.2B • Updated • 295 • 1 -
z-lab/Llama-3.1-8B-Instruct-PARO
Text Generation • 1B • Updated • 77 • 1 -
z-lab/Meta-Llama-3-8B-PARO
Text Generation • 1B • Updated • 81 • 1 -
z-lab/Llama-2-7b-hf-PARO
Text Generation • 1B • Updated • 100 • 1 -
z-lab/DeepSeek-R1-Distill-Llama-8B-PARO
Text Generation • 1B • Updated • 78 • 1 -
z-lab/paroquant-checkpoints
Updated