bnjmnmarie's picture
Upload folder using huggingface_hub
86c4895 verified
metadata
license: apache-2.0
base_model:
  - allenai/Olmo-3-7B-Instruct
tags:
  - llmcompressor

This is allenai/Olmo-3-7B-Instruct quantized with LLM Compressor with Smoothquant (W8A8). Not Tested Yet.

How to Support My Work

Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free. Or you can "buy me a kofi".