julep-ai
/

dolphin-2.9-llama3-70b-awq

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

AWQ Quantized version of cognitivecomputations/dolphin-2.9-llama3-70b.

For use with vllm and other inference engines.

Downloads last month: -

Safetensors

Model size

11B params

Tensor type

F16

·

I32

·