OpenVINO models A collection of quantized LLMs in OpenVINO format jojo1899/Phi-3.5-mini-instruct-ov-int4 Updated Nov 7, 2024 • 10 jojo1899/Mistral-7B-Instruct-v0.2-ov-int4 Text Generation • Updated Nov 7, 2024 • 17 jojo1899/llama-3_1-8b-instruct-ov-int4 Updated Feb 26 • 13 jojo1899/Llama-2-13b-chat-hf-ov-int4 Text Generation • Updated Nov 7, 2024 • 24
ONNX models A collection of quantized LLMs in ONNX format jojo1899/Llama-2-13b-chat-hf-onnx-int4 Updated Nov 7, 2024 • 1 jojo1899/llama-3_1-8b-instruct-onnx-int4 Updated Oct 30, 2024 jojo1899/Phi-3.5-mini-instruct-onnx-int4 Updated Nov 7, 2024
OpenVINO models A collection of quantized LLMs in OpenVINO format jojo1899/Phi-3.5-mini-instruct-ov-int4 Updated Nov 7, 2024 • 10 jojo1899/Mistral-7B-Instruct-v0.2-ov-int4 Text Generation • Updated Nov 7, 2024 • 17 jojo1899/llama-3_1-8b-instruct-ov-int4 Updated Feb 26 • 13 jojo1899/Llama-2-13b-chat-hf-ov-int4 Text Generation • Updated Nov 7, 2024 • 24
ONNX models A collection of quantized LLMs in ONNX format jojo1899/Llama-2-13b-chat-hf-onnx-int4 Updated Nov 7, 2024 • 1 jojo1899/llama-3_1-8b-instruct-onnx-int4 Updated Oct 30, 2024 jojo1899/Phi-3.5-mini-instruct-onnx-int4 Updated Nov 7, 2024
