ekurtic/Qwen3-8B-kvattn-fp8-tensor
8B
•
Updated
•
6
Eldar Kurtić
ekurtic
AI & ML interests
Efficient inference
Recent Activity
updated
a model
1 day ago
ekurtic/Qwen3-8B-kvattn-fp8-tensor
updated
a model
1 day ago
ekurtic/Qwen3-8B-kvattn-fp8-attn_head
published
a model
1 day ago
ekurtic/Qwen3-8B-kvattn-fp8-tensor
Organizations
ekurtic/Qwen3-8B-kvattn-fp8-attn_head
8B
•
Updated
•
6
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-tensor
8B
•
Updated
•
9
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1_4q2kv
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head_layer1
Updated
•
10
ekurtic/Llama-3.1-8B-Instruct-kvattn-fp8-attn_head
8B
•
Updated
•
10
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-tensor
7B
•
Updated
•
7
ekurtic/Llama-2-7b-chat-hf-kvattn-fp8-attn_head
7B
•
Updated
•
7
ekurtic/qwen3-8b-int4-asym
2B
•
Updated
•
5
ekurtic/qwen3-8b-int4-sym
2B
•
Updated
•
8
ekurtic/llama-3.1-8b-instruct-int4-asym
2B
•
Updated
•
5
ekurtic/llama-3.1-8b-instruct-int4-sym
2B
•
Updated
•
7
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT4-fake-quant
8B
•
Updated
•
6
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT8-fake-quant
8B
•
Updated
•
14
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-FP8-fake-quant
8B
•
Updated
•
7