exllamav2 quantizations of TheDrummer's Behemoth-X-123B-v2

2.25bpw h6 (32.964 GiB)
3.75bpw h6 (54.234 GiB)
5.00bpw h6 (71.959 GiB)
8.00bpw h8 (114.560 GiB)
measurement.json

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MikeRoz/Behemoth-X-123B-v2-exl2

Quantized
(10)
this model