mradermacher
/

OceanGPT-basic-30B-A3B-Instruct-GGUF

text-generation-inference

Model card Files Files and versions

OceanGPT-basic-30B-A3B-Instruct-GGUF

208 GB

1 contributor

History: 19 commits

mradermacher's picture

auto-patch README.md

60c8220 verified about 4 hours ago

.gitattributes

2.39 kB

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.IQ4_XS.gguf

16.6 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q2_K.gguf

11.3 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q3_K_L.gguf

15.9 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q3_K_M.gguf

14.7 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q3_K_S.gguf

13.3 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q4_K_M.gguf

18.6 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q4_K_S.gguf

17.5 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q5_K_M.gguf

21.7 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q5_K_S.gguf

21.1 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q6_K.gguf

25.1 GB
xet

uploaded from marco 12 days ago
OceanGPT-basic-30B-A3B-Instruct.Q8_0.gguf

32.5 GB
xet

uploaded from marco 12 days ago
README.md

3.87 kB

auto-patch README.md about 4 hours ago