mradermacher
/

llama3.1-kartoffeldes-70B-i1-GGUF

Model card Files Files and versions

llama3.1-kartoffeldes-70B-i1-GGUF

451 GB

1 contributor

History: 17 commits

mradermacher's picture

uploaded from rich1

ff1968c verified 10 months ago

.gitattributes

2.73 kB

uploaded from rich1 10 months ago
README.md

244 Bytes

uploaded from rich1 10 months ago
imatrix.dat

24.9 MB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ1_M.gguf

16.8 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_M.gguf

24.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_XXS.gguf

19.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ3_M.gguf

31.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ3_XXS.gguf

27.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ4_XS.gguf

37.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q2_K.gguf

26.4 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q2_K_S.gguf

24.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_L.gguf

37.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_M.gguf

34.3 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_S.gguf

30.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q4_K_M.gguf

42.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q4_K_S.gguf

40.3 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part1of2

29 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part2of2

28.9 GB
xet

uploaded from rich1 10 months ago