mradermacher
/

llama3.1-kartoffeldes-70B-i1-GGUF

Model card Files Files and versions

llama3.1-kartoffeldes-70B-i1-GGUF

609 GB

1 contributor

History: 22 commits

mradermacher's picture

uploaded from rich1

06cb6a0 verified 10 months ago

.gitattributes

3.12 kB

uploaded from rich1 10 months ago
README.md

244 Bytes

uploaded from rich1 10 months ago
imatrix.dat

24.9 MB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ1_M.gguf

16.8 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ1_S.gguf

15.3 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_M.gguf

24.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_S.gguf

22.2 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_XS.gguf

21.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ2_XXS.gguf

19.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ3_M.gguf

31.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ3_XXS.gguf

27.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-IQ4_XS.gguf

37.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q2_K.gguf

26.4 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q2_K_S.gguf

24.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_L.gguf

37.1 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_M.gguf

34.3 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q3_K_S.gguf

30.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q4_K_M.gguf

42.5 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q4_K_S.gguf

40.3 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q5_K_M.gguf

49.9 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q5_K_S.gguf

48.7 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part1of2
29 GB
xet

uploaded from rich1 10 months ago
llama3.1-kartoffeldes-70B.i1-Q6_K.gguf.part2of2
28.9 GB
xet

uploaded from rich1 10 months ago