Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Yarn-Solar-10b-32k-GGUF

Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
llama
custom_code
en
emozilla/yarn-train-tokenized-32k-mistral
arxiv:2309.00071
has_space
text-generation-inference
Model card Files Files and versions
xet
Community
2
Yarn-Solar-10b-32k-GGUF
32.1 GB
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
ff235b3f85a73830a5cd0d5115e76c00a06d71a54ef220e56041196ef65a633e
4e58bd8 verified almost 2 years ago
  • .gitattributes
    1.92 kB
    ff235b3f85a73830a5cd0d5115e76c00a06d71a54ef220e56041196ef65a633e almost 2 years ago
  • Yarn-Solar-10b-32k.Q2_K.gguf
    4 GB
    xet
    804ddb15408a3187c207d8184d938925382d84b9fbaa01e83d00563716e2ecf1 almost 2 years ago
  • Yarn-Solar-10b-32k.Q3_K_L.gguf
    5.65 GB
    xet
    5dc11af790c7258cb1d33ad71863aee17d0257425dc1b716630e6e5254e15ed3 almost 2 years ago
  • Yarn-Solar-10b-32k.Q3_K_M.gguf
    5.2 GB
    xet
    7f7a7f68c3db3db389e34c62d74068db92b47b7baad50c1246ea15fda3065121 almost 2 years ago
  • Yarn-Solar-10b-32k.Q3_K_S.gguf
    4.66 GB
    xet
    184a1f59f1f3c6dac0ec092acf7f00d275e904141913a90fb3dac4b7c3f54cf4 almost 2 years ago
  • Yarn-Solar-10b-32k.Q4_K_M.gguf
    6.46 GB
    xet
    1e2e66e867c98db403d366caed828dea465afc3417823ac0b20417ea7761ff58 almost 2 years ago
  • Yarn-Solar-10b-32k.Q4_K_S.gguf
    6.12 GB
    xet
    ff235b3f85a73830a5cd0d5115e76c00a06d71a54ef220e56041196ef65a633e almost 2 years ago