Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions
xet
Community
1
Mistral-NeMo-Minitron-8B-Instruct-GGUF
27.7 GB
  • 1 contributor
History: 5 commits
MaziyarPanahi's picture
MaziyarPanahi
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
b7695fd verified about 1 year ago
  • .gitattributes
    1.84 kB
    58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4 about 1 year ago
  • Mistral-NeMo-Minitron-8B-Instruct.Q5_K_M.gguf
    6 GB
    xet
    849ab006c1ea3adfd33a8c36f15215a3b4b128d98cf4ed8ee3ad1d2abfff5bde about 1 year ago
  • Mistral-NeMo-Minitron-8B-Instruct.Q5_K_S.gguf
    5.86 GB
    xet
    5157a8b4ffdae7a7c61cb6fa83b672146adc05887538b53d1f35e7ebfacd7e60 about 1 year ago
  • Mistral-NeMo-Minitron-8B-Instruct.Q6_K.gguf
    6.91 GB
    xet
    537569048ef565b3d1fb161305888ea12f5440b446fd8daad782cd2eb7ba4a01 about 1 year ago
  • Mistral-NeMo-Minitron-8B-Instruct.Q8_0.gguf
    8.95 GB
    xet
    58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4 about 1 year ago