Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions
xet
Community
1
Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF
78.2 GB
  • 1 contributor
History: 7 commits
MaziyarPanahi's picture
MaziyarPanahi
1dfb4431cb2677b2f6ece0fd91e725d2cb1b03c841ce75423d850be4fca32a71
3ea08df verified 11 months ago
  • .gitattributes
    2.14 kB
    1dfb4431cb2677b2f6ece0fd91e725d2cb1b03c841ce75423d850be4fca32a71 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES-GGUF_imatrix.dat
    8.56 MB
    xet
    1dfb4431cb2677b2f6ece0fd91e725d2cb1b03c841ce75423d850be4fca32a71 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES.Q5_K_M.gguf
    10.5 GB
    xet
    fa016a3d0def6c451854807c4b14ab2265a6d193691ae820e50a51e1fd1b075f 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES.Q5_K_S.gguf
    10.3 GB
    xet
    3dcf356529048e431d3ccf35e9dbbb4f5e94437d7b732d244e6a500517c7b4ff 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES.Q6_K.gguf
    12.1 GB
    xet
    c27efa74809a2f381fab63ede844b140816b120119c39f70b088d66c49279397 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES.Q8_0.gguf
    15.7 GB
    xet
    8d8f93039f57f0c9fd5fe7fb1ba49bc86a4c58670faa0006a7585f8b14917c1a 11 months ago
  • Josiefied-abliteratedV4-Qwen2.5-14B-Inst-BaseMerge-TIES.fp16.gguf
    29.5 GB
    xet
    5708833b0fcbbe8b6a0eca68de487048475ffc346c2c7c21659e75fe77660d55 11 months ago
  • README.md
    3.35 kB
    1dfb4431cb2677b2f6ece0fd91e725d2cb1b03c841ce75423d850be4fca32a71 11 months ago