Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know
- Downloads last month
- 309
Hardware compatibility
Log In
to view the estimation
4-bit
8-bit
Just a q8_0 and q4_0 version. If you need versions with other quantization parameters, please let me know
4-bit
8-bit