Size??
#1
by
clover-supply
- opened
Why are these twice the size of the fullblooded 4B? What have you done.
fp32!
Moahahaha! I usually tend to cast models to fp32 both for my fp8 scaled quants and my GGUF.
Why are these twice the size of the fullblooded 4B? What have you done.
fp32!
Moahahaha! I usually tend to cast models to fp32 both for my fp8 scaled quants and my GGUF.