Trying on a MacBook Pro M1

#1
by fabreupeixoto - opened

Hello, I hope to find you all well

I am trying this on my laptop. I am using cursos.ai for all development of my system, and I keep getting issues about the vision processing not working. Do you happen to have any tips or a churro 3B GGUF for dummies cheat sheet ?

Thanks and congrats for this amazing development
Cheers
Francisco

you have to download one of the mmproj files ikn addition to a normal gguf and give it to your inference engine somehow. then vision should work.

you have to download one of the mmproj files ikn addition to a normal gguf and give it to your inference engine somehow. then vision should work.

Thank you. I will try that.

Do you know of any inference provider that has Churro 3B available?

Best,

no clue, i run all my models locally, no matter how slow :/

Sign up or log in to comment