bartowski

/

microsoft_Fara-7B-GGUF

like 24

https://huggingface.co/microsoft/Fara-7B
not run in colab t4
out of cuda

it run good with gguf lmstudio
on rtx5060ti 16 gb vram
https://github.com/pmbstyle/fara-agent

There is also the official microsoft Magentic scaffolding, with a nice UI https://github.com/microsoft/magentic-ui/blob/main/README.md#fara-7b just replace base_urland model with the ones of your gguf server