Model Choice
#1
by
Mo-alaa
- opened
hi Abdullah,
Thanks for open sourcing the model. Is there a reason why you chose the google/gemma-3n-E4B-it model and did you try the smaller version google/gemma-3n-E2B-it? And could you share the finetuning script if possible?
Hi Mohamed,
Ahmed here.
2B was tried and the results were not good at all. the script used for finetune is by unsloth https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Gemma3N_(4B)-Audio.ipynb