renaudrenaud

And I trained this week the 20b version for classification, it works and it's cool to have these tools at our disposal.

You just have to build a pipeline.

The model is running at 16 tokens / second (120b) on the GMKTEC EVO-X2. Cost for the computer is 2000€, consumption is less than 200W and no noise. This is really cool for little companies who are interested in privacy.