view article Article Tokenization in Transformers v5: Simpler, Clearer, and More Modular +4 11 days ago • 84
view article Article Transformers v5: Simple model definitions powering the AI ecosystem +2 28 days ago • 257
view article Article Deep Learning over the Internet: Training Language Models Collaboratively Jul 15, 2021 • 7
SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model Paper • 2502.02737 • Published Feb 4 • 252
Balancing Pipeline Parallelism with Vocabulary Parallelism Paper • 2411.05288 • Published Nov 8, 2024 • 20
Idefics2 🐶 Collection Idefics2-8B is a foundation vision-language model. In this collection, you will find the models, datasets and demo related to its creation. • 11 items • Updated May 6, 2024 • 92