Article
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
- +4
•
110
Sam Foreman
samforeman
AI & ML interests
{ AI for Science, LLMs @ Scale, Generative Modeling for Physics / Lattice QCD }
@ Argonne National Laboratory
https://alcf.anl.gov/about/people/sam-foreman
Recent Activity
upvoted
an
article
1 day ago
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
upvoted
an
article
1 day ago
Gotchas in Tokenizer Behavior Every Developer Should Know
liked
a model
27 days ago
codelion/gpt-2-70m
Organizations
upvoted
2
articles
1 day ago
Article
Gotchas in Tokenizer Behavior Every Developer Should Know
•
68
liked
a
model
27 days ago
upvoted
a
collection
27 days ago
liked
a
dataset
about 2 months ago
upvoted
an
article
2 months ago
Article
A Review on the Evolvement of Load Balancing Strategy in MoE LLMs: Pitfalls and Lessons
•
28
authored
a
paper
4 months ago
commented
a
paper
4 months ago
upvoted
a
paper
4 months ago
liked
a
dataset
5 months ago
upvoted
a
collection
5 months ago
liked
a
model
6 months ago
liked
3
models
7 months ago
liked
a
Space
8 months ago
upvoted
an
article
8 months ago
Article
Welcome Llama 4 Maverick & Scout on Hugging Face
- +5
•
146
upvoted
a
paper
9 months ago
upvoted
2
articles
9 months ago
Article
From Files to Chunks: Improving HF Storage Efficiency
•
68
Article
From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub
- +2
•
81