Hugging Face's logo

sumitdotml
/
moe-emergence

Text Generation
Transformers
Safetensors
English
mixture-of-experts
gpt2
research
expert-specialization
Model card Files
xet
Community
moe-emergence

Commit History

updated model card with ablation results and all 4 runs
4049aa7

sumit commited on

Upload top2-main-10k/ckpt-step-9999.pt with huggingface_hub
4fa3232
verified

sumitdotml commited on

Upload no-lb-ablation/ckpt-step-500.pt with huggingface_hub
fddc934
verified

sumitdotml commited on

Upload top2-main-10k/run_summary.json with huggingface_hub
662a826
verified

sumitdotml commited on

Upload top2-main-10k/config.json with huggingface_hub
7268ac0
verified

sumitdotml commited on

Upload top2-main-10k/metrics.jsonl with huggingface_hub
361f1fb
verified

sumitdotml commited on

Upload top2-main-10k/best-model.json with huggingface_hub
ea76a5a
verified

sumitdotml commited on

Upload no-lb-ablation/run_summary.json with huggingface_hub
000c4a9
verified

sumitdotml commited on

Upload top2-main-10k/best-model.safetensors with huggingface_hub
4f098a5
verified

sumitdotml commited on

Upload no-lb-ablation/config.json with huggingface_hub
a93a349
verified

sumitdotml commited on

Upload no-lb-ablation/metrics.jsonl with huggingface_hub
72f3f89
verified

sumitdotml commited on

Upload no-lb-ablation/best-model.json with huggingface_hub
2eb360a
verified

sumitdotml commited on

Upload no-lb-ablation/best-model.safetensors with huggingface_hub
9945f3e
verified

sumitdotml commited on

Upload top2-main-10k/final-model.json with huggingface_hub
50bc242
verified

sumitdotml commited on

Upload top2-main-10k/final-model.safetensors with huggingface_hub
fb3bcf0
verified

sumitdotml commited on

Upload no-lb-ablation/final-model.json with huggingface_hub
c190823
verified

sumitdotml commited on

Upload no-lb-ablation/final-model.safetensors with huggingface_hub
13bb335
verified

sumitdotml commited on

add dense and moe checkpoints
3ff42e6

sumitdotml commited on