CharlesDDDD/llama_0.6B_100bt_formal
Updated
•
4
Llama baseline checkpoints (0.6B, 1.3B)
Note vanilla llama 0.6B baseline, 100BT FineWeb-Edu. 10 ckpts: 10B-100B tokens.
Note vanilla llama 1.3B baseline, 100BT FineWeb-Edu. 10 ckpts: 10B-100B tokens.