llama - a CharlesDDDD Collection

CharlesDDDD 's Collections

llama

looped_transformer

llama

updated 4 days ago

Llama baseline checkpoints (0.6B, 1.3B)

CharlesDDDD/llama_0.6B_100bt_formal

Updated 4 days ago • 4

Note vanilla llama 0.6B baseline, 100BT FineWeb-Edu. 10 ckpts: 10B-100B tokens.
CharlesDDDD/llama_1.3B_100bt_formal

Updated 4 days ago • 3

Note vanilla llama 1.3B baseline, 100BT FineWeb-Edu. 10 ckpts: 10B-100B tokens.