sumitdotml
/

moe-emergence

Text Generation

mixture-of-experts

expert-specialization

Model card Files Files and versions

moe-emergence / dense-baseline

2.15 GB

2 contributors

History: 1 commit

sumitdotml's picture

add dense and moe checkpoints

3ff42e6 10 days ago

ckpt-step-4999.pt
Detected Pickle imports (8)
- "torch.ByteStorage",
- "torch._utils._rebuild_tensor_v2",
- "numpy.dtype",
- "torch.FloatStorage",
- "collections.OrderedDict",
- "numpy.ndarray",
- "numpy._core.multiarray._reconstruct",
- "_codecs.encode"
How to fix it?
1.49 GB
xet

add dense and moe checkpoints 10 days ago
final-model.json

756 Bytes

add dense and moe checkpoints 10 days ago
final-model.safetensors

652 MB
xet

add dense and moe checkpoints 10 days ago
metrics.jsonl

1.6 MB

add dense and moe checkpoints 10 days ago