BlackMamba: Mixture of Experts for State-Space Models
Paper
•
2402.01771
•
Published
•
25
Beren Millidge PRO
BerenMillidge
AI & ML interests
None yet
Recent Activity
published
a model
about 1 month ago
Zyphra/ZAYA1-base
published
a model
about 1 month ago
Zyphra/ZAYA1-reasoning-base
updated
a model
about 1 month ago
Zyphra/ZAYA1-reasoning-base
Organizations
authored
6
papers
over 1 year ago
A Theoretical Framework for Inference Learning
Paper
•
2206.00164
•
Published
A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks
Paper
•
2212.00720
•
Published
Zyda: A 1.3T Dataset for Open Language Modeling
Paper
•
2406.01981
•
Published
•
4
Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
Paper
•
2408.04093
•
Published
•
4
Zamba: A Compact 7B SSM Hybrid Model
Paper
•
2405.16712
•
Published
•
24