CLIMB: Curriculum Learning for Infant-inspired Model Building
Paper
•
2311.08886
•
Published
Richard Diehl Martinez
rdiehlmartinez
AI & ML interests
NLP, Multilingual Language Modeling, Efficient Pre-Training
Organizations
authored
7
papers
7 months ago
Mitigating Frequency Bias and Anisotropy in Language Model Pre-Training with Syntactic Smoothing
Paper
•
2410.11462
•
Published
Attention-based Contextual Language Model Adaptation for Speech Recognition
Paper
•
2106.01451
•
Published
From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes
Paper
•
2410.22906
•
Published
Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies
Paper
•
2410.22886
•
Published
•
1
Tending Towards Stability: Convergence Challenges in Small Language Models
Paper
•
2410.11451
•
Published
Automatically Neutralizing Subjective Bias in Text
Paper
•
1911.09709
•
Published