Mixture of Experts (MoEs) - a parinayachaturvedi Collection

parinayachaturvedi 's Collections

MultiLingual LLMs

Mixture of Experts (MoEs)

Multimodal LLMs

Vision Language Models (VLM)

LLMs as Synthetic Data Generators

Mixture of Experts (MoEs)

updated Dec 7, 2024

Monet: Mixture of Monosemantic Experts for Transformers

Paper • 2412.04139 • Published Dec 5, 2024 • 14