Atlas / Reports / Detail
EMO: Pretraining Mixture of Experts for Emergent Modularity
Mixture-of-Experts Language Models report from Ai2 with 3 connected researchers in the LLMpeople atlas.
Atlas / Reports / Detail
Mixture-of-Experts Language Models report from Ai2 with 3 connected researchers in the LLMpeople atlas.