
Microsoft Completes Pre-Training of MAI-Base-2, a 2.8T-Parameter Model
Microsoft AI finished pre-training MAI-Base-2, a 2.8-trillion-parameter MoE foundation model it says is 4–12× more compute-efficient than DeepSeek's strongest open base model.
1 story

Microsoft AI finished pre-training MAI-Base-2, a 2.8-trillion-parameter MoE foundation model it says is 4–12× more compute-efficient than DeepSeek's strongest open base model.