Tag: mixture of experts
-
MiniMax M2.7 Ships as Open Weights: Frontier Agentic Model on Hugging Face
MiniMax M2.7 is now downloadable. The 230B-parameter self-evolving model that MiniMax unveiled in March has shipped as open weights on Hugging Face and ModelScope under a Modified-MIT license, and community quantizations already cover everything from a 60 GB 1-bit build to the full 457 GB BF16 release — putting a frontier-class agentic model in reach […]
-
Understanding Apple’s Parallel-Track MoE Architecture
Apple recently introduced a novel Parallel-Track Mixture‑of‑Experts (PT‑MoE) architecture for their server-side language models, aiming to dramatically improve scalability and efficiency while preserving model quality (machinelearning.apple.com). Key points Apple recently introduced a Parallel-Track Mixture-of-Experts (PT-MoE) architecture for its server-side language models, aiming to dramatically improve scalability and efficiency while preserving model quality. Rather than a […]