Model

Motif-3-Beta Released: 314B Parameter Sparse MoE Model

Published: 2026-07-21 09:26 Source: X: AK (@_akhaliq)

Motif-3-Beta just released on Hugging Face ~314B total parameters / ~13B active parameters per token (sparse MoE) 256K context length (262,144 tokens), native long context Sparse routing: 384 experts, 8 activated per token, plus 1 shared expert Multilingual, general purpose https://huggingface.co/Motif-Technologies/Motif-3-Beta

Read the original (opens in a new tab)

News stream data aggregated by AI HOT

Related newsLatest in this category

Model Kimi K3 Full-Stack Open Source, Approaching Closed-Source Flagship

07-28 13:43 · X: AYi AI Notes (@AYi_AInotes)

Model FeyNoBg Released: Open-Source Automatic Background Removal Model Achieves SOTA on Four Benchmarks

07-28 12:57 · Hacker News Hot (buzzing.cc Chinese translation)

Model Kimi K3 released, gap between open-source and closed-source models narrows to 4 points

07-28 10:17 · X: Artificial Analysis (@ArtificialAnlys)

Model Microsoft Launches First Cybersecurity AI Model MAI-Cyber-1-Flash

07-28 08:59 · ithome (RSS)

Model Microsoft Releases First Cybersecurity Model MAI-Cyber-1-Flash

07-28 04:30 · X: Rohan Paul (@rohanpaul_ai)