Tag: benchmark

  • DeepSeek V4.1-Flash: 552B Params, 890 Bytes of KV Cache Per Token

    DeepSeek V4.1-Flash: 552B Params, 890 Bytes of KV Cache Per Token

    DeepSeek released V4.1-Flash on September 10, 2026, publishing the weights on Hugging Face under an MIT licence the same day the model went live in its apps. The headline is not the parameter count but the memory footprint: a 552-billion-parameter Mixture-of-Experts backbone that holds a one-million-token context in 890 bytes of KV cache per token […]

  • OpenBMB Releases MiniCPM5-2B, Topping Open Models Under 4B

    OpenBMB Releases MiniCPM5-2B, Topping Open Models Under 4B

    OpenBMB released MiniCPM5-2B on September 7, 2026 — a 2.5-billion-parameter dense language model, open-weight under Apache 2.0, that the team reports as the strongest open model under 4B parameters. Across 34 benchmarks spanning code, math, instruction following, long context, tool use and agentic tasks, MiniCPM5-2B averages 53.9, ahead of every 2B-class baseline in OpenBMB’s comparison […]

  • IFM Releases K2 Horizon: Six Open Models With Data, Code, and Logs

    IFM Releases K2 Horizon: Six Open Models With Data, Code, and Logs

    The Institute of Foundation Models (IFM), launched by Mohamed bin Zayed University of Artificial Intelligence, released K2 Horizon on September 3, 2026 — six Apache 2.0 models spanning 0.9B to 375B parameters, published alongside the training data, code, configurations, intermediate checkpoints, and training logs that produced them. The flagship 375B-A23B scores 47 on the Artificial […]

  • OpenAI Launches GPT-6 Astra, Its First ‘Critical’ Cyber Model

    OpenAI Launches GPT-6 Astra, Its First ‘Critical’ Cyber Model

    OpenAI released GPT‑6 Astra on September 3, 2026 — the first model the company has designated as reaching the “Critical” cybersecurity threshold under its Preparedness Framework, meaning it can find previously unknown security flaws and build working exploits against hardened systems without a person directing each step. OpenAI president Greg Brockman told reporters it was […]

  • Gemini Adds Agentic Video Understanding, Cutting Tokens by up to 88%

    Gemini Adds Agentic Video Understanding, Cutting Tokens by up to 88%

    On September 1, 2026, Google added agentic video understanding to the Gemini API — a processing mode that lets the model decide which parts of a video to actually look at, instead of ingesting the whole thing at a fixed frame rate. On Google’s benchmarks the change cuts token consumption by up to 88% and […]

  • Gemini 3.7 Flash: A Big Coding Jump in a Three-Week Point Release

    Gemini 3.7 Flash: A Big Coding Jump in a Three-Week Point Release

    On August 13, 2026, Google DeepMind released Gemini 3.7 Flash — just 23 days after Gemini 3.6 Flash, and built on the same architecture and training data. The model card is explicit that this is not a new pretraining run but “algorithmic improvements to its core reasoning foundation.” The gains are concentrated almost entirely in […]

  • Qwen3.8-27B: Frontier Agentic Scores on a Single Consumer GPU

    Qwen3.8-27B: Frontier Agentic Scores on a Single Consumer GPU

    Alibaba released Qwen3.8-27B on August 14, 2026 — a 27-billion-parameter dense vision-language model under Apache 2.0, published on Hugging Face and ModelScope. It is the small sibling of the 2.4-trillion-parameter Qwen3.8-Max whose weights went up the day before, and on several agentic benchmarks it does not behave like a small model at all: 61.7 on […]

  • Qwen3.8-2.4T-A95B: Alibaba Open-Weights Its Max-Tier Flagship

    Qwen3.8-2.4T-A95B: Alibaba Open-Weights Its Max-Tier Flagship

    Alibaba published the weights for Qwen3.8-2.4T-A95B on August 13, 2026 — the open-weight release of Qwen3.8-Max, the 2.4-trillion-parameter Mixture-of-Experts model it launched as an API product ten days earlier. It is the first time Alibaba has released a Max-tier model’s weights, and at 2.4T total parameters it is the largest open-weight language model published to […]

  • Qwen3.8-Max Draws Level With the Frontier on Agentic Benchmarks

    Qwen3.8-Max Draws Level With the Frontier on Agentic Benchmarks

    Alibaba released Qwen3.8-Max on August 3, 2026, and within days independent evaluation put it level with the frontier on agentic work. On Artificial Analysis’ Agentic Index, the 2.4-trillion-parameter model scores 58 — tied with Claude Opus 5 running at xhigh effort, and one point behind Opus 5 at max effort, which still holds the top […]

  • NVIDIA Releases NemotronLabs VoiceChat, an Open Full-Duplex Voice Model

    NVIDIA Releases NemotronLabs VoiceChat, an Open Full-Duplex Voice Model

    NVIDIA released NemotronLabs VoiceChat on August 3, 2026 — an 11-billion-parameter, end-to-end speech model that listens and speaks at the same time, published with open weights on Hugging Face. It is the first open full-duplex model that can call tools mid-conversation, and independent testing from Artificial Analysis places it as the only open-weights speech model […]