Tag: AI

  • Google Ships Gemma 4 QAT Models: 72% Less VRAM, Same Quality

    Google Ships Gemma 4 QAT Models: 72% Less VRAM, Same Quality

    Lead — On June 5, 2026, Google DeepMind released quantization-aware training (QAT) checkpoints for the entire Gemma 4 family, cutting memory requirements by roughly 72% while keeping output quality nearly identical to the full-precision models. The release spans every size — from the sub-1 GB E2B edge model to the 31B dense flagship — and […]

  • Huawei’s KVarN Hits 5x KV-Cache Capacity at FP16 Accuracy and Throughput

    Huawei’s KVarN Hits 5x KV-Cache Capacity at FP16 Accuracy and Throughput

    On June 2, 2026, Huawei researchers released KVarN — a variance-normalized KV-cache quantization backend for vLLM that breaks the long-standing tradeoff between cache compression and inference speed. KVarN delivers 3–5× more context capacity at 2-bit precision while keeping FP16-level accuracy and beating FP16 throughput, all behind a single vLLM flag with no calibration. It ships […]

  • Google Releases Gemma 4 12B: Frontier Multimodal AI on a Laptop

    Google Releases Gemma 4 12B: Frontier Multimodal AI on a Laptop

    Lead — On June 3, 2026, Google DeepMind released Gemma 4 12B, a unified, encoder-free multimodal model that brings frontier-class intelligence to a single 16 GB laptop. The 11.95-billion-parameter model handles text, images, and audio in one decoder-only transformer, supports a 256K-token context across 140+ languages, and ships under a fully permissive Apache 2.0 license. Google […]

  • Google I/O 2026 Pushes Gemini Into Agent Channels

    Google I/O 2026 Pushes Gemini Into Agent Channels

    Google I/O 2026 turned Gemini into a broader agent distribution stack, with Gemini 3.5 Flash, Spark, Antigravity, AI Mode, and new agent channels all pointing in the same direction: Google wants AI agents to move from standalone demos into Search, productivity software, browsers, phones, and developer workflows. General Audience Key points Google I/O 2026 turned […]

  • Cactus Releases Needle: A 26M Distilled Model for On-Device Tool Calling

    Cactus Releases Needle: A 26M Distilled Model for On-Device Tool Calling

    Cactus Compute has released Needle, an open-source 26-million-parameter model distilled from Google’s Gemini 3.1 Flash Lite for single-shot function calling. Released under the MIT license, Needle quantizes to a 14 MB INT4 footprint and is designed to run AI agents entirely on phones, smartwatches, and other consumer devices — a sharp contrast to the cloud round-trips […]

  • Thinking Machines Unveils Interaction Models for Real-Time Human-AI Collaboration

    Thinking Machines Unveils Interaction Models for Real-Time Human-AI Collaboration

    Thinking Machines Lab announced its first “interaction models” on May 11, 2026, unveiling TML-Interaction-Small — a 276B-parameter mixture-of-experts model (12B active) designed for real-time, multimodal collaboration. Rather than waiting for the user to finish speaking, the model interleaves 200-millisecond chunks of audio and video input with simultaneous output generation, eliminating the turn-taking pause that defines […]

  • MiniCPM-V 4.6: A 1.3B Multimodal Model Built for Phones

    MiniCPM-V 4.6: A 1.3B Multimodal Model Built for Phones

    OpenBMB released MiniCPM-V 4.6 on May 11, 2026 — the smallest entry in the MiniCPM-V family to date. At just 1.3B parameters, the new multimodal model handles single-image, multi-image, and video understanding while running on consumer phones across iOS, Android, and HarmonyOS. The model is open-weight under Apache 2.0 and ships with vLLM, SGLang, llama.cpp, […]

  • NVIDIA Star Elastic: One Checkpoint, Three Reasoning Models, Zero-Shot Slicing

    NVIDIA Star Elastic: One Checkpoint, Three Reasoning Models, Zero-Shot Slicing

    On May 7, 2026, NVIDIA released Star Elastic — a single 30-billion-parameter reasoning checkpoint that contains two smaller production-ready models, 23B and 12B, embedded in its weights. Developers can extract the smaller variants with a one-shot slicing script, no fine-tuning required. The release introduces a “many-in-one” approach to LLM packaging that NVIDIA reports cuts post-training […]

  • NVIDIA Releases Kimodo: Controllable Text-to-Motion for Characters and Humanoid Robots

    NVIDIA Releases Kimodo: Controllable Text-to-Motion for Characters and Humanoid Robots

    On March 16, 2026, NVIDIA released Kimodo — a kinematic motion diffusion model that turns text prompts and sparse kinematic constraints into high-quality 3D human and humanoid-robot motion. Trained on 700 hours of commercially-friendly optical motion capture data, Kimodo ships as an open-source project on GitHub and Hugging Face, with seven model checkpoints spanning the […]

  • China Issues First National Policy Framework Dedicated to AI Agents

    China Issues First National Policy Framework Dedicated to AI Agents

    On May 8, 2026, China’s Cyberspace Administration (CAC), the National Development and Reform Commission, and the Ministry of Industry and Information Technology jointly released the Implementation Opinions on the Standardized Application and Innovative Development of Intelligent Agents — the country’s first dedicated policy framework treating AI agents as a distinct class of system requiring its […]