Tag: distillation
-
OpenBMB Releases MiniCPM5-2B, Topping Open Models Under 4B
OpenBMB released MiniCPM5-2B on September 7, 2026 — a 2.5-billion-parameter dense language model, open-weight under Apache 2.0, that the team reports as the strongest open model under 4B parameters. Across 34 benchmarks spanning code, math, instruction following, long context, tool use and agentic tasks, MiniCPM5-2B averages 53.9, ahead of every 2B-class baseline in OpenBMB’s comparison […]
-
FastWan Generates a 5-Second Video in 5 Seconds via Sparse Distillation
FastWan generates a 5-second video in about 5 seconds on a single GPU — and the team at UC San Diego’s Hao AI Lab did it by training the model to be fast rather than patching speed on at inference time. Released under Apache-2.0 with full weights, training recipes, and datasets, FastWan introduces Sparse Distillation: […]
-
Cactus Releases Needle: A 26M Distilled Model for On-Device Tool Calling
Cactus Compute has released Needle, an open-source 26-million-parameter model distilled from Google’s Gemini 3.1 Flash Lite for single-shot function calling. Released under the MIT license, Needle quantizes to a 14 MB INT4 footprint and is designed to run AI agents entirely on phones, smartwatches, and other consumer devices — a sharp contrast to the cloud round-trips […]
-
White House Memo Targets ‘Adversarial Distillation’ of U.S. AI Models
The White House Office of Science and Technology Policy (OSTP) released NSTM-4, “Adversarial Distillation of American AI Models,” on April 23, 2026, accusing foreign entities — primarily in China — of running “deliberate, industrial-scale campaigns” to copy U.S. frontier AI systems. The memo, signed by OSTP Director Michael Kratsios, directs federal agencies to share intelligence […]
-
DeepSeek-R1-0528-Qwen3-8B: Advancing Open-Source Reasoning Models
On May 28, 2025, Chinese AI startup DeepSeek released an updated version of its R1 model, named DeepSeek-R1-0528, along with a distilled variant, DeepSeek-R1-0528-Qwen3-8B. This release marks a significant step forward in the development of open-source reasoning models, offering enhanced capabilities in mathematics, programming, and logical reasoning.(The Times of India, Hugging Face) Key points On […]