Tag: edge ai
-
Cactus Needle 3: One Set of Weights, an 8-29 MB Model at Any Depth
Cactus Compute shipped Needle 3 on September 17, 2026, a single set of weights that runs as anything from a 29-million-parameter, 8 MB model to a 121-million-parameter, 29 MB one, depending on how many layers you deploy. It is not a chat model. Needle 3 does three things — tool calling, structured extraction, and text embedding — […]
-
Bonsai 2 27B: Qwen3.8 in 5.9 GB at 98% of Full Precision
On September 17, 2026, PrismML released Ternary Bonsai 2 27B — a 1.76-bit-per-weight build of Alibaba’s Qwen3.8-27B that fits in 5.93 GB and, on the company’s 20-benchmark suite, keeps 98.2% of the full-precision model’s score. July’s Ternary Bonsai 27B, built on the older Qwen3.6 base, retained about 95%. The new build ships under Apache 2.0 […]
-
Bonsai 27B: A 27B-Class AI Model That Runs on a Phone
On July 14, 2026, PrismML released Bonsai 27B — a pair of extreme-quantization builds of Alibaba’s Qwen3.6-27B that the company calls the first 27B-class model capable of running on a phone. The 1-bit variant fits in 3.9 GB and runs on an iPhone 17 Pro, while a higher-quality ternary variant fits in 5.9 GB for […]
-
SupraLabs Ships a 30M-Parameter Any-to-Any Model
SupraLabs has released Supra-A2A-Nano-Exp, an experimental ~30-million-parameter “any-to-any” model that handles text, images, and video in a single autoregressive transformer — small enough to run on a laptop CPU. Released under Apache 2.0 by the independent research group behind a string of trending ultra-small models, it is framed not as a capable generator but as […]
-
Cactus Releases Needle: A 26M Distilled Model for On-Device Tool Calling
Cactus Compute has released Needle, an open-source 26-million-parameter model distilled from Google’s Gemini 3.1 Flash Lite for single-shot function calling. Released under the MIT license, Needle quantizes to a 14 MB INT4 footprint and is designed to run AI agents entirely on phones, smartwatches, and other consumer devices — a sharp contrast to the cloud round-trips […]