Tag: on-device
-
Cactus Needle 3: One Set of Weights, an 8-29 MB Model at Any Depth
Cactus Compute shipped Needle 3 on September 17, 2026, a single set of weights that runs as anything from a 29-million-parameter, 8 MB model to a 121-million-parameter, 29 MB one, depending on how many layers you deploy. It is not a chat model. Needle 3 does three things — tool calling, structured extraction, and text embedding — […]
-
macOS 27 Ships a Foundation Model at the Command Line
macOS 27 “Golden Gate” shipped on September 14, 2026, and with it a system binary at /usr/bin/fm — a command-line interface to Apple’s on-device foundation model, pre-installed, always available, and free of API keys, accounts, and per-token costs. Apple has shipped on-device models since 2024 and opened the Foundation Models framework to developers in 2025, […]
-
Google AI Edge Gallery: Exploring On-Device Generative AI on Android
Google has introduced the AI Edge Gallery, an experimental Android application that brings the capabilities of Generative AI directly to users’ devices. This app allows users to experience and evaluate on-device machine learning (ML) and Generative AI use cases without the need for an internet connection once models are loaded.(YouTube, GitHub) Key points Google introduced […]