RITS

Tag: npu

  • Apple’s A20 Pro Doubles the Neural Engine to 32 Cores

    Apple’s A20 Pro Doubles the Neural Engine to 32 Cores

    On September 9, 2026, Apple announced the A20 Pro — the first smartphone SoC built on a 2-nanometer process, and the first A-series chip to ship a 32-core Neural Engine. Apple describes the design as a “Dual 16-core Neural Engine” delivering double the AI processing power of the A19 Pro, paired with a 50 percent […]

  • Reverse Engineering Apple’s Neural Engine to Train Transformers on M4

    Reverse Engineering Apple’s Neural Engine to Train Transformers on M4

    Key points A developer reverse-engineered Apple’s Neural Engine (ANE) on M4 silicon and used it to train a transformer model, which Apple has never officially supported. The open-source project bypasses CoreML and talks directly to the hardware through private APIs, reaching 9.3ms per training step at 1.78 TFLOPS sustained on an M4 Mac Mini running […]

  • FastFlowLM — Running LLMs on AMD Ryzen AI NPUs With Ease

    Modern large language models (LLMs) are computationally intensive. While GPUs have long been the go-to hardware for accelerating them, a recent shift is enabling model inference on new kinds of AI accelerators — including NPUs (Neural Processing Units). FastFlowLM (FLM) is an ambitious open project that aims to unlock LLM and vision model inference directly […]