RITS

Tag: QAT

  • LittleBit-2: Samsung’s Sub-1-Bit LLMs via Latent Geometry Alignment

    LittleBit-2: Samsung’s Sub-1-Bit LLMs via Latent Geometry Alignment

    Lead — On July 23, 2026, Samsung Research published LittleBit-2, the successor to a compression method that pushes large language models below one bit per weight. Presented at ICML 2026, LittleBit-2 keeps the original LittleBit architecture from NeurIPS 2025 but changes one thing: how the compressed weights are initialized. That single change takes the method […]

  • Google Ships Gemma 4 QAT Models: 72% Less VRAM, Same Quality

    Google Ships Gemma 4 QAT Models: 72% Less VRAM, Same Quality

    Lead — On June 5, 2026, Google DeepMind released quantization-aware training (QAT) checkpoints for the entire Gemma 4 family, cutting memory requirements by roughly 72% while keeping output quality nearly identical to the full-precision models. The release spans every size — from the sub-1 GB E2B edge model to the 31B dense flagship — and […]