In early July 2025, a team of researchers from Shanghai Jiao Tong University, Zhejiang University, and partners introduced MemOS, the first operational “memory operating system” designed to bring AI a level of human-like persistent recall (VentureBeat).
Key points
- In early July 2025 a team from Shanghai Jiao Tong University, Zhejiang University and partners introduced MemOS, described as the first operational memory operating system designed to give AI human-like persistent recall.
- MemOS manages memory through MemCubes, self-contained units that pair content with metadata such as provenance, versioning and governance rules.
- Reported testing gains include a 159% boost in temporal reasoning tasks versus OpenAI’s memory system, a 38.9% overall improvement on the LOCOMO benchmark, and up to 94% reduction in latency through KV-cache injections.
- MemOS is open-source under the MIT license, supports LLMs via Hugging Face, OpenAI and Ollama, with Linux support ready and Windows and macOS in development.
- A commenter on r/singularity noted the advertised numbers come from GPT-4o-mini and that MemCube scaling is only knowable with time.
What is MemOS?
Traditional large language models (LLMs) use short-lived context windows or rely on retrieval hacks, which lack true memory retention. MemOS reimagines memory as a fundamental resource—managed through MemCubes, self‑contained memory units that pair content with metadata like provenance, versioning, and governance rules (Reddit).
This transforms memory into a schedulable, shareable, and evolvable element—much like how operating systems manage CPU or storage.
Why It Matters
- Bridge short- and long-term memory: MemOS unifies transient activations, persistent plaintext, and parameter-based memories under one structure (Reddit).
- Lifecycle control & governance: MemCubes support scheduling, migration, auditing, privacy and usage policies—so memory isn’t just stored; it’s automatically managed over time (HyperAI超神经).
- Cross-platform portability: AI “memory islands” dissolve—MemOS enables memory migration across different tools or platforms.
- Expert memory marketplace: Imagine buying a “medical knowledge cube” from specialists—that vision of monetized, installable memory modules is in the researchers’ roadmap (VentureBeat).
Impressive Gains in Testing
- 159 % boost in temporal reasoning tasks versus OpenAI’s memory system
- 38.9 % overall improvement on the LOCOMO benchmark
- Up to 94 % reduction in latency through efficient KV-cache injections (VentureBeat)
These results show that treating memory as a first-class computational resource significantly boosts AI reasoning and performance.
Architecture Overview
MemOS follows a three-layer OS-like architecture (VentureBeat):
| Layer | Purpose |
|---|---|
| Interface | LLM-friendly APIs for memory operations |
| Operation | Contains MemScheduler, MemLifecycle, and governance logic |
| Infrastructure | Storage engines (vector DBs, file systems), policy enforcement, cross-device support |
Community Reaction
On r/singularity, a user summarized:
“MemOS positions ‘memory’ as a first-class operating‑system resource for LLM agents… conceptually elegant and empirically promising.” (Reddit)
Another noted limitations:
“Advertised numbers come from GPT‑4o‑mini… where their MemCube method will scale we’ll only know with time.” (Reddit)
Open-Source & Roadmap
MemOS is open-source—available under MIT license on GitHub and supports LLMs via Hugging Face, OpenAI, and Ollama. Linux support is ready; Windows and macOS are in development(VentureBeat).
Future directions include:
- Cross‑model memory transfer
- Self‑evolving memory blocks
- A marketplace ecosystem for “paid memory modules” (HyperAI超神经, VentureBeat)
Why This Could Be a Game-Changer
AI developers and enterprises have a long-standing memory gap in multi-session workflows—be it ongoing customer service, personal assistants, education tools, or diagnostic systems. MemOS’s structured, persistent, governed memory could finally bridge that gap and redefine long-term AI interaction.
Leave a Reply