Google Cloud’s Always-On Memory Agent Replaces RAG and Embeddings With Continuous LLM Consolidation on — 2026-07-18

## Short Segments
Sakana AI's breakthrough in neural network training challenges the dominance of backpropagation. Their new method, Error Diffusion, trains networks without the need for weight transport, achieving impressive results on MNIST and CIFAR-10 datasets. Today, we'll explore how this approach aligns with Dale's principle and what it means for the future of AI training. Later, we'll dive into Google Cloud's Always-On Memory Agent, a game-changer in AI memory management. Sakana AI's Error Diffusion method trains networks without backpropagation, achieving 96.7% on MNIST and 61.7% on CIFAR-10. Backpropagation has long been the backbone of deep learning, but it relies on a mechanism the brain likely cannot replicate, known as the weight transport problem. Sakana AI's new paper, "Diffusing Blame," addresses this by using Error Diffusion, a local learning rule that avoids weight transport entirely. This method aligns with Dale's principle, which states that neurons can either excite or inhibit, but not both. The research team implemented a dual-stream architecture, splitting each layer into excitatory and inhibitory streams, allowing for effective training without backpropagation. This development could pave the way for more biologically plausible AI models, offering a fresh perspective on neural network training.
## Feature Story
Google Cloud's Always-On Memory Agent redefines AI memory management by replacing traditional retrieval methods with continuous LLM consolidation. Most AI agents process requests and then forget the context, but Google's new Always-On Memory Agent changes that by treating memory as a continuous process. This agent, built with Google's Agent Development Kit and Gemini 3.1 Flash-Lite, operates 24/7, continuously ingesting and processing data without relying on vector databases or embeddings. Instead, it uses a large language model to read, think, and write structured memory into SQLite, aiming for low latency and cost efficiency. The architecture involves an orchestrator that routes requests to specialist sub-agents, each handling different aspects of memory management. The IngestAgent extracts summaries and key information, while the ConsolidateAgent synthesizes insights and connections every 30 minutes. This approach mirrors human memory processes, offering a persistent memory layer that continuously evolves. By eliminating the need for traditional retrieval stacks, the Always-On Memory Agent simplifies AI architecture and reduces costs, making it a compelling option for enterprises seeking efficient memory management solutions. As AI continues to evolve, this development highlights the importance of persistent memory in creating more intelligent and responsive systems. With its open-source release, developers can now explore and implement this innovative approach, potentially transforming how AI agents handle memory in the future. Stay tuned as we continue to track the impact of this technology on the AI landscape.