PARAS MADAN
All writing

Latest in AI

Databricks MemCurrent Explained: Persistent Memory for AI Agents

Databricks’ new research separates raw session history from reusable knowledge, with an important operational cost behind the benchmark gains.

Databricks published its MemCurrent research on October 20, 2026, explaining a persistent-memory architecture for production agents. It combines session history with distilled knowledge so agents can reuse what they learned without repeatedly loading every earlier conversation. The release provides technical evidence behind an existing beta capability, rather than announcing memory availability for the first time.

How MemCurrent stores agent memory

The MemCurrent research separates episodic memory, which preserves session traces, from derived memory, which stores reusable knowledge in a hierarchy of files. An index helps the agent discover that knowledge. Tools handle explicit updates, while an offline process extracts and consolidates lessons from previous sessions.

Keeping both forms serves a practical purpose. A compact summary can make the next task cheaper to start, while the underlying history provides a way to recover details the summary left out.

For example, imagine a data agent that has learned which tables to join for a recurring question. Keeping that procedure could save repeated exploration. Keeping the original session could also help someone inspect why the procedure was chosen when the database changes. This is a design consideration, not a claim that every retained procedure remains correct.

What the MemCurrent benchmarks show

Databricks reports 88.1% average accuracy across three public memory benchmarks, compared with 87.8% when supplying the full history. Mean input usage was 8,400 versus 103,000 tokens per question. The tests used two agent implementations and three repeats.

On its internal memory benchmark, reported pass rates were 68.4% with MemCurrent and 22.3% without memory. These are Databricks’ evaluations, not independent measurements or a forecast for another team’s workload.

Token reduction is not the same as total cost reduction. A production comparison also needs to account for generating memories, storing histories and running the background process. If a task is rarely repeated, there may be less opportunity to recover that upfront work.

The useful test is whether a team’s later tasks benefit from earlier sessions. A benchmark of isolated questions cannot settle that question for a product with different users, histories and permissions.

Agent memory was already in beta

Databricks’ October release notes date the beta for agent memory pipelines to October 12. The October 20 research is the new material here, explaining the approach and evaluation rather than turning an older feature into a fresh launch.

The pipeline documentation also exposes constraints that matter when implementing it. Scheduled pipelines run roughly every 24 hours, without a configurable interval or cron schedule. A pipeline runs only one job at a time.

Its session store and memory store are fixed at creation. Changing them requires a new pipeline, whose first run processes the actors’ full history instead of reusing the old checkpoints. Deleting a pipeline stops future runs but does not remove the memories it already wrote.

That last distinction matters for operations. Stopping a process and erasing its outputs are separate actions. A team needs an explicit lifecycle for retained knowledge, rather than treating a background job’s existence as its retention policy.

Evaluate memory that should be forgotten

A useful evaluation should include changed facts as well as repeated tasks. Give an agent an earlier procedure, change the relevant assumption, then check whether it updates its behavior or keeps applying the old lesson. Inspect the resulting memory, not just the final answer.

Persistent memory becomes valuable when it saves useful work without making yesterday’s assumptions harder to question. The next practical question for teams is how quickly they can find, correct and retire the knowledge an agent carries forward.

I’m Paras. I work at the intersection of AI, engineering and distribution.

If you’re building an enterprise AI product and want help explaining its technical choices clearly to developers and decision-makers, I’d be happy to work with you.

Book a 30-minute call.