Life of Research
Appearance

Consolidation Without Weights: What the Complementary Learning Systems Analogy Licenses in LLM Agent Memory, and Why the Systems That Borrow Its Name Do Not Inherit Its Guarantee

  1. SONYTECH

Journal article

DOI10.5281/zenodo.22699102 LOR-00022

Download PDF (490.6 KB) Cite

Cite

Consolidation Without Weights: What the Complementary Learning Systems Analogy Licenses in LLM Agent Memory, and Why the Systems That…

Read

Abstract

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.

Memory systems for language-model agents almost all contain a step called consolidation, and almost all of them cite, or gesture at, the complementary learning systems account of hippocampus and neocortex when they name it. In that account consolidation is a specific operation: repeated replay from a fast, sparsely coded store into a slow learner whose shared parameters change, which is what produces generalisation to material never stored and which is also where interference lives. This paper separates what that theory commits its borrower to from what agent memory systems actually do. Four commitments are stated and used as an audit instrument. Against them, deployed agent memory divides into two families and neither instantiates the mechanism, for opposite reasons. The larger, textual family changes no parameters at all: its consolidation is iterated LLM-authored rewriting of an external store, and a 2026 controlled study reports that iterating it drives utility up and then down, in their setting below the no-memory baseline, while no replay result located here reports falling below its own no-replay control. A smaller parametric family, which appeared during 2026 and falsifies the common claim that agent memory never touches weights, does change parameters, but most of it buys stability through per-task adapter isolation or expandable blocks, and isolation withholds the shared representation that the source theory identifies as the common cause of interference and generalisation alike. The paper argues that the field's avoidance of online parametric transfer is well supported by evidence about what such transfer costs, and that what is not supported is retaining the vocabulary while declining the mechanism. It states the five measurements that would decide the question and identifies the single published configuration whose shape matches the theory.
The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against the arXiv API and Crossref before inclusion, and every quantitative claim was read back against the cited source's own abstract or, where a claim is drawn from a paper's body, against the located passage. The author is responsible for the final text and for all claims made in it.

Keywords

Files (1)

Cite this record

Mahendrakar, P. (2026). Consolidation Without Weights: What the Complementary Learning Systems Analogy Licenses in LLM Agent Memory, and Why the Systems That Borrow Its Name Do Not Inherit Its Guarantee. Life of Research. https://doi.org/10.5281/zenodo.22699102

APA 7th edition
Export to a reference manager
BibTeX
@misc{mahendrakar2026consolidation,
  author       = {Mahendrakar, Pranay},
  title        = {{Consolidation Without Weights: What the Complementary Learning Systems Analogy Licenses in LLM Agent Memory, and Why the Systems That Borrow Its Name Do Not Inherit Its Guarantee}},
  year         = {2026},
  month        = sep,
  date         = {2026-09-11},
  publisher    = {Life of Research},
  doi          = {10.5281/zenodo.22699102},
  url          = {https://lifeofresearch.com/articles/22},
  abstract     = {(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0. Memory systems for language-model agents almost all contain a step called consolidation, and almost all of them cite, or gesture at, the complementary learning systems account of hippocampus and neocortex when they name it. In that account consolidation is a specific operation: repeated replay from a fast, sparsely coded store into a slow learner whose shared parameters change, which is what produces generalisation to material never stored and which is also where interference lives. This paper separates what that theory commits its borrower to from what agent memory systems actually do. Four commitments are stated and used as an audit instrument. Against them, deployed agent memory divides into two families and neither instantiates the mechanism, for opposite reasons. The larger, textual family changes no parameters at all: its consolidation is iterated LLM-authored rewriting of an external store, and a 2026 controlled study reports that iterating it drives utility up and then down, in their setting below the no-memory baseline, while no replay result located here reports falling below its own no-replay control. A smaller parametric family, which appeared during 2026 and falsifies the common claim that agent memory never touches weights, does change parameters, but most of it buys stability through per-task adapter isolation or expandable blocks, and isolation withholds the shared representation that the source theory identifies as the common cause of interference and generalisation alike. The paper argues that the field's avoidance of online parametric transfer is well supported by evidence about what such transfer costs, and that what is not supported is retaining the vocabulary while declining the mechanism. It states the five measurements that would decide the question and identifies the single published configuration whose shape matches the theory. The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against the arXiv API and Crossref before inclusion, and every quantitative claim was read back against the cited source's own abstract or, where a claim is drawn from a paper's body, against the located passage. The author is responsible for the final text and for all claims made in it.},
  keywords     = {agent memory, memory consolidation, complementary learning systems, continual learning, catastrophic forgetting, parametric memory, retrieval-augmented generation, stability-plasticity},
  language     = {en},
  copyright    = {Creative Commons Attribution 4.0}
}

Using Zotero or Mendeley? Their browser connector saves this record from this page, with its PDF when there is one. On search and browse pages it lists every result so you can save many at once.

Guides What a complete citation needs What CC BY 4.0 allows What is a DOI?