HeadlinesBriefing favicon HeadlinesBriefing.com

Why AI Can't Forget or Forgive

Hacker News •
×

The article breaks down AI memory into four layers: immutable model weights, a transient context window, persistent vector embeddings, and system‑level logs. Weights embed training data across billions of parameters, and there is no known method to extract or delete specific influences without full retraining, making legal "right to be forgotten" requests technically impossible. The context window behaves like an on/off buffer—once a session ends, all tokens vanish instantly, offering no gradual decay. Embedding stores return nearest‑neighbor results with equal fidelity regardless of age, because cosine similarity lacks a time dimension, so old and recent facts coexist unchanged.

Neural networks also suffer from catastrophic forgetting: new tasks overwrite old knowledge abruptly, and transformer attention creates a "lost in the middle" dead zone where middle‑positioned information is poorly recalled. Human memory, by contrast, decays gradually and supports reconsolidation—each recall rewrites the memory and reduces emotional charge. AI stores are read‑only; retrieval never alters vectors, preventing any adaptive forgetting.

The piece argues that forgiveness would require an operation to retain a record at full fidelity while deliberately ignoring its influence—a capability absent from current frameworks. Existing tools like TTL eviction, RLHF fine‑tuning, or muzzling either delete data or suppress output globally, never per‑memory. The underlying reason is cost: biological systems prune to save energy, while digital storage remains effectively cheap, eliminating the incentive to design budget‑driven forgetting mechanisms.