Metaphor Tracer: A Theory-Informed Analysis of Hidden States
2607.28434

Authors

Lutz Goetzmann,Marc Heimann,Roxana Assadi Moghaddam,Olga Brovkina,Mark Pettifor

Abstract

What do a language model's hidden states say about the organization of a single text? From one forward pass, without training, we score every token position on two properties. The aggregator measures whether the position consolidates the whole text into a stable configuration. The differentiator, whether other tokens are transiently carried into its subspace as the model reads: metaphor in its root sense, transport. Constants were frozen on one discovery text; every other is confirmatory.

The aggregator is not, in the classic sense, an information measure, nor a measure of salience. Across three unrelated models, as a signifier repeats, its surprisal and its attention drain while its aggregator score holds: the channel marks a token's place in the text.

That this tracks a reading rests on independent ground truth: an engineered register the aggregator follows across its boundaries (6/6 cells), and a psychoanalyst's marking of clinical transcripts, fixed before the instrument existed, in 34/36 cells, with a graded increment above lexical controls and dissociations no type-level measure reproduces. A transfer test gives the result its shape: the model whose token structure travels with lexical type reads the singular discourse worst, and in a matched base/instruct pair tuning raises fidelity without moving type-transfer.

Structural value is a property of a token's place in this text, not of its vector alone: a relational rather than essentialist reading of hidden states, operationalizing theory that predated the instrument.

Resources

Ray graphicRay graphicRay graphicRay graphic

Stay in the loop

Every AI paper that matters, free in your inbox daily.

Details

  • takara.ai
  • Custom AI and machine learning from the Frontier Research Team.
  • © 2026 takara.ai Ltd
  • Content is sourced from third-party publications.
Ray graphicRay graphicRay graphic