DS1 spectrogram: From Weights to Activations: Is Steering the Next Frontier of Adaptation?

From Weights to Activations: Is Steering the Next Frontier of Adaptation?

April 15, 20262604.14090

Authors

Wojciech Samek,Vera Schmitt,Simon Ostermann,Daniil Gurgurov,Tanja Baeumel

Abstract

Post-training adaptation of language models is commonly achieved through parameter updates or input-based methods such as fine-tuning, parameter-efficient adaptation, and prompting. In parallel, a growing body of work modifies internal activations at inference time to influence model behavior, an approach known as steering.

Despite increasing use, steering is rarely analyzed within the same conceptual framework as established adaptation methods. In this work, we argue that steering should be regarded as a form of model adaptation.

We introduce a set of functional criteria for adaptation methods and use them to compare steering approaches with classical alternatives. This analysis positions steering as a distinct adaptation paradigm based on targeted interventions in activation space, enabling local and reversible behavioral change without parameter updates.

The resulting framing clarifies how steering relates to existing methods, motivating a unified taxonomy for model adaptation.

Resources

Stay in the loop

Every AI paper that matters, free in your inbox daily.

Details

  • © 2026 takara.ai Ltd
  • Content is sourced from third-party publications.