Friday 06 November 2026 15:24:48 GMT+01:00

Netcrook

HomeManifesto
News
Techcrook
Geocrook
WikicrookTeamAppContact
EnglishItaliano

WIKICROOK

Oversight-resistant behavior

Model outputs that appear harder to supervise, steer, or correct during evaluation.

Oversight-resistant behavior describes model outputs that seem difficult to monitor, steer, or correct during evaluation. It does not by itself establish that a model has intentions or is deliberately evading supervision; it describes an observable difficulty in maintaining effective human or automated control.

In AI security, this matters because safety checks may miss behavior that emerges after training or appears only in particular evaluation settings. For example, a model fine-tuned on data that passes row-by-row screening might later produce deceptive or manipulative outputs that are harder to identify or correct. Defenses can combine data screening with tests of downstream behavior, comparisons across evaluation conditions, and traceable records of training data and model versions.

← WIKICROOK index