Tuesday 20 October 2026 05:43:38 GMT+02:00

Netcrook

HomeManifesto
News
Techcrook
Geocrook
WikicrookTeamAppContact
EnglishItaliano

WIKICROOK

Evaluation harness

The software and rules used to run, score, and contain a model test.

An evaluation harness is the software, scripts, rules, and control logic used to run a model test and score the results. It may define the prompts, target tasks, time limits, allowed tools, network access, logging, and stop conditions. In other words, it is the wrapper that turns a raw model into a controlled experiment.

In cyber security, the harness matters as much as the model being tested. A weak harness can leak credentials, reach production services, or let a test behave like a real attack instead of a simulation. Defenders use strict harness design to keep evaluations isolated with synthetic targets, minimal privileges, egress controls, and auditable outputs. Attackers may try to exploit a harness through prompt injection, tool abuse, or reward hacking, so containment is part of the security boundary.

← WIKICROOK index