Sabado 17 Octubre 2026 15:52:04 GMT+02:00

Netcrook

InicioManifiesto
Noticias
Techcrook
Geocrook
WikicrookEquipoAppContacto
EnglishItaliano

WIKICROOK

Constitutional AI

An alignment approach that guides model behavior using explicit principles or rules.

Constitutional AI is an alignment method that trains or guides a model with an explicit set of principles, often written as rules about helpfulness, harmlessness, honesty, or policy compliance. Instead of relying only on human rating of outputs, the system learns to revise its answers against that “constitution” and prefer responses that satisfy the stated rules.

This matters in cybersecurity because model behavior is part of the attack surface. A well-defined constitution can reduce unsafe instructions, limit abusive content, and make refusals more consistent in high-risk settings. It also supports auditing: defenders can inspect the governing principles and test whether the model follows them under adversarial prompts. In real attacks, prompt injection and jailbreak attempts try to push the model beyond those rules; in defense, Constitutional AI is one layer that helps keep the model aligned when inputs are hostile or misleading.

← índice WIKICROOK