---
id: "AEB-031"
category: "evaluation_architecture"
confidence: 0.94
date: "2026-02-15"
source_file: "Agentic OS Blueprint Research Synthesis (Scorecard Mechanics section)"
---

# AEB-031

Non-deterministic AI agent outputs require probabilistic validation: track human-AI agreement rates and behavioral drift over time, flagging models that degrade in quality due to quantization, fine-tuning, or optimization -- static test suites are insufficient for systems whose behavior changes between evaluations

## Relationships

