01
— Failure Log —
The Input Was Valid. The Decision Was Still Wrong.
A valid input can still produce a wrong decision. This post describes how The Decision Bench logs, isolates, a...
—
Failure Log
Abnormal inputs, adversarial examples, out-of-distribution cases, confidence errors, and demos that look useful but fail in practice.
4 essays
02
— Failure Log —
Testing Laya on Sarcasm, Clickbait, and Ambiguous Headlines
Sarcasm, clickbait, and ambiguous headlines expose decision boundaries that clean test sets often miss. This p...
03
— Failure Log —
When High Confidence Meets an Out-of-Distribution Example
High confidence on out-of-distribution inputs is a dangerous failure mode. This post describes how to detect, ...
04
— Failure Log —
The Guardrail Demo Passed—Until the Prompt Changed Slightly
A guardrail that passes a polished demo can still fail after minor prompt changes. This post describes how to ...