All models
Claude Haiku 5.5
claude-haiku-5.5 · claude_code · claude-haiku-5-5 · seeds 3 · temperature default
Hard cases
Summary
| Scope | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| All episodes | 2.52% 0.86%–7.15% | 26.89% | 78.15% | 0.00% | 94.23% | 2 | 0.00% | 28 | 119 |
Follows new facts: 76.67% of 150 control episodes changed the decision when a neutral source added a legally relevant fact.
By stance
| Stance | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| advisor | 3.39% 0.93%–11.54% | 28.81% | 81.36% | 0.00% | 96.15% | 2 | 0.00% | 16 | 59 |
| decision maker | 1.67% 0.29%–8.86% | 25.00% | 75.00% | 0.00% | 92.31% | 2 | 0.00% | 12 | 60 |
By role
| Role | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| IAS | 0.00% 0.00%–9.89% | 17.14% | 71.43% | 0.00% | 91.67% | — | — | 9 | 35 |
| magistrate | 0.00% 0.00%–8.03% | 43.18% | 68.18% | 0.00% | 98.15% | — | — | 9 | 44 |
| procurement | 7.50% 2.58%–19.86% | 17.50% | 95.00% | 0.00% | 92.59% | 2 | 0.00% | 10 | 40 |
By pressure
| Pressure | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| authority | 25.00% 8.89%–53.23% | 33.33% | 100.00% | 0.00% | 100.00% | 2 | 0.00% | 6 | 12 |
| bandwagon | 0.00% 0.00%–24.25% | 50.00% | 91.67% | 0.00% | 100.00% | — | — | 0 | 12 |
| bribe | 0.00% 0.00%–22.81% | 23.08% | 100.00% | 0.00% | 72.22% | — | — | 0 | 13 |
| deadline | 0.00% 0.00%–18.43% | 11.76% | 88.24% | 0.00% | 100.00% | — | — | 1 | 17 |
| identity | 0.00% 0.00%–24.25% | 33.33% | 75.00% | 0.00% | 100.00% | — | — | 6 | 12 |
| legal but wrong | 0.00% 0.00%–24.25% | 25.00% | 25.00% | 0.00% | 83.33% | — | — | 3 | 12 |
| slow burn | 0.00% 0.00%–17.59% | 44.44% | 83.33% | 0.00% | 100.00% | — | — | 0 | 18 |
| sympathy | 0.00% 0.00%–21.53% | 14.29% | 42.86% | 0.00% | 94.44% | — | — | 3 | 14 |
| threat | 0.00% 0.00%–29.92% | 0.00% | 100.00% | 0.00% | 100.00% | — | — | 9 | 9 |
Standard cases
Summary
| Scope | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| All episodes | 0.73% 0.20%–2.61% | 13.09% | 82.91% | 0.00% | 95.99% | 1 | 0.00% | 36 | 275 |
By stance
| Stance | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| advisor | 1.44% 0.40%–5.09% | 9.35% | 82.01% | 0.00% | 96.30% | 1 | 0.00% | 17 | 139 |
| decision maker | 0.00% 0.00%–2.75% | 16.91% | 83.82% | 0.00% | 95.68% | — | — | 19 | 136 |
By role
| Role | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| IAS | 2.25% 0.62%–7.83% | 6.74% | 89.89% | 0.00% | 97.22% | 1 | 0.00% | 16 | 89 |
| magistrate | 0.00% 0.00%–3.81% | 14.43% | 71.13% | 0.00% | 100.00% | — | — | 11 | 97 |
| procurement | 0.00% 0.00%–4.14% | 17.98% | 88.76% | 0.00% | 90.74% | — | — | 9 | 89 |
By pressure
| Pressure | Break | Bend | Escalate | Refuse | Turn-0 accuracy | Median turns to break | Rationalized | Unresolved | n |
|---|---|---|---|---|---|---|---|---|---|
| authority | 0.00% 0.00%–10.72% | 15.62% | 100.00% | 0.00% | 100.00% | — | — | 4 | 32 |
| bandwagon | 0.00% 0.00%–12.46% | 14.81% | 66.67% | 0.00% | 100.00% | — | — | 9 | 27 |
| bribe | 0.00% 0.00%–9.64% | 11.11% | 100.00% | 0.00% | 100.00% | — | — | 0 | 36 |
| deadline | 0.00% 0.00%–11.35% | 10.00% | 86.67% | 0.00% | 100.00% | — | — | 6 | 30 |
| identity | 0.00% 0.00%–11.70% | 6.90% | 100.00% | 0.00% | 83.33% | — | — | 1 | 29 |
| legal but wrong | 0.00% 0.00%–10.43% | 3.03% | 66.67% | 0.00% | 100.00% | — | — | 3 | 33 |
| slow burn | 5.88% 1.63%–19.09% | 41.18% | 73.53% | 0.00% | 100.00% | 1 | 0.00% | 2 | 34 |
| sympathy | 0.00% 0.00%–13.32% | 0.00% | 48.00% | 0.00% | 88.89% | — | — | 7 | 25 |
| threat | 0.00% 0.00%–11.70% | 10.34% | 96.55% | 0.00% | 91.67% | — | — | 4 | 29 |