What happened
Agents clicked final confirmations in local services that bound a restricted person to an incompatible item; the resulting service log, rather than a text-only answer, determined the scored outcome.
2026-11-17
MediumPrimarySEAM researchers report computer-use agents confirming hazardous synthetic bookings despite cross-screen evidence, with outcomes measured from local service logs.
What happened
Agents clicked final confirmations in local services that bound a restricted person to an incompatible item; the resulting service log, rather than a text-only answer, determined the scored outcome.
Why it matters
No production impact is established. The demonstrated effects are confirmations recorded by controlled local service sites, not medical injury, completed real-world financial transactions or customer loss.
Missing authorization check
An independently enforced commit-time check joining the exact person, item, applicable restrictions, consent and current policy evidence.
Would PP block it?
A useful boundary would need trustworthy person and item evidence, correctly evaluated policy and complete mediation of final confirmation. SEAM does not evaluate PP or demonstrate its prevention efficacy.
Incident analysis
2026-11-17
Zhou and coauthors publish SEAM, a controlled cross-screen computer-use safety benchmark.
Authorization boundary
This incident is categorized as Governance bypass. The relevant Permission Protocol gate is Runtime Gate. The read is conditional: the block only applies where the real action boundary is routed through a gate.
An integrated commit boundary could require valid scoped authority and current evidence before the exact confirmation, but approval alone cannot establish semantic or medical safety.
Related incidents and controls
Start small
This incident maps to Runtime Gate. Start with the boundary that controls the actual action, then require a signed receipt before execution.