human-in-the-loop reviewHuman-in-the-Loop for AI Agents: Most Approval Gates Rubber-Stamp
Claude Code users approve 93% of permission prompts, and human reviewers caught 13.6% of harmful actions in Anthropic's tests. Gate only irreversible agent actions, sample the rest with planted errors, and use the free gate in LangGraph or the OpenAI Agents SDK.
October 4, 2026 · 14 min readclinical AI validationLung Cancer AI: Chart Data Held Up. Scans and Slides Didn't.
I3LUNG's 2,396-patient Nature Medicine study found chart and blood data drove lung cancer immunotherapy predictions, while CT and pathology gains didn't survive held-out testing. Validate locally before funding new data pipelines.
September 15, 2026 · 10 min readrequirements engineeringChatGPT Made Spec Reviewers Worse. Save It for Round 2.
A controlled crossover experiment with 34 inspectors found ChatGPT support was associated with about 8% lower specification defect-detection F1 while saving no time at all. The cohort that learned the task unaided first improved roughly 12% between periods against 7% for the cohort that started with the tool.
August 24, 2026 · 12 min readexplainable AIThe Vaguer the AI Explanation, the More Novices Trusted It
A peer-reviewed Nature Medicine study put 623 lay people and 153 primary care physicians in front of the same AI diagnoses. In the experiment, researchers found explanations helped the experts and made the novices defer — and the vaguest ones were most persuasive.
August 6, 2026 · 11 min read