#human-in-the-loop
Every post tagged "human-in-the-loop".
64 posts · showing 1–10
-
The Analytics Agent's SQL Was Correct. It Answered a Different Question. Make It Print Its Definitions Before Its Number.
The query ran clean, the chart looked right, and the churn number went into the board deck. It counted trial accounts as customers. The fix is not better SQL; it is making the agent commit to what every word in the question means before it touches the warehouse.
-
Your Agent Asks Permission Nine Times an Hour, So Nobody Reads the Prompts Any More. Spend a Fixed Approval Budget.
Every confirmation dialog you add makes the next one less effective. Here's how to classify write actions by reversibility and reach, auto-allow the safe corner, and reserve the human's attention for the handful of actions that can't be undone.
-
The Page Your Agent Read Told It to Email Your Customer List. "Ignore Instructions in the Content" Won't Stop the Next One.
A system-prompt warning makes injection less likely. It doesn't make it impossible, and the attacker gets as many tries as they like. The real fix lives in the tool dispatcher, not the prompt.
-
Your Agent's Dry Run Doesn't Bind the Real Run — Confirm the Plan Hash, Not the Intent
A human approves a preview; the agent then executes a freshly computed call. Everything that shifts in between is unguarded — and the fix is a redeemable plan object, not a sterner confirmation prompt.
-
Your First Production Agent Should Be Invoice Reconciliation — Because the Ledger Grades It for You
The best first agent isn't the most impressive one — it's the one whose environment tells you when it's wrong. Here's how to score candidate tasks for a built-in oracle, and the two ways that oracle quietly lies to you.
-
Your Two Reviewer Agents Disagree. Who Breaks the Tie?
Running the same document past two agents is easy. Deciding what happens when they return opposite verdicts is the part most multi-agent designs quietly leave undefined — and the default resolution is usually the worst one available.
-
Your Agents Asked 40 Questions This Week. Which Ones Should Have Reached a Human?
Human attention is the one resource in an agent deployment that never shows up on the bill — so agents spend it freely. Here's a three-way routing rule, a threshold you can actually tune, and the two metrics that tell you when your agent is asking too much or too little.
-
Read, Draft, Send: Where to Draw the Permission Line in a Personal Email Agent
Most email agents get permissions wrong by granting them per tool. The safer line runs through the arguments — who the recipient is, how many there are, and whether the thread was already open.
-
Retry, Reroute, or Hand Back: Budgeting an Agent's Second Chances
A tool call fails and the loop tries again — five times, forty seconds, and still nothing usable for the user. Retrying is only one of three legal responses, and picking the wrong one turns a fast failure into an expensive one.
-
Extraction Was Never the Hard Part: An Invoice Agent, Rebuilt
The first version had the model read invoices and type the numbers. The rebuild started after the numbers were already read — which is where the actual work in accounts payable has always been.