#advanced
Every post tagged "advanced".
23 posts · showing 11–20
-
Deadlock, Livelock, and the Agent That Waits Forever
A deadlocked thread pool gives you a stack trace. Deadlocked agents produce fluent, plausible activity that looks like work — and bill you for it until someone notices.
-
OAuth for Agents: Acting on Behalf of a User
A service account with everyone's access puts your entire access-control model inside a model's judgment. Per-user tokens move the check to where prompt injection can't reach it.
-
Queueing and Backpressure for Agent Workloads
A run can take four seconds or four minutes, and you can't tell in advance. Size the pool to the provider's rate limit, split queues by shape — and check the one timeout relationship that silently runs your task twice.
-
Sandboxing Code Execution: What a `run_code` Tool Actually Needs
One tool replaces dozens — and hands a model that reads untrusted text a general-purpose mechanism for doing anything the process can do. Four boundaries, four isolation levels, and the one people leave open.
-
Agents That Wait: Callbacks, Webhooks, and Long-Running Tools
A twenty-minute export breaks the assumption that tools return quickly. Handles, in-loop polling, and true suspension — plus the expiry field that stops suspended runs leaking forever.
-
Migrating Model Versions Without Breaking Your Agent
The new model is better at nearly everything and different at everything, and tool selection is what shifts first. Replay a frozen eval set against both — and put the cost-per-task row in the comparison.
-
Indirect Prompt Injection: When the Tool Result Is the Attack
The attack doesn't come from your user — it comes from the page, ticket, or document your agent fetched. Three conditions have to hold for it to work, and breaking any one is an architectural choice, not a prompt.
-
Designing for Resumability: Agents That Survive a Restart
Serializing the message array is the obvious approach and it produces subtly wrong resumptions. What has to survive a crash is a work ledger, idempotent side effects, and enough state to rebuild context from scratch.
-
Debate or Vote? Getting Real Value From Multiple Model Opinions
Voting harvests independent error; debate harvests challenge. Pick wrong and you multiply your token bill for agreement you'd have had from a single call — and the disagreement, the part worth paying for, gets logged away.
-
Rate Limits Are an Agent Design Constraint, Not an Ops Problem
Backoff assumes a predictable call count. Agents burst, retry at three layers, and generate more traffic the more they're throttled — which makes rate limits an architecture question, not an ops ticket.