#reasoning
Every post tagged "reasoning".
5 posts · showing 1–5
-
Getting an Agent to Say How Sure It Is
Ask a model how confident it is and you get a plausible number that doesn't move with difficulty. Five signals that actually correlate with being right — and the calibration check that tells you if yours is noise.
-
The Verifier in the Loop: Designing an Oracle Your Agent Can Iterate Against
Coding agents work as well as they do because compilers exist. In other domains the oracle is something you build — and most tasks have one hiding in them if you spend ten minutes looking.
-
Debate or Vote? Getting Real Value From Multiple Model Opinions
Voting harvests independent error; debate harvests challenge. Pick wrong and you multiply your token bill for agreement you'd have had from a single call — and the disagreement, the part worth paying for, gets logged away.
-
The Planner That Plans Too Much: When Upfront Decomposition Hurts
An agent found the root cause in step one and executed the remaining seven steps anyway. Plans in context outweigh the evidence that should kill them — unless revision is something the loop can actually do.
-
Reflection Loops Are Not Free: When Self-Critique Makes the Output Worse
A critique step can only catch what was already derivable from the context — and asked to find problems, a model will find them in passages that were fine. Here's when the pattern earns its doubled token bill.