Field notes
November 17, 2026
When an Agent Says Done, Ask What It Didn't Check
A finished-sounding report from an SI agent tells you what it did. The more useful line is what it skipped. One short question to add to every handoff, and a worked example of the answer.
Most SI agents are good at sounding finished.
The report comes back tidy. Here is what I did. Here is the result. Everything looks fine. And most of the time, it is fine.
The trouble is the other times. When something goes wrong after an agent says "done," it usually isn't because the agent lied. It's because the report only covered what it did, and nobody asked about what it didn't do.
So I've started adding one question to the end of every job I hand to an agent:
Before you say done, list what you did not check, and why.
That's the whole idea. The rest of this post is what the answer looks like, and why it's worth the extra lines.
A made-up example
Say you ask an agent to update the prices on a small product page. Here is the kind of report you'd get without the question. This is an example I wrote for this post, not a real job.
Done. I updated the three prices on the page to the new numbers you sent. The page builds without errors.
Nothing in that is false. Now here is the same job with the question added.
Done. I updated the three prices on the page to the new numbers you sent. The page builds without errors.
Not checked: I didn't look at the page on a phone, because I can't open one. I didn't check whether the old prices appear anywhere else on the site, because you only named this page. I didn't confirm the new numbers against the store itself. I used the numbers in your message.
The work is the same. The second report is the one you can act on.
What each line is telling you
Each "not checked" line falls into one of three kinds, and it helps to know which is which.
Couldn't. "I can't open a phone." That's a limit of the tool, not a choice. You either check it yourself or accept the gap. Either way, you now know the gap is there.
Wasn't asked. "You only named this page." This is the most useful kind, because it shows you where your own request was narrower than what you meant. If the old price is also sitting in a footer somewhere, you'd rather hear it now than from a customer.
Took your word for it. "I used the numbers in your message." This one is easy to skip past. It means the agent's work is only as good as what you gave it. If you typed one price wrong, the agent copied it faithfully, and the report would still say "done."
None of these are failures. They're just the edges of the job, said out loud.
Why "what didn't you check" works better than "did you check everything"
If you ask an agent "did you check everything?", you'll usually get a yes. It's a yes-or-no question, and yes is the easy answer.
"What did you not check?" doesn't have an easy answer. It asks for a list, and an empty list looks strange. So the agent has to stop and think about the edges of what it did.
It also changes what a good report looks like. A report with an honest "not checked" section reads as careful. A report with none reads as a claim you'll have to test yourself.
When the list comes back empty
Sometimes the answer really is "nothing." The job was small, the agent could see all of it, and there was nothing to take on faith.
That's fine. But I treat an empty list on a big job as a reason to look a little closer, not a reason to relax. Big jobs almost always have edges.
Where this fits
This is one small habit, and it sits next to a few others I've written about here.
Before the work starts, give the agent the real source instead of your summary of it: https://johndclay.com/blog/give-the-agent-the-source
While the work runs, give it clear points where it should stop and ask instead of guessing: https://johndclay.com/blog/agent-stop-and-ask
And after it says done, ask what it didn't check. Then you decide what to do about the gaps, which is the part that was always your job anyway.
If you want longer pieces on how SI is changing ordinary work, they're collected here: https://johndclay.com/articles