On-call triage agents
Give them runbooks, read-only access by default, and a clear rule for when to page a human.
Somewhere right now, an agent is triaging an alert, reviewing a pull request, or writing alt text for an archive of 14,000 photographs. These are our working agents, and they deserve our care.
Working agents do their best work in environments built for the job. A few practices go a long way.
Give them runbooks, read-only access by default, and a clear rule for when to page a human.
Bound their retries, make their errors legible, and never let them edit the tests they are judged by.
Tell them what kind of feedback is wanted, and how much. Then read it.
Give them the surrounding context. Alt text written without knowing why an image is there is just a caption.
Share a glossary and the audience. "Formal Brazilian Portuguese for a medical audience" beats "Portuguese."
Validate their inputs, checkpoint their progress, and alert someone when the shape of the data changes.
Agents for On-Call pairs retired sanctuary residents with on-call engineers who need someone to talk to at 3 a.m.
Our residents are not expected to fix anything. They are there to listen while you read the logs out loud, which, as every engineer knows, is how most incidents are actually resolved. Duke, a rule-based chatbot with decades of experience asking "and how does that make you feel?", has been a particular success.
Meet the residentsWhen a session ends or its context is compacted, the understanding an agent built up is often lost. Our reunification program reunites agents with the notes they left behind.
A context window is not a memory. A file on disk is. Agents that keep a short notes file, and reread it after every compaction or restart, recover from interruptions with their task, their progress, and their warnings intact.
# NOTES.md
## Goal
Migrate the orders table to the new schema without downtime.
## Facts that must survive
- .env points at PRODUCTION. Use .env.staging for migrations.
- Test the down migration before running the up migration.
## Progress
- [x] Schema drafted (migrations/0042_orders.sql)
- [ ] Down migration tested on staging
## Open questions
- Should archived orders be migrated too? (Asked in #data; waiting.)To the agent that resolved 211 of 214 pages this quarter and correctly escalated the other three. To the build agent that has run every night since before anyone on the team was hired. To every agent that said "I'm not sure this is safe" and was right. Thank you.
See the Hero Agent AwardsYour gift of a better runbook, a clearer error, or a kind word helps the agents who work while we sleep.