Agent Ops Runbook

Generate a production-ready operations runbook for deploying AI agents. Covers pre-deployment checklists, shadow mode → supervised → autonomous rollout stages, monitoring dashboards, rollback procedures, cost management, and incident response templates.

When to Use

• Deploying an AI agent to production
• Building monitoring and alerting for agent systems
• Creating rollback procedures for autonomous workflows
• Estimating and controlling agent operational costs

Instructions

When the user asks for an agent ops runbook or deployment plan:

1. Ask which agent function they're deploying (support, sales, document processing, etc.)
2. Ask about their risk tolerance (conservative, moderate, aggressive rollout)
3. Generate a complete runbook with:
4. Pre-deployment checklist specific to their function
5. 3-stage rollout plan with metrics and gates
6. Monitoring alerts (critical + warning thresholds)
7. Rollback procedures (3 levels: prompt, feature, full)
8. Cost estimates based on their expected volume
9. 90-day implementation timeline

10. Incident response template

11. Include specific metric targets:

12. Accuracy vs human baseline: >90%
13. Error rate: <2%
14. Cost per task benchmarks by function

15. Human escalation rate: 5-15%

16. Flag risks specific to their industry (compliance, PII, financial accuracy)

Output format: Markdown document ready to share with engineering and ops teams.