Billing invoice generation backlog
INC-2840MediumMonitoring
Invoice generation workers are backed up; ~14k invoices pending. Customers may see delayed invoice emails.
Duration
1d 16h 29m
Impacted Users
14,200
Regions
us-east-1, eu-west-1
Response SLA
900s
Status Page
Not posted
War Room
#inc-2840
Detected at: 7/1/2026, 10:42:00 PM
Acknowledged: 7/1/2026, 10:45:00 PM
Last update: 7/2/2026, 4:12:00 AM
Incident Timeline
Chronological log of all events during this incident
Caleb Fosterstatus change7/2/2026, 4:12:00 AM
Status changed to monitoring. Queue depth back under 1k.
Caleb Fosternote7/1/2026, 11:02:00 PM
Scaled workers from 4 to 8. Queue depth dropping ~500/min.
Caleb Fosteracknowledged7/1/2026, 10:45:00 PM
Caleb Foster acknowledged as commander
Naomi Chencreated7/1/2026, 10:30:00 PM
Incident auto-created from alert ALR-1245 (invoice queue depth > 10k)
Incident Commander
C
Caleb Foster
Senior Backend Engineer
@caleb
Quick Actions
Responders
CCaleb Foster
YYuki Tanaka
PPriya Raman
Affected Services
Linked Alerts
ALR-1245MediumAcknowledged
Invoice queue depth is 14,231 (threshold 10,000)
Tags
#billing#backlog