Operator error alerting (#7) - #29

Merged

brocla merged 25 commits into

mainfrom

alerting-plan

Sep 11, 2026

Commits on Sep 11, 2026

Revise the error-alerting plan against the current code

Kevin Brown
and
claude
committed
51d13a8
Cap operator alerts at 20 a day in the alerting plan

Kevin Brown
and
claude
committed
339d1a3
Add the internal/alert core: reporter, throttle and queue

Kevin Brown
and
claude
committed
e8568f7
Persist the alert throttle ledger in the store

Kevin Brown
and
claude
committed
53ca9bc
Update the alerting plan for the phase 1 Ledger as built

Kevin Brown
and
claude
committed
6d6cca1
Throttle alerts in memory when the ledger fails instead of dropping them

Kevin Brown
and
claude
committed
f1b66b8
Split systemic job failures from sender rejections and report them

Kevin Brown
and
claude
committed
8cd9906
Record phase 2 and its shutdown exception in the alerting plan

Kevin Brown
and
claude
committed
9db5af9
Say so when a transformer reports success but exits with an error

Kevin Brown
and
claude
committed
dccf590
Retry only the mark when a sent reply cannot be marked delivered

Kevin Brown
and
claude
committed
b25e0b3
Record the resend-storm fix and #6's accepted window in the alerting plan

Kevin Brown
and
claude
committed
97125ab
Report job-sweep delete failures and serve the alert ledger from App

Kevin Brown
and
claude
committed
8a5addf
Report Mailgun-side failures and add SendAlert

Kevin Brown
and
claude
committed
51f5785
Wire operator alerts into the worker

Kevin Brown
and
claude
committed
c2dc092
Record phase 3 in the alerting plan

Kevin Brown
and
claude
committed
4242a35
Add filemill alert-test to prove the alert channel

Kevin Brown
and
claude
committed
39cf7e2
Use alert-test for phase 5's test send in the alerting plan

Kevin Brown
and
claude
committed
ff8cce3
Recover from panics in the delivery and sweep loops

Kevin Brown
and
claude
committed
45eb720
Report a worker restart and stop CLI commands interrupting live jobs

Kevin Brown
and
claude
committed
526f82e
Record phase 4 in the alerting plan

Kevin Brown
and
claude
committed
0aa8f96
Record the production verification of phases 4 and 5 in the alerting plan

Kevin Brown
and
claude
committed
f7d2118
Interrupt leftover jobs only in continuous mode

Kevin Brown
and
claude
committed
ba22367
Keep the suppressed alert count when a send fails

Kevin Brown
and
claude
committed
163a6bf
Report a mark failure that follows another alert, and name orphaned files

Kevin Brown
and
claude
committed
f47aec5
Record the review fixes in the alerting plan

Kevin Brown
and
claude
committed
09e30b9

Navigation Menu

Operator error alerting (#7) - #29

Operator error alerting (#7)#29
brocla merged 25 commits into
mainfrom
alerting-plan

Commits on Sep 11, 2026

Revise the error-alerting plan against the current code

Cap operator alerts at 20 a day in the alerting plan

Add the internal/alert core: reporter, throttle and queue

Persist the alert throttle ledger in the store

Update the alerting plan for the phase 1 Ledger as built

Throttle alerts in memory when the ledger fails instead of dropping them

Split systemic job failures from sender rejections and report them

Record phase 2 and its shutdown exception in the alerting plan

Say so when a transformer reports success but exits with an error

Retry only the mark when a sent reply cannot be marked delivered

Record the resend-storm fix and #6's accepted window in the alerting plan

Report job-sweep delete failures and serve the alert ledger from App

Report Mailgun-side failures and add SendAlert

Wire operator alerts into the worker

Record phase 3 in the alerting plan

Add filemill alert-test to prove the alert channel

Use alert-test for phase 5's test send in the alerting plan

Recover from panics in the delivery and sweep loops

Report a worker restart and stop CLI commands interrupting live jobs

Record phase 4 in the alerting plan

Record the production verification of phases 4 and 5 in the alerting plan

Interrupt leftover jobs only in continuous mode

Keep the suppressed alert count when a send fails

Report a mark failure that follows another alert, and name orphaned files

Record the review fixes in the alerting plan