Case 14 · AIOps Triple-Source Root-Cause Analysis · 400+ Microservices · MTTR 45min → 12min · Alert Fatigue Halved¶
TL;DR: AIOps Triple-Source Root-Cause Analysis · 400+ Microservices · MTTR 45min → 12min · Alert Fatigue Halved. Direction: AI + DevOps. Scale: 400+ microservices, 5000+ alerts/day. Hard KPI: MTTR 45min → 12min, alert fatigue halved. Tech: OpenTelemetry + ClickHouse + LLM correlation, SRE feedback loop. My role: data flow architecture, LLM correlation engineering, SRE integration. Client name anonymized under NDA.
- Direction: AI + DevOps
- Industry: fintech
- Scale: 400+ microservices, 5000+ alerts/day
- Hard KPI: MTTR 45min → 12min, alert fatigue halved
Problem¶
Fintech with 400+ microservices, 5000+ alerts/day, root cause depends on senior SREs manually correlating logs / metrics / traces.
Solution¶
Real-time logs + metrics + traces time-aligned across three sources, LLM produces root-cause hypotheses + correlation analysis, outputs Top-3 candidates.
Tech Stack¶
OpenTelemetry + ClickHouse + LLM correlation, SRE feedback loop
Result (Hard KPIs)¶
MTTR 45min → 12min, alert fatigue halved
My Role¶
data flow architecture, LLM correlation engineering, SRE integration
Related¶
Next: Download PDF · 30-min alignment
Client name anonymized · KPIs verified · Real client name disclosable under NDA.