NeuroOps is an autonomous AI SRE engine that detects, diagnoses, and remediates Kubernetes incidents end-to-end β with zero human intervention for high-confidence scenarios.
| Metric | Result |
|---|---|
| π― Chaos Incidents Resolved | 15 / 15 β 100% |
| β‘ Average MTTR | < 4 minutes |
| π DORA Tier | Elite Performer |
| πͺ False Positive Rate | 0% |
| π° Cost vs Manual On-Call | > 1,600Γ cheaper |
| π€ Autonomous Resolution Rate | 50β100% (confidence-gated) |
flowchart TD
A([π₯ Fault Injected]) --> B
subgraph DETECT["π DETECT"]
B[Prometheus Scrapes\nGolden Signals] --> C[Isolation Forest\nAnomaly Scoring]
C --> D{Anomaly?}
D -- No --> B
D -- Yes --> E[Alert Dedup\n+ Severity Triage]
end
E --> F
subgraph DIAGNOSE["𧬠DIAGNOSE β LangGraph Fan-Out"]
F[Supervisor Init\nIncident ID + OTel Trace] --> G1 & G2 & G3 & G4
G1[π Detective\nMetric Correlation]
G2[πΊοΈ Topologist\nTrace Analysis]
G3[π Historian\nDeploy Timeline]
G4[π Log Analyser\nPod Logs]
G1 & G2 & G3 & G4 --> H[π§ Supervisor\nRoot Cause + Confidence]
end
H -- "< 0.55" --> I[π€ Escalate\nto Human]
H -- ">= 0.65" --> J
subgraph REMEDIATE["π§ REMEDIATE"]
J{Action?} -- "restart / scale" --> K[β‘ Auto-Execute]
J -- "rollback / PR" --> L[π Slack Approval\nThen Execute]
K & L --> M[β
Verify Resolution]
end
M --> N[π Post-Mortem\nStored]
style DETECT fill:#1a1a2e,stroke:#00D9FF,color:#fff
style DIAGNOSE fill:#1a1a2e,stroke:#FF6B35,color:#fff
style REMEDIATE fill:#1a1a2e,stroke:#00C853,color:#fff
graph TB
subgraph UI["π Web UI :3000"]
WEB[Orbital Command Hub\nReal-time Dashboard]
end
subgraph CORE["βοΈ Core Services"]
DET["π Detector :8001"]
AGT["π§ Agent :8002"]
REM["π§ Remediator :8003"]
end
subgraph OBS["π‘ Observability"]
PROM[Prometheus]
JAEGER[Jaeger]
GRAFANA[Grafana]
OTEL[OTel Collector]
end
subgraph K8S["βΈοΈ Kubernetes"]
WORKLOADS[Target Workloads]
CHAOS[LitmusChaos]
end
WEB --> AGT & DET
DET --> PROM & OTEL
AGT --> PROM & JAEGER & OTEL
REM --> WORKLOADS & OTEL
CHAOS --> WORKLOADS
WORKLOADS --> PROM
OTEL --> JAEGER
PROM & JAEGER --> GRAFANA
style UI fill:#0d1117,stroke:#00D9FF,color:#00D9FF
style CORE fill:#0d1117,stroke:#FF6B35,color:#FF6B35
style OBS fill:#0d1117,stroke:#7C3AED,color:#7C3AED
style K8S fill:#0d1117,stroke:#326CE5,color:#326CE5
Prerequisites: Python 3.11+, Docker, Kubernetes cluster (Minikube / kind / EKS)
git clone https://github.com/Tayab-Ahamed/neuroops.git
cd neuroops
cp .env.example .env # fill in your API keysdocker compose up --buildServices: :8001 Detector Β· :8002 Agent Β· :8003 Remediator
Open web-ui/index.html for the live dashboard.
# Detector
cd detector && pip install -r requirements.txt && uvicorn server:app --port 8001
# Agent
cd agent && pip install -r requirements.txt && uvicorn main:app --port 8002
# Remediator
cd remediator && pip install -r requirements.txt && uvicorn server:app --port 8003# LLM
ANTHROPIC_API_KEY=sk-ant-... # Required β RCA agents
OPENAI_API_KEY=sk-... # Optional fallback
# Observability
PROMETHEUS_URL=http://localhost:9090
JAEGER_QUERY_URL=http://localhost:16686
OTEL_COLLECTOR_ENDPOINT=http://localhost:4317
# Kubernetes
KUBECONFIG=~/.kube/config
TARGET_NAMESPACE=neuroops-demo
# GitHub
GITHUB_TOKEN=ghp_... # Historian agent + PR actions
GITHUB_REPO=your-username/repo
# Tuning
CONFIDENCE_THRESHOLD=0.65 # Below β human escalation
AUTONOMOUS_CONFIDENCE_THRESHOLD=0.65 # Actions above this run autonomously
ANOMALY_CONTAMINATION=0.05
# ChatOps
SLACK_WEBHOOK_URL=https://hooks.slack.com/... # Optional| Method | Endpoint | Description |
|---|---|---|
GET |
/health |
Health + anomaly model status |
GET |
/alerts |
Active alerts |
GET |
/metrics |
Prometheus scrape endpoint |
POST |
/baseline/train |
Trigger baseline training |
| Method | Endpoint | Description |
|---|---|---|
POST |
/investigate |
Trigger RCA for an alert |
GET |
/incidents |
All persisted incidents |
GET |
/incidents/{id} |
Single incident + full RCA trace |
GET |
/incidents/{id}/similar |
Top-K similar incidents (RAG) |
GET |
/analytics/mttr |
p50/p95/p99 MTTR per service |
GET |
/analytics/sla |
SLA breach + autonomous resolution rate |
GET |
/analytics/cost |
LLM token + USD cost tracking |
| Method | Endpoint | Description |
|---|---|---|
POST |
/remediate |
Execute remediation action |
GET |
/health |
Health + action count |
GET |
/metrics |
Prometheus scrape endpoint |
neuroops/
βββ detector/ # Anomaly detection β Isolation Forest + Ridge Regression
βββ agent/ # LangGraph RCA β Detective, Topologist, Historian, Supervisor
βββ remediator/ # Actions β restart, rollback, scale, patch, PR + approval gate
βββ observability/ # OTel collector config, Grafana dashboards, CLI replay tool
βββ benchmarks/ # Chaos benchmark runner + report generator
βββ web-ui/ # Orbital Command Hub (real-time HTML dashboard)
βββ cluster/ # Kubernetes manifests + LitmusChaos experiments
βββ docker-compose.yml
βββ Makefile
βββ pyproject.toml
MIT β see LICENSE
Built by Tayab Ahamed