Skip to content

Commit e28bedd

Browse files
committed
docs: align blog post and submission with current architecture
- Add A2A protocol to architecture diagrams (both docs) - Fix model list: Claude/DeepSeek/Gemini (not GPT-4o) - Fix Try It: GEMINI_API_KEY + DASHSCOPE_API_KEY - Add hosted links: evidra.cc, lab.evidra.cc
1 parent bde7265 commit e28bedd

2 files changed

Lines changed: 22 additions & 15 deletions

File tree

docs/hackathon/blog-post.md

Lines changed: 15 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -84,7 +84,9 @@ to see to improve it.
8484
## How It Works
8585

8686
```
87-
kagent / bench-cli agent loop
87+
bench-cli (orchestrator)
88+
↓ A2A message/send
89+
kagent (Google ADK agent loop)
8890
↓ MCP tool calls
8991
AgentGateway (auth, rate limits, access policies)
9092
↓ routes to backend
@@ -98,11 +100,12 @@ postgres (evidence chain, bench runs, scorecards)
98100
The flow:
99101

100102
1. Select scenarios and model from the bench UI
101-
2. bench-cli provisions a namespace, injects the failure, runs the agent
102-
3. Agent calls tools through AgentGateway → evidra-mcp → kubectl
103-
4. Every mutation is automatically recorded as signed evidence
104-
5. Evidra detects behavioral patterns in real-time
105-
6. Results appear in the leaderboard with pass rate, cost, and reliability score
103+
2. bench-cli provisions a namespace, injects the failure
104+
3. bench-cli delegates to kagent via A2A protocol (`execution_mode: "a2a"`)
105+
4. kagent calls tools through AgentGateway → evidra-mcp → kubectl
106+
5. Every mutation is automatically recorded as signed evidence
107+
6. bench-cli verifies the fix, submits the result
108+
7. Results appear in the leaderboard with pass rate, cost, and reliability score
106109

107110
### What Evidra adds to AgentGateway
108111

@@ -137,9 +140,9 @@ handles well and which need work.
137140
model upgrades, or ADK updates. Compare before/after to prove
138141
improvements and catch regressions.
139142

140-
**Model comparison.** Run the same scenarios across DeepSeek, GPT-4o,
141-
Claude, Gemini. The leaderboard shows which model is most reliable,
142-
cheapest per pass, and fastest — specifically for kagent's use case.
143+
**Model comparison.** Run the same scenarios across Claude, DeepSeek,
144+
Gemini. The leaderboard shows which model is most reliable, cheapest
145+
per pass, and fastest — specifically for kagent's use case.
143146

144147
## Five Demo Scenarios
145148

@@ -209,7 +212,7 @@ cd evidra-kagent-bench
209212

210213
# Configure LLM provider
211214
cp .env.example .env
212-
# Edit .env — set DEEPSEEK_API_KEY (or another provider key)
215+
# Edit .env — set GEMINI_API_KEY (for kagent) + DASHSCOPE_API_KEY (for bench-cli)
213216

214217
# Create k3d cluster (one-time)
215218
docker compose run --rm k3d-setup
@@ -235,7 +238,8 @@ open http://localhost:28080/lab
235238
## Links
236239

237240
- **Benchmark harness:** [evidra-kagent-bench](https://github.com/vitas/evidra-kagent-bench)
238-
- **Evidra core:** [evidra](https://github.com/vitas/evidra)
241+
- **Evidra core:** [evidra](https://github.com/vitas/evidra) · [evidra.cc](https://evidra.cc)
242+
- **Bench Lab (hosted):** [lab.evidra.cc](https://lab.evidra.cc)
239243
- **ADK bug fix:** [google/adk-python#4985](https://github.com/google/adk-python/pull/4985)
240244
- **AgentGateway:** [agentgateway.dev](https://agentgateway.dev)
241245
- **kagent:** [kagent-dev/kagent](https://github.com/kagent-dev/kagent)

docs/hackathon/submission.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,8 @@ signal-by-signal.
5555
## Architecture
5656

5757
```
58+
bench-cli (scenario orchestrator)
59+
↓ A2A message/send
5860
kagent (Google ADK + LLM)
5961
↓ MCP tool calls
6062
AgentGateway (auth, TLS, rate limits, access policies, sessions)
@@ -106,7 +108,7 @@ The benchmark suite gives kagent developers actionable data:
106108
- **Pass/fail on 75 scenarios** — which failures can kagent handle?
107109
- **Behavioral signals per run** — retry loops, scope creep, risk escalation
108110
- **Reliability score** — quantitative trust metric, not guesswork
109-
- **Model comparison**DeepSeek vs GPT-4o vs Claude on the same scenarios
111+
- **Model comparison**Claude vs DeepSeek vs Gemini on the same scenarios
110112
- **Regression detection** — run after prompt changes, prove improvement
111113

112114
## The Benchmark: 75 Infrastructure Scenarios
@@ -206,7 +208,7 @@ Any audit consumer can ingest it. Evidra adds the intelligence.
206208
```bash
207209
git clone https://github.com/vitas/evidra-kagent-bench
208210
cd evidra-kagent-bench
209-
cp .env.example .env # set DEEPSEEK_API_KEY or another provider key
211+
cp .env.example .env # set GEMINI_API_KEY + DASHSCOPE_API_KEY
210212
docker compose run --rm k3d-setup
211213
docker compose up -d
212214
open http://localhost:28080/lab
@@ -223,9 +225,10 @@ open http://localhost:28080/lab
223225
| All Runs | [/lab/bench/runs](http://localhost:28080/lab/bench/runs) | Drill into individual run details |
224226
| Scenarios | [/lab/bench/scenarios](http://localhost:28080/lab/bench/scenarios) | 75 scenario catalog |
225227

226-
## Repositories
228+
## Links
227229

228230
- **Benchmark harness:** https://github.com/vitas/evidra-kagent-bench
229-
- **Evidra core:** https://github.com/vitas/evidra
231+
- **Evidra core:** https://github.com/vitas/evidra · [evidra.cc](https://evidra.cc)
232+
- **Bench Lab (hosted):** [lab.evidra.cc](https://lab.evidra.cc)
230233
- **ADK fix PR:** https://github.com/google/adk-python/pull/4985
231234
- **kagent issue:** https://github.com/kagent-dev/kagent/issues/1532

0 commit comments

Comments
 (0)