@@ -84,7 +84,9 @@ to see to improve it.
8484## How It Works
8585
8686```
87- kagent / bench-cli agent loop
87+ bench-cli (orchestrator)
88+ ↓ A2A message/send
89+ kagent (Google ADK agent loop)
8890 ↓ MCP tool calls
8991AgentGateway (auth, rate limits, access policies)
9092 ↓ routes to backend
@@ -98,11 +100,12 @@ postgres (evidence chain, bench runs, scorecards)
98100The flow:
99101
1001021 . Select scenarios and model from the bench UI
101- 2 . bench-cli provisions a namespace, injects the failure, runs the agent
102- 3 . Agent calls tools through AgentGateway → evidra-mcp → kubectl
103- 4 . Every mutation is automatically recorded as signed evidence
104- 5 . Evidra detects behavioral patterns in real-time
105- 6 . Results appear in the leaderboard with pass rate, cost, and reliability score
103+ 2 . bench-cli provisions a namespace, injects the failure
104+ 3 . bench-cli delegates to kagent via A2A protocol (` execution_mode: "a2a" ` )
105+ 4 . kagent calls tools through AgentGateway → evidra-mcp → kubectl
106+ 5 . Every mutation is automatically recorded as signed evidence
107+ 6 . bench-cli verifies the fix, submits the result
108+ 7 . Results appear in the leaderboard with pass rate, cost, and reliability score
106109
107110### What Evidra adds to AgentGateway
108111
@@ -137,9 +140,9 @@ handles well and which need work.
137140model upgrades, or ADK updates. Compare before/after to prove
138141improvements and catch regressions.
139142
140- ** Model comparison.** Run the same scenarios across DeepSeek, GPT-4o ,
141- Claude, Gemini. The leaderboard shows which model is most reliable,
142- cheapest per pass, and fastest — specifically for kagent's use case.
143+ ** Model comparison.** Run the same scenarios across Claude, DeepSeek ,
144+ Gemini. The leaderboard shows which model is most reliable, cheapest
145+ per pass, and fastest — specifically for kagent's use case.
143146
144147## Five Demo Scenarios
145148
@@ -209,7 +212,7 @@ cd evidra-kagent-bench
209212
210213# Configure LLM provider
211214cp .env.example .env
212- # Edit .env — set DEEPSEEK_API_KEY (or another provider key )
215+ # Edit .env — set GEMINI_API_KEY (for kagent) + DASHSCOPE_API_KEY (for bench-cli )
213216
214217# Create k3d cluster (one-time)
215218docker compose run --rm k3d-setup
@@ -235,7 +238,8 @@ open http://localhost:28080/lab
235238## Links
236239
237240- ** Benchmark harness:** [ evidra-kagent-bench] ( https://github.com/vitas/evidra-kagent-bench )
238- - ** Evidra core:** [ evidra] ( https://github.com/vitas/evidra )
241+ - ** Evidra core:** [ evidra] ( https://github.com/vitas/evidra ) · [ evidra.cc] ( https://evidra.cc )
242+ - ** Bench Lab (hosted):** [ lab.evidra.cc] ( https://lab.evidra.cc )
239243- ** ADK bug fix:** [ google/adk-python #4985 ] ( https://github.com/google/adk-python/pull/4985 )
240244- ** AgentGateway:** [ agentgateway.dev] ( https://agentgateway.dev )
241245- ** kagent:** [ kagent-dev/kagent] ( https://github.com/kagent-dev/kagent )
0 commit comments