Gate rejected self-healing benchmark candidates

[giaphutran12]

Summary

• fail benchmark lanes when self-healing emits candidate_rejected, even if diagnostic rows score well
• apply the same gate to rescore so old canary artifacts with diagnostics can be re-evaluated
• document that rejected candidates are debug output, not promotable cron recipes

Evidence

• node --test benchmarks/dataset-agent/run-benchmark.test.mjs
• node --import ./backend/node_modules/tsx/dist/esm/index.mjs --test backend/test/tinyfish-agent-run.test.ts backend/test/collection-browser-actions.test.ts backend/test/collection-agent-runner.test.ts benchmarks/dataset-agent/run-benchmark.test.mjs
• node --check benchmarks/dataset-agent/run-benchmark.mjs
• node --check benchmarks/dataset-agent/adapters/self-healing-output.mjs
• node --check benchmarks/dataset-agent/adapters/collection-self-healing-adapter.mjs
• git diff --check HEAD
• npm --prefix backend test
• npm --prefix backend run build
• make verify-self-healing
• Rescored PR Surface Agent run provenance diagnostics #59 canary artifact: status: failed, failureCategory: capability_gate, reason: self-healing candidate rejected

Notes

• Infra blockers still win over capability gates.
• Rescore can only apply this to artifacts that already contain diagnostics.selfHealingAction.
• No auto-merge.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 2e3ecb65-0014-41b5-9df2-d1b24c583d2f

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch codex/benchmark-self-healing-action-gate

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}