Add collection self-healing benchmark lane

[giaphutran12]

Summary

• add collection-self-heal benchmark adapter that wraps CollectionPopulateRecipeRuntime inside SelfHealingPopulateRecipeService
• require BIGSET_COLLECTION_BENCHMARK_RUNNER_MODULE for real collection benchmark runs, so Mengzhe/Meteor's runner can plug in without hard-coding it here
• extend make verify-self-healing to syntax-check the collection adapter and run both Mastra and collection no-key zero-spend blocked smokes

Verification

• node --check benchmarks/dataset-agent/adapters/collection-self-healing-adapter.mjs
• node --check benchmarks/dataset-agent/adapters/mastra-populate-adapter.mjs
• make verify-self-healing

Notes

This does not claim the collection runner is fully migrated yet. It creates the benchmark lane and self-healing wrapper contract so the collection system can be tested through the same recipe generation, validation, repair, and promotion path once the runner module is wired in.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: ecc705df-f3f6-4c1c-8159-4424fe26c757

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch codex/collection-self-healing-benchmark

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}