Skip to content

Surface collection capability diagnostics#46

Draft
giaphutran12 wants to merge 1 commit into
codex/collection-source-qualityfrom
codex/collection-capability-diagnostics
Draft

Surface collection capability diagnostics#46
giaphutran12 wants to merge 1 commit into
codex/collection-source-qualityfrom
codex/collection-capability-diagnostics

Conversation

@giaphutran12
Copy link
Copy Markdown
Collaborator

Summary

  • Surface no-Agent browser/form/detail follow-up as a safe capability diagnostic from collection source outcomes.
  • Persist disabled-Agent deferrals with a reason in the vendored source report.
  • Update benchmark failure text and infra detection so normal docs text like API key setup does not become an infra blocker.

Verification

  • npm --prefix backend test (66/66)
  • npm --prefix backend run build
  • node --test benchmarks/dataset-agent/run-benchmark.test.mjs
  • node --check benchmarks/dataset-agent/run-benchmark.mjs
  • make verify-self-healing
  • Real no-Agent benchmark: mcp-docs-pages produced 3 rows and failed honestly with the capability diagnostic instead of infra-blocked; cost /bin/zsh.007287.

No auto-merge.

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 22, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: e81ae0c7-e5cf-4f33-89e8-9df2313ffda8

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/collection-capability-diagnostics

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant