Skip to content

Improve collection source coherence#48

Draft
giaphutran12 wants to merge 1 commit into
codex/collection-stack-handofffrom
codex/collection-source-coherence
Draft

Improve collection source coherence#48
giaphutran12 wants to merge 1 commit into
codex/collection-stack-handofffrom
codex/collection-source-coherence

Conversation

@giaphutran12
Copy link
Copy Markdown
Collaborator

Summary

  • keep URL-like row cells in source_urls instead of only page/evidence URLs
  • prefer official docs URLs over blogs/courses/directories during duplicate merge
  • drop conflicting evidence and rows that do not match the prompt's named entity source policy
  • update the MCP docs benchmark answer key for Anthropic's current official platform.claude.com docs host

Verification

  • npm --prefix backend test (74/74)
  • npm --prefix backend run build
  • make verify-self-healing
  • node --check benchmarks/dataset-agent/run-benchmark.mjs
  • git diff --check
  • real Agent canary: mcp-docs-pages via collection-self-heal passed 1/1, 3 rows, factual 1.0, entity coverage 1.0, domain accuracy 1.0, claim support 1.0, cost $0.021924

Notes

No auto-merge. This stacks on codex/collection-stack-handoff so Meteor's migration branch can keep moving independently.

@giaphutran12 giaphutran12 self-assigned this May 22, 2026
@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 22, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: e6952be7-d2e4-4c52-b3ba-b9c59a1ecb9b

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/collection-source-coherence

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant