Improve collection source targeting

[giaphutran12]

Summary

• Add prompt-derived official source policy for named-entity collection prompts.
• Prepend official/canonical source queries from prompt semantics, not benchmark answer keys.
• Prefer entity-owned domains in source ranking/triage, follow high-value official links, and avoid extracting generic hosted/third-party pages as proof.
• Add tests covering source policy query generation, durable recipe noise handling, third-party downgrades, and official candidate boosting.

Verification

• npm --prefix backend test -- test/collection-source-policy.test.ts
• npm --prefix backend run build
• make verify-self-healing
• Real focused benchmark: benchmark-results/collection-source-quality-4prompt-20260522-pr45d/summary.json
  • 2/4 passed: latest-ai-blog-posts, saas-pricing-pages
  • 2/4 failed: earnings-release-pages misses Apple; mcp-docs-pages has all entities but domain gate 0.667
  • Cost: /bin/zsh.024046, Agent/browser: 0

Notes

• This intentionally does not inject benchmark answer-key entities/domains into runtime behavior.
• Remaining quality gap is source discovery for exact official detail pages, especially Apple earnings and Anthropic docs.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 992bfe6f-e3f5-47be-958a-9ccaa0c1f3c0

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch codex/collection-source-quality

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}