Skip to content

Add AI Visibility Monitor to Tools & Software / Open Source Data / Evals#35

Open
WorkSmartAI-alt wants to merge 1 commit into
amplifying-ai:mainfrom
WorkSmartAI-alt:add-ai-visibility-monitor
Open

Add AI Visibility Monitor to Tools & Software / Open Source Data / Evals#35
WorkSmartAI-alt wants to merge 1 commit into
amplifying-ai:mainfrom
WorkSmartAI-alt:add-ai-visibility-monitor

Conversation

@WorkSmartAI-alt
Copy link
Copy Markdown

Adding AI Visibility Monitor, an open-source Python toolkit for tracking ChatGPT, Claude, and Perplexity citations of a given domain.

Why this fits the Open Source Data / Evals subsection specifically:

  • It is open-source (MIT licensed) and self-hosted, matching the spirit of the existing entries (AI Product Bench, GEO/AEO Tracker)
  • It runs locally on your own credentials with no SaaS dependency
  • It targets the specific GEO outcome of measuring citation rate by AI engine over time

Repo: https://github.com/WorkSmartAI-alt/ai-visibility-monitor
License: MIT
Status: Active development, currently used in production for tracking work-smart.ai and a small number of client domains.

Inserted alphabetically between AI Product Bench and GEO/AEO Tracker. Happy to move the entry if a different section is a better fit.

@WorkSmartAI-alt
Copy link
Copy Markdown
Author

Update for the maintainers since this PR has been open for a few days.

The repo shipped v0.2.1 since this PR was opened. Three additions relevant to the open-source / evals / GEO category:

  • Multi-engine support: queries Claude + ChatGPT + Perplexity in one run, then unions citations across engines. Useful for evals work where engine variance is the signal.
  • Haiku 4.5 default model: weekly cost is now ~$0.30 per run for 5 queries, ~$0.94 for 14. 10x cheaper than the previous Sonnet default. Reproducibility cost matters for eval work.
  • New commands: --expand (adjacent query discovery, ranks expansion queries by winnability), --surfaces (auto-categorizes cited URLs by type), avm trend (trajectory across historical runs).

Backward compatible. Sample data set ships with the repo for testing.

Repo: https://github.com/WorkSmartAI-alt/ai-visibility-monitor

If the README entry in this PR needs an update to reflect v0.2.1, happy to revise. Otherwise the existing description should still hold.

Thanks for considering.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant