Skip to content

feat(aeo): optimize site for AI agents and answer engines#41

Open
soumendrak wants to merge 1 commit into
mainfrom
aeo-llms-txt-agent-optimization
Open

feat(aeo): optimize site for AI agents and answer engines#41
soumendrak wants to merge 1 commit into
mainfrom
aeo-llms-txt-agent-optimization

Conversation

@soumendrak

Copy link
Copy Markdown
Member

Optimizes the site for LLMs and answer engines (AEO) so agents can understand it without rendering the React SPA: adds llms.txt/llms-full.txt, expands robots.txt to welcome AI crawlers, and grows the sitemap to every route. Embeds static Organization + WebSite JSON-LD plus a <noscript> fallback in index.html for non-JS crawlers. Extends usePageMeta to inject per-route structured data — BreadcrumbList everywhere and Event schema with ISO 8601 dates on conference pages. Adds a designed FAQ section on the homepage whose FAQPage schema is generated from the same visible content (single source, injected only where the FAQ renders). Verified in-browser across home, conference, initiative, and about routes with valid JSON-LD and no console errors.

🤖 Generated with Claude Code

Add agent/AEO discovery and structured data so LLMs and answer engines
can understand the site without rendering the SPA:

- llms.txt and llms-full.txt with site overview, sections, and FAQ
- robots.txt welcomes AI crawlers (GPTBot, ClaudeBot, PerplexityBot, …)
  and references the llms.txt files; sitemap expanded to all routes
- Static Organization + WebSite JSON-LD and a <noscript> fallback in
  index.html so non-JS crawlers see real content
- usePageMeta extended to inject per-route JSON-LD + keywords; adds
  BreadcrumbList everywhere and Event schema (ISO 8601 dates) on
  conference pages
- FAQPage schema generated from the visible homepage FAQ (single
  source, schema only where the FAQ is rendered)

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@soumendrak soumendrak requested a review from a team as a code owner June 2, 2026 14:49
@cloudflare-workers-and-pages

Copy link
Copy Markdown

Deploying website with  Cloudflare Pages  Cloudflare Pages

Latest commit: 4b1692b
Status: ✅  Deploy successful!
Preview URL: https://180e1851.website-3m7.pages.dev
Branch Preview URL: https://aeo-llms-txt-agent-optimizat.website-3m7.pages.dev

View logs

@soumendrak soumendrak requested a review from PrinceX04 June 2, 2026 14:51
@soumendrak soumendrak self-assigned this Jun 2, 2026
@soumendrak soumendrak added the enhancement New feature or request label Jun 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant