Add GitHub Action for Vercel preview deployment e2e testing

[devin-ai-integration]

Resolves #445

This PR adds a GitHub Action workflow that waits for Vercel preview deployments to complete and then runs e2e tests against the preview URL. The workflow:

1. Triggers on successful deployment_status events for preview environments
2. Sets up Node.js and pnpm
3. Installs Playwright dependencies
4. Runs e2e tests against the Vercel preview URL

Also adds a new e2e test file that tests:

• Base path (home page)
• API endpoints
• Website paths

Link to Devin run: https://app.devin.ai/sessions/fc3bf7f6915448d39a00af6ba6368f1b
Requested by: Nathan Clevenger ([email protected])

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
ai	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Mar 31, 2025 9:49pm

[devin-ai-integration]

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

• Address comments on this PR. Add "(aside)" to your comment to have me ignore it.
• Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

• Disable automatic comment and CI monitoring

[nathanclevenger]

we should add e2e tests for APIs that just use fetch

Also, there is a new secret in Github Actions for VERCEL_AUTOMATION_BYPASS_SECRET ... you can bypass vercel protection by adding that to a header called x-vercel-protection-bypass

for playwright, we can:

const config: PlaywrightTestConfig = {
  use: {
    extraHTTPHeaders: {
      'x-vercel-protection-bypass': process.env.VERCEL_AUTOMATION_BYPASS_SECRET,
      'x-vercel-set-bypass-cookie': true | 'samesitenone' (optional)
    }
  }
}

finally, let's shorten the action name to Vercel E2E Tests

[nathanclevenger]

You should also add / and /api

[nathanclevenger]

should you pull latest from main on this branch? a lot has changed on main

[devin-ai-integration]

Closing due to inactivity for more than 7 days.