Skip to content

BipulRaman/UI-Test-Agent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 

Repository files navigation

UI Test Agent

An AI-powered, browser-driven QA specialist for GitHub Copilot Chat in VS Code. Turns plain English into evidence-backed QA reports across desktop, tablet, and mobile — by driving a real browser end to end. No test code. No DSL. No config files.

Marketplace Installs License: MIT

Heads up: the agent runs on top of GitHub Copilot Chat in Agent Mode, so an active GitHub Copilot subscription (Individual, Business, Enterprise, or Free trial) with Copilot Chat installed and signed in is required.


Repository layout

Folder Contents
extension/ The published VS Code extension source (ui-test-agent).
web/ The project landing site — static HTML/CSS/JS, deployable to GitHub Pages, Azure Static Web Apps, Netlify, etc.

What it does

Installing the extension does three things automatically:

  1. Installs the UI Test agent (ui-test.agent.md) into your VS Code prompts folder.
  2. Installs 8 named prompt entry points/ui-test-smoke, /ui-test-a11y, /ui-test-perf, /ui-test-console, /ui-test-links, /ui-test-responsive, /ui-test-scaffold, /ui-test-run — so any workflow can be launched from Copilot Chat.
  3. Wires up a built-in browser engine so the agent can drive a real browser to perform the checks. Auto-configured — no manual setup, no config files to edit.

No test code, no DSL, no manual configuration.


Quick start

  1. Install the extension from the VS Code Marketplace.
  2. Make sure you're signed in to GitHub Copilot in VS Code.
  3. Open GitHub Copilot Chat and switch to Agent Mode.
  4. Try one of these:
@UI Test  Test https://example.com on desktop, mobile, tablet
/ui-test-smoke   url=https://example.com
/ui-test-a11y    url=https://example.com
/ui-test-perf    url=https://example.com  device=mobile
/ui-test-scaffold

The agent narrates its scope, drives Chrome, and replies with a Markdown report. When you scaffold a project, it writes a committable ./.ui-tests/ folder with starter cases and a reports/ output directory.


Eight workflows, one agent

Prompt What it verifies
/ui-test-smoke Page load, title, no console errors, no 5xx
/ui-test-console Runtime console + network health
/ui-test-a11y Lighthouse accessibility (WCAG / axe)
/ui-test-perf Lighthouse performance + Core Web Vitals
/ui-test-links Same-origin link health / shallow crawl
/ui-test-responsive Overflow + touch-target audit across breakpoints
/ui-test-scaffold Bootstrap a starter .ui-tests/ suite
/ui-test-run Bulk-run a folder of *.ui-test.md cases

All workflows can fan out across the standard device matrix (desktop · desktopHD · tablet · tabletLand · mobile · mobileSm) with optional network/CPU throttling.


Requirements

  • Active GitHub Copilot subscription (Individual, Business, Enterprise, or Free trial) with Copilot Chat enabled and signed in. The agent runs on top of Copilot Chat in Agent Mode — without an active subscription it cannot run.
  • VS Code 1.101+ with the GitHub Copilot Chat extension installed.
  • Node.js on PATH.
  • Google Chrome / Chromium / Edge installed locally (auto-detected).

Develop the extension

cd extension
npm install
npm run compile
# Press F5 in VS Code to launch the Extension Development Host

Package locally:

cd extension
npm run package        # produces ui-test-agent-<version>.vsix

See extension/PUBLISHING.md for the full Marketplace publish flow and extension/CHANGELOG.md for release history.


Run the website locally

The site in web/ is plain HTML/CSS/JS — no build step, no dependencies.

cd web
# any static server works, e.g.:
npx serve .
# or:
python -m http.server 8080

Then open http://localhost:8080 (or whatever port the server prints).

See web/README.md for deployment recipes (GitHub Pages, Azure Static Web Apps, Netlify).


Safety guarantees

The bundled agent is read-only on application source code. Its editFiles capability is whitelisted to test/report folders only — it can scaffold and write reports, but never modifies the product it tests. Crawls are capped at 25 pages by default. Real credentials and destructive actions are refused unless explicitly authorized.


License

MIT — see extension/LICENSE.

About

VS Code extension that adds a plain-English browser-QA agent to GitHub Copilot Chat. Drives a real Chrome via the Chrome DevTools MCP to run smoke, accessibility, performance, console, link, and responsive checks across desktop, tablet, and mobile — every run produces an evidence-backed Markdown report. No test code, no config

Topics

Resources

Stars

Watchers

Forks

Contributors