Compare responses from GPT-4, Claude, Gemini & Mistral side-by-side. Get the best answer, every time.
AI Arbitrage is a Chrome extension that automatically queries multiple AI models when you ask a question on ChatGPT, Claude, Gemini, or Mistral. It displays all responses side-by-side so you can:
- 🏆 Find the best answer — See which model gives the most comprehensive response
- 🚀 Compare speed — Know which model responds fastest
- 💰 Track costs — See how much each query costs you
- 🎯 Check consensus — See if models agree or contradict each other
- Parallel API Calls — All models are queried simultaneously for speed
- Smart Analysis — Automatic detection of fastest, cheapest, and most detailed response
- Consensus Detection — Highlights when models agree or disagree
- Cost Tracking — Real-time cost calculation per query
- Premium UI — Glassmorphic, dark-mode design
- Keyboard Shortcuts —
Ctrl+Shift+Ato trigger comparison - 100% Local — API keys stored locally, never sent anywhere except official APIs
- Clone or download this repository
- Open Chrome and go to
chrome://extensions/ - Enable Developer mode (toggle in top right)
- Click Load unpacked
- Select the
ai-arbitrage-extensionfolder - Click the extension icon and add your API keys
The extension requires PNG icons. Convert the SVG files:
# Using ImageMagick
convert icons/icon16.svg icons/icon16.png
convert icons/icon48.svg icons/icon48.png
convert icons/icon128.svg icons/icon128.png
# Or use any SVG to PNG converterYou'll need API keys from at least 2 providers for comparison:
| Provider | Get API Key | Cost |
|---|---|---|
| OpenAI | platform.openai.com/api-keys | ~$0.15/1M tokens |
| Anthropic | console.anthropic.com | ~$0.25/1M tokens |
| Google Gemini | aistudio.google.com | Free tier available |
| Mistral | console.mistral.ai | ~$0.20/1M tokens |
- Install the extension and add your API keys
- Go to ChatGPT, Claude, Gemini, or Mistral
- Ask any question — the extension auto-detects your query
- View the comparison panel that appears with all responses
- Copy the best answer or expand any response for full text
| Shortcut | Action |
|---|---|
Ctrl+Shift+A |
Toggle comparison panel |
Esc |
Close panel |
ai-arbitrage-extension/
├── manifest.json # Extension configuration
├── background/
│ └── background.js # Service worker (API calls)
├── content/
│ ├── content.js # Query detection & UI injection
│ └── panel.css # Panel styling
├── popup/
│ ├── popup.html # Settings popup
│ ├── popup.css # Popup styling
│ └── popup.js # Popup logic
└── icons/
├── icon16.svg/png
├── icon48.svg/png
└── icon128.svg/png
- API keys are stored locally in Chrome's secure storage
- Keys are only sent to official API endpoints (OpenAI, Anthropic, Google, Mistral)
- No analytics or tracking — completely offline except for API calls
- Open source — audit the code yourself
- Support for more providers (Cohere, Together AI, Groq)
- Response history & analytics
- Custom model selection
- Export comparisons to Markdown/PDF
- Firefox support
Soham Dahivalkar
MIT License — feel free to use, modify, and distribute.
⚡ Stop guessing. Start comparing.