Debug, regression-test, and safely share TypeScript AI-agent behavior—locally.
No account · no default upload · metadata-only by default · optional customer-owned Studio
AgentInspect turns agent runs into customer-owned evidence: execution trees, deterministic contracts, CI gates, verified-safe bundles, and optional self-hosted review.
npm install agent-inspect| Workflow | What you do |
|---|---|
| Debug one run | Capture/import → tree / timeline / report → first causal failure |
| Prevent one regression | TraceContract / check → suite / cohort → CI gate |
| Share one safe artifact | Redact → verify-safe → offline bundle → optional Studio review |
Review as a team (optional): workspace + optional SQLite index → customer-owned Studio Beta (no AgentInspect-hosted cloud).
Commands below match the packed quickstart. Replace <run-id> with a value from list.
npm install agent-inspect
npx agent-inspect init --yes
node examples/agent-inspect-demo.mjs
npx agent-inspect list --dir .agent-inspect# After copying a run id from list:
npx agent-inspect view <run-id> --dir .agent-inspect
npx agent-inspect report <run-id> --dir .agent-inspect
npx agent-inspect check <run-id> --dir .agent-inspect
npx agent-inspect bundle <run-id> --dir .agent-inspect --profile share
npx agent-inspect verify-safe <run-id> --dir .agent-inspectinit scaffolds config and a demo script; the demo writes the trace. Guide: First trace in 5 minutes · repo · Golden path
| Path | Use when | Start |
|---|---|---|
| Manual / observe | Custom nesting or object methods | Getting started |
| AI SDK | Vercel AI SDK generateText / streamText |
@agent-inspect/ai-sdk |
| OpenAI Agents | OpenAI Agents JS | @agent-inspect/openai-agents |
| LangChain | Callbacks / LangGraph-via-LangChain | @agent-inspect/langchain |
| Structured logs | Logs already emitted | Log-to-tree |
| Harness | Fixture runner for real projects | @agent-inspect/harness |
| CI reporters | Failed-test artifacts | vitest · jest |
| Standards files | OpenInference / OTLP JSON | Standards |
Blessed starters (no API keys): examples/starters
Understand — what / view / tree · timeline · report · diff · sessions / activity
Prevent regressions — deterministic checks · typed TraceContract (Beta) · suites · cohorts · CI gates · Vitest/Jest reporters (artifact reporters today; TraceContract matchers not shipped)
Share safely — redaction profiles · scan · verify-safe · offline bundles · CI artifacts
Scale locally — workspace · optional SQLite index (Beta) · observed outcomes · viewer / TUI / VS Code
Review as a team — customer-owned Studio Beta · explicit file / GitHub / HTTP ingest (disabled by default) · no maintainer cloud
Interoperate — read-only MCP server (Preview) · OpenInference-compatible / OTLP GenAI-aligned mapping with known-loss reporting
Support labels: SUPPORT-LEVELS.md · Network: NETWORK-BEHAVIOR.md
| Scenario | Start |
|---|---|
| Wrong tool call | broken-agent starter |
| CI trajectory gate | CI artifacts |
| Safe incident handoff | Safe sharing |
| Multi-agent / session retry | Sessions & outcomes |
| Customer-owned team review | Self-hosting · Studio |
| Design partner trial | Pilot kit |
- Traces are local JSONL under
.agent-inspect/(orAGENT_INSPECT_TRACE_DIR) - Metadata-only by default — no raw prompts/outputs unless you opt in
- No hidden upload — core does not send traces to AgentInspect
- Customer-owned Studio ingestion is disabled by default and explicit when enabled
- MCP server exposes configured local evidence to the connected client (Preview)
- Standards export only when you run/configure it
- Redaction is best-effort, not certification — review before posting
- Not a chain-of-thought recorder
Details: Safe sharing · Network behavior · Security
Current release: 6.7.3 (eighteen linked npm packages). Technical launch candidate; external pilot evidence pending. Persisted schema 1.0. Node.js ≥ 20. v7 not scheduled.
Roadmap · Pilot kit · Changelog
- Hosted SaaS or maintainer-hosted dashboard
- Production APM replacement
- Eval dataset platform or LLM-as-judge by default
- Prompt registry, pricing engine, or replay engine
- Universal standards exporter or completed external adoption proof
See Compare.
Package family (18 public packages)
| Package | Purpose |
|---|---|
agent-inspect |
Core APIs + CLI |
@agent-inspect/ai-sdk |
AI SDK telemetry |
@agent-inspect/openai-agents |
OpenAI Agents processor |
@agent-inspect/langchain |
LangChain callbacks |
| Package | Purpose |
|---|---|
@agent-inspect/harness |
Fixture runner |
@agent-inspect/eval |
Local eval heuristics |
@agent-inspect/vitest |
Vitest reporter |
@agent-inspect/jest |
Jest reporter |
| Package | Purpose |
|---|---|
@agent-inspect/redact |
Deterministic redaction |
@agent-inspect/guardrails |
Deterministic guardrail rules |
@agent-inspect/circuit |
Loop / retry / timeout analyzers |
| Package | Purpose |
|---|---|
@agent-inspect/viewer |
Localhost viewer |
@agent-inspect/tui |
Optional terminal UI |
@agent-inspect/mcp |
MCP client tracing |
@agent-inspect/mcp-server |
Read-only MCP server (Preview) |
| Package | Purpose |
|---|---|
@agent-inspect/index-sqlite |
Optional SQLite index (Beta) |
@agent-inspect/studio |
Customer-owned Studio (Beta) |
| Package | Purpose |
|---|---|
@agent-inspect/adapter-sdk |
Third-party adapters (Beta) |
agent-inspect-vscode is in-repo (Marketplace not published yet).
| Website | Repo | |
|---|---|---|
| Getting started | docs | FIRST-TRACE |
| Contracts / suites / gates | — | TRACE-CONTRACTS · SUITES-COHORTS-GATES |
| Safe sharing | safe-sharing | SAFE-TRACE-SHARING |
| API / CLI | — | API · CLI (packed with npm) |
| Full index | — | docs/README.md |
CONTRIBUTING.md · Good first issues · Discussions
Redact traces before posting issues or PRs.
pnpm add agent-inspect
npx agent-inspect doctorMonorepo: pnpm install && pnpm build && pnpm test