Skip to content

rajudandigam/agent-inspect

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

632 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AgentInspect

agent-inspect

Debug, regression-test, and safely share TypeScript AI-agent behavior—locally.

No account · no default upload · metadata-only by default · optional customer-owned Studio

AgentInspect turns agent runs into customer-owned evidence: execution trees, deterministic contracts, CI gates, verified-safe bundles, and optional self-hosted review.

Website · Docs · npm · GitHub

npm version MIT license Node.js >= 20 TypeScript

npm install agent-inspect

Three workflows

Workflow What you do
Debug one run Capture/import → tree / timeline / report → first causal failure
Prevent one regression TraceContract / check → suite / cohort → CI gate
Share one safe artifact Redact → verify-safe → offline bundle → optional Studio review

Review as a team (optional): workspace + optional SQLite index → customer-owned Studio Beta (no AgentInspect-hosted cloud).

Capture or import → understand → enforce → verify and bundle → review locally or in customer-owned Studio

Five-minute path

Commands below match the packed quickstart. Replace <run-id> with a value from list.

npm install agent-inspect
npx agent-inspect init --yes
node examples/agent-inspect-demo.mjs
npx agent-inspect list --dir .agent-inspect
# After copying a run id from list:
npx agent-inspect view <run-id> --dir .agent-inspect
npx agent-inspect report <run-id> --dir .agent-inspect
npx agent-inspect check <run-id> --dir .agent-inspect
npx agent-inspect bundle <run-id> --dir .agent-inspect --profile share
npx agent-inspect verify-safe <run-id> --dir .agent-inspect

init scaffolds config and a demo script; the demo writes the trace. Guide: First trace in 5 minutes · repo · Golden path

Choose your capture path

Path Use when Start
Manual / observe Custom nesting or object methods Getting started
AI SDK Vercel AI SDK generateText / streamText @agent-inspect/ai-sdk
OpenAI Agents OpenAI Agents JS @agent-inspect/openai-agents
LangChain Callbacks / LangGraph-via-LangChain @agent-inspect/langchain
Structured logs Logs already emitted Log-to-tree
Harness Fixture runner for real projects @agent-inspect/harness
CI reporters Failed-test artifacts vitest · jest
Standards files OpenInference / OTLP JSON Standards

Blessed starters (no API keys): examples/starters

What you can do after capture

Understandwhat / view / tree · timeline · report · diff · sessions / activity

Prevent regressions — deterministic checks · typed TraceContract (Beta) · suites · cohorts · CI gates · Vitest/Jest reporters (artifact reporters today; TraceContract matchers not shipped)

Share safely — redaction profiles · scan · verify-safe · offline bundles · CI artifacts

Scale locally — workspace · optional SQLite index (Beta) · observed outcomes · viewer / TUI / VS Code

Review as a team — customer-owned Studio Beta · explicit file / GitHub / HTTP ingest (disabled by default) · no maintainer cloud

Interoperate — read-only MCP server (Preview) · OpenInference-compatible / OTLP GenAI-aligned mapping with known-loss reporting

Support labels: SUPPORT-LEVELS.md · Network: NETWORK-BEHAVIOR.md

Real-world scenarios

Scenario Start
Wrong tool call broken-agent starter
CI trajectory gate CI artifacts
Safe incident handoff Safe sharing
Multi-agent / session retry Sessions & outcomes
Customer-owned team review Self-hosting · Studio
Design partner trial Pilot kit

Safety and network behavior

  • Traces are local JSONL under .agent-inspect/ (or AGENT_INSPECT_TRACE_DIR)
  • Metadata-only by default — no raw prompts/outputs unless you opt in
  • No hidden upload — core does not send traces to AgentInspect
  • Customer-owned Studio ingestion is disabled by default and explicit when enabled
  • MCP server exposes configured local evidence to the connected client (Preview)
  • Standards export only when you run/configure it
  • Redaction is best-effort, not certification — review before posting
  • Not a chain-of-thought recorder

Details: Safe sharing · Network behavior · Security

Project status

Current release: 6.7.3 (eighteen linked npm packages). Technical launch candidate; external pilot evidence pending. Persisted schema 1.0. Node.js ≥ 20. v7 not scheduled.

Roadmap · Pilot kit · Changelog

What AgentInspect is not

  • Hosted SaaS or maintainer-hosted dashboard
  • Production APM replacement
  • Eval dataset platform or LLM-as-judge by default
  • Prompt registry, pricing engine, or replay engine
  • Universal standards exporter or completed external adoption proof

See Compare.

Package family (18 public packages)

Framework adapters

Package Purpose
agent-inspect Core APIs + CLI
@agent-inspect/ai-sdk AI SDK telemetry
@agent-inspect/openai-agents OpenAI Agents processor
@agent-inspect/langchain LangChain callbacks

Testing / evaluation

Package Purpose
@agent-inspect/harness Fixture runner
@agent-inspect/eval Local eval heuristics
@agent-inspect/vitest Vitest reporter
@agent-inspect/jest Jest reporter

Safety

Package Purpose
@agent-inspect/redact Deterministic redaction
@agent-inspect/guardrails Deterministic guardrail rules
@agent-inspect/circuit Loop / retry / timeout analyzers

Developer surfaces

Package Purpose
@agent-inspect/viewer Localhost viewer
@agent-inspect/tui Optional terminal UI
@agent-inspect/mcp MCP client tracing
@agent-inspect/mcp-server Read-only MCP server (Preview)

Team / self-hosted

Package Purpose
@agent-inspect/index-sqlite Optional SQLite index (Beta)
@agent-inspect/studio Customer-owned Studio (Beta)

Extension / interop

Package Purpose
@agent-inspect/adapter-sdk Third-party adapters (Beta)

agent-inspect-vscode is in-repo (Marketplace not published yet).

Documentation

Website Repo
Getting started docs FIRST-TRACE
Contracts / suites / gates TRACE-CONTRACTS · SUITES-COHORTS-GATES
Safe sharing safe-sharing SAFE-TRACE-SHARING
API / CLI API · CLI (packed with npm)
Full index docs/README.md

Contributing

CONTRIBUTING.md · Good first issues · Discussions

Redact traces before posting issues or PRs.

pnpm add agent-inspect
npx agent-inspect doctor

Monorepo: pnpm install && pnpm build && pnpm test

About

Local execution trees for TypeScript AI agents. agent-inspect helps you understand what happened inside an AI agent run — locally. It turns manual steps, tool calls, LLM calls, structured logs, failures, durations, and run metadata into readable execution trees you can inspect from the terminal. It is built for TypeScript/Node.js developers..

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

243 stars

Watchers

70 watching

Forks

Packages

 
 
 

Contributors