Skip to content

Preserve Agent browser actions in reports#56

Closed
giaphutran12 wants to merge 1 commit into
codex/browser-action-trace-ingestionfrom
codex/agent-browser-action-reporting
Closed

Preserve Agent browser actions in reports#56
giaphutran12 wants to merge 1 commit into
codex/browser-action-trace-ingestionfrom
codex/agent-browser-action-reporting

Conversation

@giaphutran12
Copy link
Copy Markdown
Collaborator

Summary

Stacked on #55 (codex/browser-action-trace-ingestion).

This is the producer-side follow-up for browser-action traces. If TinyFish Agent result JSON includes explicit browser-action arrays, the vendored collection runner now preserves them in phase-scoped reports so #55 can ingest them into processTrace.steps.

  • Adds BrowserActionReport schema.
  • Preserves explicit browser_actions / agent_browser_actions from Agent results.
  • Ignores generic actions arrays because they are not browser-specific enough for replay.
  • Stores parsed actions on AgentRunRecord.browser_actions even when row extraction later yields zero rows or throws.
  • Emits initial actions only at run_report.initial.agent_browser_actions.
  • Emits repair actions only at repair.loops[*].agent_browser_actions.
  • Does not emit top-level agent_browser_actions, avoiding double-counting in the Ingest collection browser action traces #55 consumer.

What this does not claim

  • The TinyFish SDK does not currently type these payload fields.
  • No browser actions are inferred from URLs, goals, source outcomes, or triage diagnostics.
  • No Playwright script is generated.
  • No cron replay or promotion is enabled.

Verification

  • node --import ./backend/node_modules/tsx/dist/esm/index.mjs --test backend/test/collection-browser-actions.test.ts backend/test/collection-agent-runner.test.ts backend/test/populate-playwright-readiness.test.ts
  • npm --prefix backend run build
  • npm --prefix backend test
  • git diff --check
  • node --check benchmarks/dataset-agent/run-benchmark.mjs
  • make verify-self-healing

@giaphutran12 giaphutran12 self-assigned this May 22, 2026
@coderabbitai
Copy link
Copy Markdown
Contributor

coderabbitai Bot commented May 22, 2026

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 8bd055b3-002e-4e3c-af96-aa84e6b64905

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch codex/agent-browser-action-reporting

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@giaphutran12
Copy link
Copy Markdown
Collaborator Author

Closing stale draft cleanup PR; superseded by later BigSet work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant