Skip to content

Review and redact agent traces before dataset upload - #298

Open
voropaevv wants to merge 1 commit into
huggingface:mainfrom
voropaevv:fix/review-agent-trace-uploads
Open

voropaevv wants to merge 1 commit into
huggingface:mainfrom
voropaevv:fix/review-agent-trace-uploads

Conversation

@voropaevv

Copy link
Copy Markdown

Summary

Fixes #289.

The Agent Traces example pointed hf upload at the complete Codex session directory. This change documents selecting specific JSONL files, reviewing and redacting their records, and getting approval for the staged copies and exact destination before any Hub write.

The example uploads only the reviewed staging directory and checks that the destination dataset is private. The CLI's --private flag sets visibility when creating a repository. The separate readback covers existing datasets.

Verification

  • Ran the Bash syntax checks and exercised the examples with hf 1.28.0, mocked Hub methods, and synthetic JSONL. Checked the destination readback for private, public, missing-visibility, and mismatched-ID responses, and confirmed the staged JSONL was the only file selected for upload.
  • Ran ./scripts/publish.sh --check, the skills index and distribution builds, and the three distribution tests. The generated manifests use version 1.0.38.

Codex assisted with the patch, checks, and PR description.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

huggingface-datasets: agent-trace upload has no review or redaction step before uploading a whole session directory

1 participant