Skip to content

feat: Add Modal training runner - #3

Merged
homanp merged 2 commits into
mainfrom
homanp/add-modal-training-runner
Jun 16, 2026
Merged

feat: Add Modal training runner#3
homanp merged 2 commits into
mainfrom
homanp/add-modal-training-runner

Conversation

@homanp

@homanp homanp commented Jun 16, 2026

Copy link
Copy Markdown
Contributor

What does this PR do?

Adds a Modal runner for remote Gemma probe training and guarded generation on an A100 GPU. The runner persists Hugging Face downloads in open-constitution-hf-cache, saves probe outputs in open-constitution-outputs, uses a Modal huggingface-secret for HF_TOKEN, and documents the workflow with a Mermaid diagram.

Also updates the Transformers loader to use dtype= instead of deprecated torch_dtype=, adds modal as a dev dependency, and ignores local .env files.

Fixes #

Checklist

  • I tested my changes
  • I reviewed my own code

Validation performed:

  • uv run ruff check .
  • uv run ruff format --check .
  • uv run pytest
  • uv run python -m compileall activation_probe_mvp scripts tests modal_train.py
  • Modal guarded-generation smoke test using saved probe volume: completed without pause

@homanp
homanp marked this pull request as ready for review June 16, 2026 10:12
@open-cla

open-cla Bot commented Jun 16, 2026

Copy link
Copy Markdown

Contributor License Agreement

All contributors are covered by a CLA.

@homanp homanp changed the title Add Modal training runner feat: Add Modal training runner Jun 16, 2026
@homanp homanp self-assigned this Jun 16, 2026
@superagent-security

Copy link
Copy Markdown

Superagent didn't find any vulnerabilities or security issues in this PR.

@homanp
homanp merged commit 5573c46 into main Jun 16, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant