Skip to content

Paper: Opening the Black Box: Mechanistic Interpretability for AI Agent Tool Selection Using Sparse Autoencoders - #1284

Open
fwkoch wants to merge 18 commits into
2026from
editorial/575-lab
Open

fwkoch wants to merge 18 commits into
2026from
editorial/575-lab

Conversation

@fwkoch

@fwkoch fwkoch commented Oct 9, 2026

Copy link
Copy Markdown
Member

Requested by Franklin Koch

Editorial copy of #1243, which doesn't allow maintainer edits. This branch starts from the author's branch exactly as it is, with one "Editorial fixes" commit on top. Please continue the discussion on #1243.

🤖 Generated with Claude Code

hanneshapke and others added 18 commits June 13, 2026 11:51
* added RAFT motivation

* Extended RAFT description and added one image.
* Add Carlos Huisa and Triveni Gandhi as authors

* Update affiliations for Carlos Huisa and Triveni Gandhi

* Potential fix for pull request finding

Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Hannes Hapke <hanneshapke@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
* Add CPU-only quickstart notebook as supplementary material

Publish kiji-inspector quickstart_colab.ipynb in papers/575-lab (TOC entry
+ Colab cross-reference in main.md). Pin install to kiji-inspector==0.5.0rc2
and transformers==5.12.1, and strip Jupyter widget outputs/metadata that
fail nbformat validation and render poorly in static HTML.

* Point Colab links to 575-lab/scipy_proceedings @ 2026

* Clarify quickstart is an open-source example, not the paper's SAE

* Document SAE registry, loading API, and vLLM activation-extraction patch in main.md

* Add command-line reproducibility note for the pipeline
* added section on AI affiliation

* fixed typo
… et al. (2023) for unfaithful CoT rationales
The curvenote CLI image now ships typst 0.15.1, which removed the `diff`
symbol (typst/codex v0.3.0, "Removals in sym"; `partial` replaces it).
mystmd's tex-to-typst@0.0.21 still maps `partial: 'diff'`, so every
`\partial` in the paper compiled to an undefined `diff` and the
full_text.pdf export failed with `error: unknown variable: diff`,
breaking the `curvenote check` CI job before the venue checks could run.

Writing the literal ∂ (U+2202) passes through to Typst as `∂` and KaTeX
renders it identically in the HTML output, so the notation is unchanged.
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
@fwkoch fwkoch added the approved This triggers Curvenote Submission action label Oct 9, 2026
@github-actions

github-actions Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Curvenote Preview

Directory Preview Checks Updated (UTC)
papers/575-lab 🔍 Inspect ✅ 55 checks passed (6 optional) Oct 9, 2026, 5:37 AM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved This triggers Curvenote Submission action

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants