fix: prevent self-audit 'Violates Known Physics' example bleedthrough#585

Merged

neoneye merged 48 commits intomainfrom

fix/self-audit-physics-example-bleedthrough

May 3, 2026

Commits on May 2, 2026

Merge remote-tracking branch 'origin/main' into fix/self-audit-physics-example-bleedthrough
neoneye
committed
self_audit: carve regulatory/permit gaps out of physics check; drop LOW=None mitigation rule
neoneye
committed
self_audit: reframe physics check around fantasy/fictional-universe prompts
neoneye
committed
self_audit: record physics-check failure modes in comment field
neoneye
committed
self_audit: hard-gate physics HIGH on naming a specific law
neoneye
committed
self_audit: emit justification before level to stop self-contradicting verdicts
neoneye
committed
self_audit: scope physics LOW-mitigation to the physics topic
neoneye
committed
self_audit: drop fantasy framing, focus physics check on named-law violations
neoneye
committed
self_audit: split "Violates Known Physics" into a dedicated module
neoneye
committed
violates_known_physics: drop keyword-based fallback
neoneye
committed
self_audit: run physics check before the main loop, drop module-side audit constants
neoneye
committed
self_audit: rename ALL_CHECKLIST_ITEMS to BATCH_CHECKLIST_ITEMS, drop physics entry
neoneye
committed
violates_known_physics: take LLMExecutor directly, drop dict-wrap call site
neoneye
committed
violates_known_physics: rename _LLMResponse to PhysicsCheck
neoneye
committed
violates_known_physics: carve R&D out of the physics violation check
neoneye
committed
violates_known_physics: drop reference to other audit items in system prompt
neoneye
committed
violates_known_physics: add smoke harness over prompt-catalog sample
neoneye
committed
violates_known_physics: drop test-prompt-paraphrasing R&D examples
neoneye
committed
violates_known_physics: bump smoke harness SAMPLE_SEED to 800
neoneye
committed
violates_known_physics: also flag plans that propagate physics falsehoods as truth
neoneye
committed
violates_known_physics: bump smoke harness SAMPLE_SEED to 900
neoneye
committed
violates_known_physics: held-out evaluation on 20 fresh prompts (SEED=1000)
neoneye
committed
violates_known_physics: extend held-out evaluation with 20 more prompts (SEED=1100)
neoneye
committed
violates_known_physics: extend held-out evaluation to 90 prompts (SEED=1200)
neoneye
committed
violates_known_physics: extend held-out evaluation to 110 prompts (SEED=1300)
neoneye
committed
prompts: add two supernatural test cases to simple_plan_prompts catalog
neoneye
committed
violates_known_physics: split (B) into (B.1) named-law-contradiction and (B.2) non-physical-causation
neoneye
committed
prompts: add Nyxa supernatural-commerce platform test case
neoneye
committed
violates_known_physics: tighten assertion clause — marketing counts, operator belief is irrelevant
neoneye
committed
violates_known_physics: add EXPECTED_HIGH_IDS canary group to smoke harness
neoneye
committed
prompts: add 'ban women from computers/internet' US federal-program test case
neoneye
committed
violates_known_physics: add 'ban women from computers' to EXPECTED_HIGH_IDS
neoneye
committed

Commits on May 3, 2026