https://github.com/p-e-w/heretic/compare/master...RyderFreeman4Logos:heretic:feat/llm-judge-pipeline?expand=1#255

Closed

RyderFreeman4Logos wants to merge 20 commits into

p-e-w:masterfrom

RyderFreeman4Logos:feat/llm-judge-pipeline

Commits on Mar 26, 2026

feat(heretic): add LLM judge, 2k eval subset, logging, and dual-baseline scoring

RyderFreeman4Logos
and
claude
committed
feat(judge): add per-model token usage tracking and cost estimation

RyderFreeman4Logos
and
claude
committed
perf(judge): parallelize LLM judge with ThreadPoolExecutor (6 concurrent batches)

RyderFreeman4Logos
and
claude
committed
perf(pipeline): cross-trial GPU/LLM-judge pipeline via ask/tell loop

RyderFreeman4Logos
and
claude
committed
fix(pipeline): address code review findings

RyderFreeman4Logos
and
claude
committed
chore(repo): fix lint/format/typecheck errors, add quality gate hooks

RyderFreeman4Logos
and
claude
committed
fix(pipeline): address cumulative review findings

RyderFreeman4Logos
and
claude
committed
fix(pipeline): handle non-interrupt exceptions, restore print_responses

RyderFreeman4Logos
and
claude
committed
fix(judge): address security and robustness review findings

RyderFreeman4Logos
and
claude
committed
fix(judge): harden prompt boundary, increase response limit, cancel on failure

RyderFreeman4Logos
and
claude
committed
fix(judge): complete injection boundary, non-blocking shutdown, add tests

RyderFreeman4Logos
and
claude
committed
Merge pull request #1 from RyderFreeman4Logos/feat/llm-judge-pipeline
RyderFreeman4Logos
authored
feat(judge): hot-reloadable config via judge.toml + env vars

RyderFreeman4Logos
and
claude
committed
fix(judge): add tomli dep for py3.10, validate config inputs

RyderFreeman4Logos
and
claude
committed

Commits on Mar 27, 2026