chore: benchmark routing + tool-call validation#98

Open

saschabuehrle wants to merge 9 commits into

mainfrom

feat/benchmark-truthfulqa

Commits on Mar 14, 2026

chore: enrich benchmark routing metrics

saschabuehrle
authored and
saschabuehrle
committed
feat: add real-world tool calls benchmark

saschabuehrle
authored and
saschabuehrle
committed
fix: download full HumanEval dataset

saschabuehrle
authored and
saschabuehrle
committed
chore: unify benchmark model overrides

saschabuehrle
authored and
saschabuehrle
committed
chore: show resolved models in gsm8k full benchmark

saschabuehrle
authored and
saschabuehrle
committed
fix: correct baseline cost estimation in full benchmarks

saschabuehrle
authored and
saschabuehrle
committed
chore: add concurrency to mmlu full benchmark

saschabuehrle
authored and
saschabuehrle
committed
fix: handle parallel tool calls in bfcl benchmark

saschabuehrle
authored and
saschabuehrle
committed
style(benchmarks): apply black formatting for truthfulqa PR

saschabuehrle
authored and
saschabuehrle
committed