LLM pipeline implementation#1040

Open

mohitmundhragithub wants to merge 75 commits intomasterfrom

Commits on Aug 2, 2025

WIP LLM pipeline and dataset implementation
farook-edev
committed

Commits on Aug 4, 2025

fixed issues preventing libraries from compiling, runtime errors not included
farook-edev
committed

Commits on Aug 18, 2025

Commits on Aug 19, 2025

added linux x86_64 config for internal testing
farook-edev
committed

Commits on Aug 26, 2025

updated bazel config to use SSE/MMX instructions
farook-edev
committed
fixed incorrect answer format and compression
farook-edev
committed
got pipeline and dataset to produce proper results + fixed issues where pipeline cannot handle an input size larger than the max prefill size
farook-edev
committed

Commits on Sep 1, 2025

Commits on Sep 7, 2025

Commits on Sep 8, 2025

Commits on Sep 9, 2025

fixed issue with genai ops import
farook-edev
committed

Commits on Sep 27, 2025

code/config cleanup
farook-edev
committed

Commits on Sep 28, 2025

add zero-shot option to MMLU constructor
farook-edev
committed

Commits on Sep 29, 2025

Commits on Oct 5, 2025

Commits on Oct 7, 2025

Commits on Oct 11, 2025

disabled XNNPACK AVX-VNNI for windows due to C2440 error
farook-edev
committed

Commits on Oct 13, 2025

moved accuracy calculation away from ProcessOutput, ifeval accuracy is calculated per instruction not per sample
farook-edev
committed

Commits on Oct 19, 2025

fixed issue with app not finding model/tokenizer
farook-edev
committed

Commits on Oct 20, 2025

Commits on Oct 27, 2025

potential fix for windows C2440
farook-edev
committed

Commits on Oct 30, 2025