Skip to content

Actions: mlcommons/inference

Actions

MLC based Submission Generation

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
test-submission-generation.yml
1,011 workflow runs
1,011 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix(e2e-rag): drop the duplicated second half of QSL.py MLC based Submission Generation #1551: Pull request #2673 opened by Anai-Guo
Action required Anai-Guo:fix-e2e-rag-qsl-duplicated-body
Anai-Guo:fix-e2e-rag-qsl-duplicated-body
Action required
Default --audit-conf to audit.config in the reference entry points MLC based Submission Generation #1550: Pull request #2672 opened by 100-JM
Action required 100-JM:fix/audit-config-default
100-JM:fix/audit-config-default
Action required
llama3.1-8b: fix run scripts and the README accuracy flow MLC based Submission Generation #1549: Pull request #2671 opened by 100-JM
Action required 100-JM:fix/llama3.1-8b-scripts-readme
100-JM:fix/llama3.1-8b-scripts-readme
Action required
llama3.1-8b: use TokensPrompt in the Offline vLLM SUT and fail fast on worker death MLC based Submission Generation #1548: Pull request #2670 opened by 100-JM
Action required 100-JM:fix/llama3.1-8b-vllm-tokensprompt
100-JM:fix/llama3.1-8b-vllm-tokensprompt
Action required
Pin anthropic<1.0 in the DeepSeek-R1 evaluation requirements MLC based Submission Generation #1547: Pull request #2669 opened by 100-JM
Action required 100-JM:fix/deepseek-r1-pin-anthropic
100-JM:fix/deepseek-r1-pin-anthropic
Action required
Bound and pre-load the DeepSeek-R1 LiveCodeBench grader workers MLC based Submission Generation #1546: Pull request #2668 opened by 100-JM
Action required 100-JM:fix/deepseek-r1-lcb-grader-workers
100-JM:fix/deepseek-r1-lcb-grader-workers
Action required
fix: NameError 'has_reranker' in e2e-rag single-shot result display MLC based Submission Generation #1545: Pull request #2667 opened by Anai-Guo
Action required Anai-Guo:fix-e2e-rag-has-reranker
Anai-Guo:fix-e2e-rag-has-reranker
Action required
fix(TEST01): NameError in verify_performance when the loadgen log reports errors MLC based Submission Generation #1544: Pull request #2666 opened by Anai-Guo
Action required Anai-Guo:fix-test01-undefined-line
Anai-Guo:fix-test01-undefined-line
Action required
Restore IMAGE_EXTENSIONS in the text_to_image FID helper MLC based Submission Generation #1543: Pull request #2665 opened by David-Wu1119
Action required David-Wu1119:fix/fid-missing-image-extensions
David-Wu1119:fix/fid-missing-image-extensions
Action required
Fix two NameErrors in the e2e-rag reference implementation MLC based Submission Generation #1542: Pull request #2664 opened by David-Wu1119
Action required David-Wu1119:fix/e2e-rag-undefined-names
David-Wu1119:fix/e2e-rag-undefined-names
Action required
Fix NameError on every async query in the llama2-70b API SUT MLC based Submission Generation #1541: Pull request #2663 opened by David-Wu1119
Action required David-Wu1119:fix/sut-api-missing-import-sys
David-Wu1119:fix/sut-api-missing-import-sys
Action required
Fix three defects in tools/submission/log_parser.py MLC based Submission Generation #1540: Pull request #2662 opened by David-Wu1119
Action required David-Wu1119:fix/log-parser-undefined-names
David-Wu1119:fix/log-parser-undefined-names
Action required
Update model names in report MLC based Submission Generation #1539: Pull request #2661 opened by pgmpablo157321
4m 33s report_fix
report_fix
4m 33s
Sync Docs branch with master MLC based Submission Generation #1538: Pull request #2657 synchronize by mlcommons-bot
9m 8s docs
docs
9m 8s
Fix MLC based Submission Generation #1537: Pull request #2660 synchronize by hanyunfan
5m 29s fix-llama2-70b-99-v61-old-checker
fix-llama2-70b-99-v61-old-checker
5m 29s
Sync Docs branch with master MLC based Submission Generation #1536: Pull request #2657 synchronize by mlcommons-bot
4m 36s docs
docs
4m 36s
Fix MLC based Submission Generation #1535: Pull request #2660 opened by anandhu-eng
4m 51s fix-llama2-70b-99-v61-old-checker
fix-llama2-70b-99-v61-old-checker
4m 51s
Quick fix: add edge qwen 27b in final report MLC based Submission Generation #1534: Pull request #2659 opened by pgmpablo157321
4m 10s report_fix
report_fix
4m 10s
Sync Docs branch with master MLC based Submission Generation #1533: Pull request #2657 synchronize by anandhu-eng
1m 38s docs
docs
1m 38s
Sync Docs branch with master MLC based Submission Generation #1530: Pull request #2657 synchronize by anandhu-eng
12m 43s docs
docs
12m 43s
Quick fix: Add interactive to metric overwrite MLC based Submission Generation #1529: Pull request #2656 opened by pgmpablo157321
3m 58s scenario_mapping
scenario_mapping
3m 58s
Quick fix for scenario mapping MLC based Submission Generation #1528: Pull request #2655 synchronize by pgmpablo157321
3m 55s scenario_mapping
scenario_mapping
3m 55s
Quick fix for scenario mapping MLC based Submission Generation #1527: Pull request #2655 opened by pgmpablo157321
4m 9s scenario_mapping
scenario_mapping
4m 9s
Require only one of server or interactive MLC based Submission Generation #1526: Pull request #2654 opened by pgmpablo157321
3m 41s Qwen_quick_fix
Qwen_quick_fix
3m 41s
Add interactive checks for Q3VL submission checker MLC based Submission Generation #1525: Pull request #2652 synchronize by pgmpablo157321
3m 51s Victor49152:mingyuanm/q3vl-submission-checker
Victor49152:mingyuanm/q3vl-submission-checker
3m 51s