From f325c20ba474c33ef0a702e44a9c0775ebdb1881 Mon Sep 17 00:00:00 2001 From: Akar <67700732+akrztrk@users.noreply.github.com> Date: Mon, 23 Dec 2024 11:02:07 +0100 Subject: [PATCH] updated bencmark table (#1674) --- docs/en/benchmark_llm.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/en/benchmark_llm.md b/docs/en/benchmark_llm.md index 817532dcd9..b740893f61 100644 --- a/docs/en/benchmark_llm.md +++ b/docs/en/benchmark_llm.md @@ -16,8 +16,7 @@ sidebar: ### Benchmarking -{:.table-model-big.db} - +{:.table-model-big} | Model | Avarega | MedMCQA | MedQA | MMLU
anotomy | MMLU
clinical
knowledge | MMLU
college
biology | MMLU
college
medicine | MMLU
medical
genetics | MMLU
professional
medicine | PubMedQA | |-----------------|---------|---------|--------|------------------|-------------------------------|----------------------------|------------------------------|------------------------------|-----------------------------------|----------| | jsl_medm_q4_v3 | 0.6884 | 0.6421 | 0.6889 | 0.7333 | 0.834 | 0.8681 | 0.7514 | 0.9 | 0.8493 | 0.782 | @@ -26,6 +25,7 @@ sidebar: | jsl_meds_q4_v3 | 0.5522 | 0.5104 | 0.48 | 0.6444 | 0.7472 | 0.8333 | 0.6532 | 0.68 | 0.6691 | 0.752 | | jsl_meds_q8_v3 | 0.5727 | 0.53 | 0.4933 | 0.6593 | 0.7623 | 0.8681 | 0.6301 | 0.76 | 0.7647 | 0.762 | | jsl_meds_q16_v3 | 0.5793 | 0.5482 | 0.4839 | 0.637 | 0.7585 | 0.8403 | 0.6532 | 0.77 | 0.7022 | 0.766 | +
### Benchmark Summary