Skip to content

Commit

Permalink
update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
JinjieNi committed Jun 15, 2024
1 parent 3396eb9 commit 5e526af
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/how_to_use_your_own_eval_code.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,5 +67,5 @@ Feel free to use your own evaluation code to evaluate with MixEval data. To help
...
]
```
1. The difference between model input (the benchmark data) and output (the model response file) is just the `"response"` field, i.e., each entry in your output file should keep all key-value pairs (including the 'id') of the input entry, with an additional `"response"` field representing the model's output.
2. The example model output files can be found under `mix_eval/data/model_responses/gemma_11_7b_instruct/`.
1. You should prepare the model response files under `mix_eval/data/model_responses/`. As an example, you can refer to the file structure of `mix_eval/data/model_responses/gemma_11_7b_instruct/`.
2. The difference between model input (the benchmark data) and output (the model response file) is just the `"response"` field, i.e., each entry in your output file should keep all key-value pairs (including the 'id') of the input entry, with an additional `"response"` field representing the model's output.

0 comments on commit 5e526af

Please sign in to comment.