Skip to content

Commit 5148cdf

Browse files
committed
Run on all questions
1 parent 8e4453d commit 5148cdf

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

evals/evaluate.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -53,8 +53,8 @@ def get_openai_config() -> dict:
5353
openai_config = get_openai_config()
5454
# TODO: specify the localhost URL using argument
5555
# TODO: specify the experiment name (based on PR number)
56-
# TODO: Specify the num questions using argument
56+
# TODO: Specify the num questions using arg CLI
5757

5858
run_evaluate_from_config(
59-
working_dir=Path(__file__).parent, config_path="eval_config.json", openai_config=openai_config, num_questions=10
59+
working_dir=Path(__file__).parent, config_path="eval_config.json", openai_config=openai_config
6060
)

0 commit comments

Comments
 (0)