Skip to content

Commit 976d288

Browse files
committed
test: Nudge the model towards the expected answer
Llama-3.2-1B-Instruct sometimes waffled about humans now living on any "other" planets in the solar system. Signed-off-by: Derek Higgins <[email protected]>
1 parent 4a80a96 commit 976d288

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

tests/integration/test_cases/inference/chat_completion.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"non_streaming_01": {
33
"data": {
4-
"question": "Which planet do humans live on?",
4+
"question": "Which planet do humans live on, starting with letter E?",
55
"expected": "Earth"
66
}
77
},

tests/integration/test_cases/openai/responses.json

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
{
22
"non_streaming_01": {
33
"data": {
4-
"question": "Which planet do humans live on?",
4+
"question": "Which planet do humans live on, starting with letter E?",
55
"expected": "Earth"
66
}
77
},

0 commit comments

Comments
 (0)