-
Notifications
You must be signed in to change notification settings - Fork 458
Open
Description
Thank you for your promising work Code-Optimize. We greatly appreciate the effort you've put into it.
However, we’ve encountered some difficulty in reproducing the second step of annotation. Specifically, the MBPP dataset provided in the code contains the following keys:
[prompt, test, entry_point].
On the other hand, the MBPP datasets we have found online typically contain keys such as:
['task_id', 'text', 'code', 'test_list', 'test_setup_code'].
It seems there might be a missing or unclear preprocessing step that is causing this discrepancy. Could you kindly clarify this step for us, or point us in the right direction?
Looking forward to your response, and thank you once again for your valuable contributions.
Best regards,
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels