Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

如何eval和predict调用api的模型 #6519

Closed
1 task done
xiao-liya opened this issue Jan 3, 2025 · 0 comments
Closed
1 task done

如何eval和predict调用api的模型 #6519

xiao-liya opened this issue Jan 3, 2025 · 0 comments
Labels
wontfix This will not be worked on

Comments

@xiao-liya
Copy link

Reminder

  • I have read the README and searched the existing issues.

System Info

  • llamafactory version: 0.7.2.dev0
  • Platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.35
  • Python version: 3.10.13
  • PyTorch version: 2.3.0+cu121 (GPU)
  • Transformers version: 4.46.0.dev0
  • Datasets version: 3.0.1
  • Accelerate version: 0.34.2
  • PEFT version: 0.13.0
  • TRL version: 0.11.1
  • GPU type: NVIDIA RTX A6000
  • DeepSpeed version: 0.14.0
  • Bitsandbytes version: 0.43.0
  • vLLM version: 0.4.3

Reproduction

预测数据集是本地自己创建的，现在能够预测本地模型，如果预测调用api的模型，应该如何修改代码，需要修改哪些代码？

Expected behavior

预测和评估调用API的模型

Others

No response
@github-actions github-actions bot added the pending This problem is yet to be addressed label Jan 3, 2025
@hiyouga hiyouga added wontfix This will not be worked on and removed pending This problem is yet to be addressed labels Jan 3, 2025
@hiyouga hiyouga closed this as not planned Won't fix, can't repro, duplicate, stale Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
wontfix This will not be worked on
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @xiao-liya