Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refine/llm api op unittest #528

Merged
merged 180 commits into from
Jan 17, 2025
Merged

Refine/llm api op unittest #528

merged 180 commits into from
Jan 17, 2025

Conversation

BeachWang
Copy link
Collaborator

  1. Add global skip_op_error param to enable fault-tolerant when execute DataJuicer analyzer and executor, but disable fault-tolerant for unit test.
  2. Enhance unit test for API calling OPs.

drcege and others added 30 commits October 24, 2024 10:26
@drcege
add api call
63d430a
@drcege
add call_api ops
6720da4
@drcege
clean
8daa6e1
@drcege
minor update
ef11951
@drcege
more tests
5597d5c
@drcege
update tests
4b6e769
@drcege
Merge branch 'main' into dev/api_model
835be22
@drcege
update prompts
325a753
@drcege
fix unittest
4f04bdd
@drcege
update tests
0adbdcd
@drcege
add docs
0aa4069
@drcege
minor fix
f007532
@drcege
Merge branch 'main' into dev/api_model
9aa7390
@drcege
add API processor
ee4f461
@drcege
Merge branch 'main' into dev/api_model
9bbfe47
@drcege
refine API processor
b00b182
@drcege
refine
b718de7
@BeachWang
chunk and extract events
6d1d433
@drcege
fix bugs
4d1670f
@drcege
fix tests
9e11aa3
@BeachWang
extract attribute
cc40fc0
@BeachWang
Merge branch 'dev/api_model' of github.com:alibaba/data-juicer into d…
4c262ad 
…ev/llm_info_extract
@drcege
refine tests
347bc0f
@BeachWang
extract nickname
c9d5051
@BeachWang
Merge branch 'dev/api_model' of github.com:alibaba/data-juicer into d…
8a128ca 
…ev/llm_info_extract
@BeachWang
nickname test done
9262777
@BeachWang
merge main
58fc020
@BeachWang
lightRAG to OP
c7dc28e
@BeachWang
merge main
238869e
@BeachWang
doc done
0e51a43
@BeachWang BeachWang added enhancement New feature or request dj:core issues/PRs about the core functions of Data-Juicer labels Jan 3, 2025
@BeachWang BeachWang requested review from HYLcool and yxdyc January 3, 2025 11:18
@BeachWang BeachWang self-assigned this Jan 3, 2025
HYLcool
HYLcool reviewed Jan 9, 2025
View reviewed changes
configs/config_all.yaml Outdated Show resolved Hide resolved
HYLcool
HYLcool approved these changes Jan 17, 2025
View reviewed changes
Copy link
Collaborator

@HYLcool HYLcool left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@BeachWang BeachWang merged commit 0815c29 into main Jan 17, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@HYLcool HYLcool HYLcool approved these changes

@yxdyc yxdyc Awaiting requested review from yxdyc

Assignees

@BeachWang BeachWang

Labels
dj:core issues/PRs about the core functions of Data-Juicer enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@BeachWang @HYLcool @drcege