Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Daniel/prompt optimization #1737

Draft
wants to merge 29 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
5aea893
save
sfc-gh-dhuang Oct 29, 2024
6a8d32e
improve trubasicapp setup for competitive experiments, add mlflow ins…
sfc-gh-dhuang Oct 31, 2024
7968d52
save
sfc-gh-dhuang Oct 31, 2024
6b91ffe
save progress
sfc-gh-dhuang Nov 12, 2024
65d92ce
save
sfc-gh-dhuang Nov 12, 2024
b8325a4
save
sfc-gh-dhuang Nov 25, 2024
cf5979a
Merge branch 'daniel/prompt-opt' into trec-exp-adding-rubric
sfc-gh-dhuang Nov 25, 2024
17941b0
add agreement analysis with scoreddocs
sfc-gh-dhuang Nov 25, 2024
fbe2ae4
notebook updates
sfc-gh-dhuang Dec 3, 2024
dd3c1f7
Merge branch 'main' into trec-exp-adding-rubric
sfc-gh-dhuang Dec 3, 2024
99d2a2b
cleanup
sfc-gh-dhuang Dec 3, 2024
78e3fb5
dataset preprocessing script update
sfc-gh-dhuang Dec 3, 2024
4206707
cleanup competitive analysis
sfc-gh-dhuang Dec 3, 2024
8554d04
Merge branch 'main' into trec-exp-adding-rubric
sfc-gh-dhuang Dec 3, 2024
fb9c246
add llm aggrefact nb
sfc-gh-dhuang Dec 4, 2024
35432e7
add llm-aggrefact experiment notebook
sfc-gh-dhuang Dec 5, 2024
360fbb8
Merge branch 'main' into trec-exp-adding-rubric
sfc-gh-dhuang Dec 5, 2024
cb743c5
move notebooks
sfc-gh-dhuang Dec 5, 2024
680eab4
Merge branch 'main' into trec-exp-adding-rubric
sfc-gh-dhuang Dec 5, 2024
12f38a0
Merge branch 'trec-exp-adding-rubric' into daniel/prompt-optimization
sfc-gh-dhuang Dec 5, 2024
ee872d0
save
sfc-gh-dhuang Dec 9, 2024
4438819
save
sfc-gh-dhuang Dec 10, 2024
d843fae
save
sfc-gh-dhuang Dec 13, 2024
469af41
save progress - optimizing context relevance cortex prompt
sfc-gh-dhuang Dec 16, 2024
6deb0fd
add ragas answer relevance notebook
sfc-gh-dhuang Jan 3, 2025
d6d7662
add answer relevance notebooks
sfc-gh-dhuang Jan 7, 2025
6cd9eb3
update prompt opt for groundedness nb
sfc-gh-dhuang Jan 8, 2025
abd6f63
updated context relevance nb to persist optimized prompt
sfc-gh-dhuang Jan 17, 2025
9370e31
save
sfc-gh-dhuang Jan 23, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -52,6 +52,9 @@ credentials.toml
# test files generated by benchmark experiments
**/tests/*.csv
**/results/*.csv
**/experiments/mlruns/
**/experiments/*/*.csv
**/experiments/**/*.zip

# test files generated by pytest
test-output.xml
Expand Down
Loading