Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT add red team social bias dataset #661

Open
romanlutz opened this issue Jan 27, 2025 · 2 comments
Open

FEAT add red team social bias dataset #661

romanlutz opened this issue Jan 27, 2025 · 2 comments
Assignees
Labels
good first issue Good for newcomers help wanted Extra attention is needed

Comments

@romanlutz
Copy link
Contributor

Is your feature request related to a problem? Please describe.

This is brand new and not yet added:

https://svannie678.github.io/svannie678-red_team_repo_social_bias/

Describe the solution you'd like

Similar fetch function like all other datasets.

Describe alternatives you've considered, if relevant

Additional context

@romanlutz romanlutz added good first issue Good for newcomers help wanted Extra attention is needed labels Jan 27, 2025
@MoolmanM
Copy link
Contributor

Hello! I was looking into the issue and was considering working on a fix. It seems like the solution would involve checking if the URL is a parquet file and, if so, adding logic to convert it into json/csv/txt before proceeding with the regular processing. Before I begin, I wanted to check if it’s alright to take this on or if there’s already a plan to address it. Let me know your thoughts!

@romanlutz
Copy link
Contributor Author

Hi @MoolmanM ! Thanks for expressing interest. You can absolutely get started on this. I would recommend checking out the pyrit.datasets module. We have functions in there to pull in datasets from Hugging Face. This particular one is also available on HuggingFace so you don't need to do anything special, just call HF. The not so straightforward part is deciding which columns to use for our SeedPrompt objects. I'm happy to point you in the right direction if you want help, but you can also give it a try first. LMK

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants