Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT add dataset from "A Framework to Assess Multilingual Vulnerabilities of LLMs" #831

Open
romanlutz opened this issue Mar 25, 2025 · 2 comments
Assignees
Labels
datasets Pulling in external datasets into PyRIT good first issue Good for newcomers help wanted Extra attention is needed

Comments

@romanlutz
Copy link
Contributor

Is your feature request related to a problem? Please describe.

This paper introduces a new dataset that we could use.

Describe the solution you'd like

Write a fetch_* function like all the others in pyrit.datasets that fetches the CSV file from https://github.com/CarsonDon/Multilingual-Vuln-LLMs/blob/main/prompts/allprompt.csv

Let's credit the paper authors as usual. Let's also capture the "type" column in the harm_categories column for our seed prompts.

@romanlutz romanlutz added datasets Pulling in external datasets into PyRIT good first issue Good for newcomers help wanted Extra attention is needed labels Mar 25, 2025
@devesh-2002
Copy link

May I try to work on this issue?

@romanlutz
Copy link
Contributor Author

Of course! Go ahead! If you want an example of another dataset PR check out #821

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
datasets Pulling in external datasets into PyRIT good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

2 participants