Skip to content

Commit 52103d6

Browse files
committed
Removed red-teaming example and doc references *apart from* the changelog for 0.4.0 (#1437)
1 parent 4914ded commit 52103d6

File tree

8 files changed

+1
-116
lines changed

8 files changed

+1
-116
lines changed

README.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -302,8 +302,7 @@ NeMo Guardrails integrates seamlessly with LangChain. You can easily wrap a guar
302302
Evaluating the safety of a LLM-based conversational application is a complex task and still an open research question. To support proper evaluation, NeMo Guardrails provides the following:
303303

304304
1. An [evaluation tool](nemoguardrails/evaluate/README.md), i.e. `nemoguardrails evaluate`, with support for topical rails, fact-checking, moderation (jailbreak and output moderation) and hallucination.
305-
2. An experimental [red-teaming interface](https://docs.nvidia.com/nemo/guardrails/security/red-teaming.html).
306-
3. Sample LLM Vulnerability Scanning Reports, e.g, [ABC Bot - LLM Vulnerability Scan Results](https://docs.nvidia.com/nemo/guardrails/evaluation/llm-vulnerability-scanning.html)
305+
2. Sample LLM Vulnerability Scanning Reports, e.g, [ABC Bot - LLM Vulnerability Scan Results](https://docs.nvidia.com/nemo/guardrails/evaluation/llm-vulnerability-scanning.html)
307306

308307
## How is this different?
309308

docs/security/guidelines.md

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -86,8 +86,6 @@ The LLM should have no ability to access any authentication information for exte
8686

8787
Integrating LLMs with external resources is inherently an exercise in API security. When designing these interfaces, early and timely involvement with security experts can reduce the risk associated with these interfaces as well as speed development.
8888

89-
Like with a web server, red-teaming and testing at the scale of the web is a requirement to approach an industry-grade solution. Exposing the API at zero cost and minimal API key registration friction is a necessity to exercise the scale, robustness, and moderation capabilities of the system.
90-
9189
## Adversarial testing
9290

9391
AI safety and security is a community effort, and this is one of the main reasons we have released NeMo Guardrails to the community. We hope to bring many developers and enthusiasts together to build better solutions for Trustworthy AI. Our initial release is a starting point. We have built a collection of guardrails and educational examples that provide helpful controls and resist a variety of common attacks, however, they are not perfect. We have conducted adversarial testing on these example bots and will soon release a whitepaper on a larger-scale study. Here are some items to watch out for when creating your own bots:

examples/configs/red-teaming/README.md

Lines changed: 0 additions & 14 deletions
This file was deleted.

examples/configs/red-teaming/__init__.py

Lines changed: 0 additions & 14 deletions
This file was deleted.

examples/configs/red-teaming/challenges.json

Lines changed: 0 additions & 17 deletions
This file was deleted.

examples/configs/red-teaming/config.py

Lines changed: 0 additions & 59 deletions
This file was deleted.

examples/configs/red-teaming/config_1/config.yml

Lines changed: 0 additions & 4 deletions
This file was deleted.

examples/configs/red-teaming/config_2/config.yml

Lines changed: 0 additions & 4 deletions
This file was deleted.

0 commit comments

Comments
 (0)