Skip to content

Commit d06f490

Browse files
committed
Pipeline: filters: nightfall: style updates
Signed-off-by: Lynette Miles <[email protected]>
1 parent c349252 commit d06f490

File tree

1 file changed

+36
-28
lines changed

1 file changed

+36
-28
lines changed

pipeline/filters/nightfall.md

Lines changed: 36 additions & 28 deletions
Original file line numberDiff line numberDiff line change
@@ -1,42 +1,27 @@
11
# Nightfall
22

3-
The Nightfall filter scans logs for sensitive data and redacts the sensitive portions. This filter supports scanning for
4-
various sensitive information, ranging from API keys and personally identifiable information(PII) to custom regexes you
3+
The _Nightfall_ filter scans logs for sensitive data and redacts the sensitive portions. This filter supports scanning for
4+
various sensitive information, ranging from API keys and Personally Identifiable Information (PII) to custom regular expressions you
55
define. You can configure what to scan for in the [Nightfall Dashboard](https://app.nightfall.ai).
66

7-
> This filter is not enabled by default in 1.9.0 due to a typo. It must be enabled by setting flag ```-DFLB_FILTER_NIGHTFALL=ON``` when building. In 1.9.1 and above this is fixed.
8-
## Configuration Parameters
7+
This filter isn't enabled by default in 1.9.0 due to a typo. To enable it, set the flag ```-DFLB_FILTER_NIGHTFALL=ON``` when building. In 1.9.1 and above this is fixed.
8+
9+
## Configuration parameters
910

1011
The plugin supports the following configuration parameters:
1112

1213
| Key | Description | Default |
1314
| :--- | :--- | :--- |
14-
| nightfall\_api_key | The Nightfall API key to scan your logs with, obtainable from the [Nightfall Dashboard](https://app.nightfall.ai) | |
15-
| policy\_id | The Nightfall dev platform policy to scan your logs with, configurable in the [Nightfall Dashboard](https://app.nightfall.ai/developer-platform/policies). | |
16-
| sampling\_rate | The rate controlling how much of your logs you wish to be scanned, must be a float between (0,1]. 1 means all logs will be scanned. Useful for avoiding rate limits in conjunction with Fluent Bit's match rule.| 1 |
17-
| tls.debug | Debug level between 0 (nothing) and 4 (every detail). | 0 |
18-
| tls.verify | When enabled, turns on certificate validation when connecting to the Nightfall API. | true |
19-
| tls.ca_path | Absolute path to root certificates, required if tls.verify is true. | |
15+
| `nightfall_api_key` | The Nightfall API key to scan your logs with, obtainable from the [Nightfall Dashboard](https://app.nightfall.ai) | _none_ |
16+
| `policy_id` | The Nightfall developer platform policy to scan your logs with, configurable in the [Nightfall Dashboard](https://app.nightfall.ai/developer-platform/policies). | _none_ |
17+
| `sampling_rate` | The rate controlling how much of your logs you wish to be scanned. Must be a float between `(0,1]`. `1` means all logs will be scanned. Use this setting to avoid rate limits in conjunction with Fluent Bit match rules.| `1` |
18+
| `tls.debug` | Debug level between `0` (nothing) and `4` (every detail). | `0` |
19+
| `tls.verify` | When enabled, turns on certificate validation when connecting to the Nightfall API. | `true` |
20+
| `tls.ca_path` | Absolute path to root certificates, required if `tls.verify` is true. | _none_ |
2021

21-
### Command Line
22+
### Configuration file
2223

23-
```text
24-
$ bin/fluent-bit -c /PATH_TO_CONF_FILE/fluent-bit.conf
25-
26-
[2022/02/09 19:46:22] [ info] [engine] started (pid=53844)
27-
[2022/02/09 19:46:22] [ info] [storage] version=1.1.5, initializing...
28-
[2022/02/09 19:46:22] [ info] [storage] in-memory
29-
[2022/02/09 19:46:22] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
30-
[2022/02/09 19:46:22] [ info] [cmetrics] version=0.2.2
31-
[2022/02/09 19:46:22] [ info] [input:http:http.0] listening on 0.0.0.0:8000
32-
[2022/02/09 19:46:22] [ info] [sp] stream processor started
33-
[2022/02/09 19:46:30] [ info] [filter:nightfall:nightfall.0] Nightfall request http_do=0, HTTP Status: 200
34-
[0] app.log: [1644464790.280412000, {"A"=>"there is nothing sensitive here", "B"=>[{"A"=>"my credit card number is *******************"}, {"A"=>"*********** is my social security."}], "C"=>false, "D"=>"key ********************"}]
35-
[2022/02/09 19:47:25] [ info] [filter:nightfall:nightfall.0] Nightfall request http_do=0, HTTP Status: 200
36-
[0] app.log: [1644464845.675431000, {"A"=>"a very safe string"}]
37-
```
38-
39-
### Configuration File
24+
The following is an example of a configuration file for the Nightfall filter.
4025

4126
```text
4227
[INPUT]
@@ -56,3 +41,26 @@ $ bin/fluent-bit -c /PATH_TO_CONF_FILE/fluent-bit.conf
5641
Name stdout
5742
```
5843

44+
### Command line
45+
46+
Once configured, you can use the filter from the command line by running a command like:
47+
48+
```shell
49+
bin/fluent-bit -c /PATH_TO_CONF_FILE/fluent-bit.conf
50+
```
51+
52+
Which results in output like:
53+
54+
```text
55+
[2022/02/09 19:46:22] [ info] [engine] started (pid=53844)
56+
[2022/02/09 19:46:22] [ info] [storage] version=1.1.5, initializing...
57+
[2022/02/09 19:46:22] [ info] [storage] in-memory
58+
[2022/02/09 19:46:22] [ info] [storage] normal synchronization mode, checksum disabled, max_chunks_up=128
59+
[2022/02/09 19:46:22] [ info] [cmetrics] version=0.2.2
60+
[2022/02/09 19:46:22] [ info] [input:http:http.0] listening on 0.0.0.0:8000
61+
[2022/02/09 19:46:22] [ info] [sp] stream processor started
62+
[2022/02/09 19:46:30] [ info] [filter:nightfall:nightfall.0] Nightfall request http_do=0, HTTP Status: 200
63+
[0] app.log: [1644464790.280412000, {"A"=>"there is nothing sensitive here", "B"=>[{"A"=>"my credit card number is *******************"}, {"A"=>"*********** is my social security."}], "C"=>false, "D"=>"key ********************"}]
64+
[2022/02/09 19:47:25] [ info] [filter:nightfall:nightfall.0] Nightfall request http_do=0, HTTP Status: 200
65+
[0] app.log: [1644464845.675431000, {"A"=>"a very safe string"}]
66+
```

0 commit comments

Comments
 (0)