Skip to content

Commit d26c1dc

Browse files
authored
Merge pull request #1652 from fluent/lynettemiles/sc-135610/update-fluent-bit-fluent-bit-docs-administration
2 parents 7cfa640 + 84e0c2b commit d26c1dc

File tree

1 file changed

+13
-13
lines changed

1 file changed

+13
-13
lines changed

administration/configuring-fluent-bit/yaml/pipeline-section.md

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,17 +1,17 @@
1-
# Pipeline Section
1+
# Pipeline section
22

33
The `pipeline` section defines the flow of how data is collected, processed, and sent to its final destination. It encompasses the following core concepts:
44

55
| Name | Description |
6-
|---|---|
6+
| ---- | ----------- |
77
| `inputs` | Specifies the name of the plugin responsible for collecting or receiving data. This component serves as the data source in the pipeline. Examples of input plugins include `tail`, `http`, and `random`. |
8-
| `processors` | **Unique to YAML configuration**, processors are specialized plugins that handle data processing directly attached to input plugins. Unlike filters, processors are not dependent on tag or matching rules. Instead, they work closely with the input to modify or enrich the data before it reaches the filtering or output stages. Processors are defined within an input plugin section. |
8+
| `processors` | **Unique to YAML configuration**, processors are specialized plugins that handle data processing directly attached to input plugins. Unlike filters, processors aren't dependent on tag or matching rules. Instead, they work closely with the input to modify or enrich the data before it reaches the filtering or output stages. Processors are defined within an input plugin section. |
99
| `filters` | Filters are used to transform, enrich, or discard events based on specific criteria. They allow matching tags using strings or regular expressions, providing a more flexible way to manipulate data. Filters run as part of the main event loop and can be applied across multiple inputs and filters. Examples of filters include `modify`, `grep`, and `nest`. |
1010
| `outputs` | Defines the destination for processed data. Outputs specify where the data will be sent, such as to a remote server, a file, or another service. Each output plugin is configured with matching rules to determine which events are sent to that destination. Common output plugins include `stdout`, `elasticsearch`, and `kafka`. |
1111

12-
## Example Configuration
12+
## Example configuration
1313

14-
Here's a simple example of a pipeline configuration:
14+
Here's an example of a pipeline configuration:
1515

1616
```yaml
1717
pipeline:
@@ -33,13 +33,13 @@ pipeline:
3333
match: '*'
3434
```
3535
36-
## Pipeline Processors
36+
## Pipeline processors
3737
38-
Processors operate on specific signals such as logs, metrics, and traces. They are attached to an input plugin and must specify the signal type they will process.
38+
Processors operate on specific signals such as logs, metrics, and traces. They're attached to an input plugin and must specify the signal type they will process.
3939
4040
### Example of a Processor
4141
42-
In the example below, the content_modifier processor inserts or updates (upserts) the key my_new_key with the value 123 for all log records generated by the tail plugin. This processor is only applied to log signals:
42+
In the following example, the `content_modifier` processor inserts or updates (upserts) the key `my_new_key` with the value `123` for all log records generated by the tail plugin. This processor is only applied to log signals:
4343

4444
```yaml
4545
parsers:
@@ -110,9 +110,9 @@ pipeline:
110110
end
111111
```
112112

113-
You might noticed that processors not only can be attached to input, but also to an output.
113+
Processors can be attached to inputs and outputs.
114114

115-
### How Are Processors Different from Filters?
115+
### How Processors are different from Filters
116116

117117
While processors and filters are similar in that they can transform, enrich, or drop data from the pipeline, there is a significant difference in how they operate:
118118

@@ -122,11 +122,11 @@ While processors and filters are similar in that they can transform, enrich, or
122122

123123
## Running Filters as Processors
124124

125-
You can configure existing [Filters](https://docs.fluentbit.io/manual/pipeline/filters) to run as processors. There are no specific changes needed; you simply use the filter name as if it were a native processor.
125+
You can configure existing [Filters](https://docs.fluentbit.io/manual/pipeline/filters) to run as processors. There are no specific changes needed; you use the filter name as if it were a native processor.
126126

127-
### Example of a Filter Running as a Processor
127+
### Example of a Filter running as a Processor
128128

129-
In the example below, the grep filter is used as a processor to filter log events based on a pattern:
129+
In the following example, the `grep` filter is used as a processor to filter log events based on a pattern:
130130

131131
```yaml
132132
parsers:

0 commit comments

Comments
 (0)