You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/api-reference/enrichment-components/configuration-reference/index.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -93,16 +93,19 @@ A minimal configuration file can be found on the [Github repo](https://github.co
93
93
|`output.good.throttledBackoffPolicy.maxBackoff` (since *6.0.0*) | Optional. Default: `1 second`. Maximum backoff before retrying when writing fails with exceeded kinesis write throughput. |
94
94
|`output.good.recordLimit`| Optional. Default: `500`. Maximum allowed to records we are allowed to send to Kinesis in 1 PutRecords request. |
95
95
|`output.good.byteLimit`| Optional. Default: `5242880`. Maximum allowed to bytes we are allowed to send to Kinesis in 1 PutRecords request. |
96
+
|`output.good.maxRetries` (since *6.3.0*) | Optional. Default: `10`. Maximum number of retries by Kinesis Client. |
96
97
|`output.failed.streamName`| Required. E.g. `failed`. Name of the Kinesis stream that will receive the failed events (same format as the enriched events). |
97
98
|`output.failed.throttledBackoffPolicy.minBackoff` (since *6.0.0*) | Same as `output.good.throttledBackoffPolicy.minBackoff` for failed events. |
98
99
|`output.failed.throttledBackoffPolicy.maxBackoff` (since *6.0.0*) | Same as `output.good.throttledBackoffPolicy.maxBackoff` for failed events. |
99
100
|`output.failed.recordLimit`| Same as `output.good.recordLimit` for failed events. |
100
101
|`output.failed.byteLimit`| Same as `output.good.byteLimit` for failed events. |
102
+
|`output.failed.maxRetries`| Same as `output.good.maxRetries` for failed events. |
101
103
|`output.bad.streamName`| Required. E.g. `bad`. Name of the Kinesis stream that will receive the failed events in the "bad row" format (JSON). |
102
104
|`output.bad.throttledBackoffPolicy.minBackoff` (since *6.0.0*) | Same as `output.good.throttledBackoffPolicy.minBackoff` for failed events in the "bad row" format (JSON). |
103
105
|`output.bad.throttledBackoffPolicy.maxBackoff` (since *6.0.0*) | Same as `output.good.throttledBackoffPolicy.maxBackoff` for failed events in the "bad row" format (JSON). |
104
106
|`output.bad.recordLimit`| Same as `output.good.recordLimit` for failed events in the "bad row" format (JSON). |
105
107
|`output.bad.byteLimit`| Same as `output.good.byteLimit` for failed events in the "bad row" format (JSON). |
108
+
|`output.bad.maxRetries`| Same as `output.good.maxRetries` for failed events in the "bad row" format (JSON). |
106
109
107
110
## enrich-kafka
108
111
@@ -113,6 +116,7 @@ A minimal configuration file can be found on the [Github repo](https://github.co
113
116
|`input.topicName`| Required. Name of the Kafka topic to read collector payloads from. |
114
117
|`input.bootstrapServers`| Required. A list of `host:port` pairs to use for establishing the initial connection to the Kafka cluster |
115
118
|`input.debounceCommitOffsets` (since *6.0.0*) | Optional. Default: `10 seconds`. How frequently to commit our progress back to kafka. By increasing this value, we decrease the number of requests made to the kafka broker. |
119
+
|`input.commitTimeout` (since *6.3.0*) | Optional. Default: `15 seconds`. The time to wait for offset commits to complete. If an offset commit doesn't complete within this time, a CommitTimeoutException will be raised instead. |
116
120
|`input.consumerConf`| Optional. Kafka consumer configuration. See [the docs](https://kafka.apache.org/documentation/#consumerconfigs) for all properties. |
117
121
|`output.good.topicName`| Required. Name of the Kafka topic to write to |
118
122
|`output.good.bootstrapServers`| Required. A list of host:port pairs to use for establishing the initial connection to the Kafka cluster |
0 commit comments