Update to upstream tag v0.50.0 #233
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Rename base->generated * Fix references
…#18785) * Update replace.cue updating the example for the capture group name in the example to use $$num instead of $num as single $ does not work. Also need to provide more description on the Note. "Note that $foo is interpreted in a Vector configuration file, instead use $$foo." This isn't clear, and not sure what it means. * Update replace.cue Added additional example for Replace with capture group to give an example of calling capture groups in a configuration file and outside a configuration file so it is clear. * Update website/cue/reference/remap/functions/replace.cue * Update website/cue/reference/remap/functions/replace.cue Co-authored-by: May Lee <[email protected]> * Update website/cue/reference/remap/functions/replace.cue Co-authored-by: May Lee <[email protected]> * test case fix * cue fmt --------- Co-authored-by: Jesse Szwedko <[email protected]> Co-authored-by: May Lee <[email protected]> Co-authored-by: Pavlos Rontidis <[email protected]>
* fix(ci): attempt to enable splunk ITs * sort
…otdev#22764) * feat(sink: clickhouse): add query_settings option to clickhouse sink * Rename query settings struct * config UX improvements * Update changelog.d/22764_clickhouse_query_settings.feature.md * Fix spelling * cargo fmt * regen docs --------- Co-authored-by: Pavlos Rontidis <[email protected]> Co-authored-by: Thomas <[email protected]>
* Update VRL * Add interval_ms to get funcs * Refactor code to remove duplication * Revert "Update VRL" This reverts commit 4667fc9. * Update VRL's main branch * Add changelog * Update changelog.d/23361_interval_ms_redeable.fix.md * Update changelog.d/23361_interval_ms_redeable.fix.md Co-authored-by: Pavlos Rontidis <[email protected]> * Move structs to before statments (clippy) * cargo vdev build licenses * Fix typo in filename --------- Co-authored-by: Pavlos Rontidis <[email protected]>
…in a newline (vectordotdev#21097) * fix(codecs): Ensure that batches using newline delimited framing end in a newline Fixes: vectordotdev#21086 Signed-off-by: Jesse Szwedko <[email protected]> * Update tests and handle empty batches Signed-off-by: Jesse Szwedko <[email protected]> * fix changelog --------- Signed-off-by: Jesse Szwedko <[email protected]> Co-authored-by: Pavlos Rontidis <[email protected]>
…ebsite in the npm_and_yarn group (vectordotdev#23372) chore(website deps): Bump brace-expansion Bumps the npm_and_yarn group in /website with 1 update: [brace-expansion](https://github.com/juliangruber/brace-expansion). Updates `brace-expansion` from 1.1.11 to 1.1.12 - [Release notes](https://github.com/juliangruber/brace-expansion/releases) - [Commits](juliangruber/brace-expansion@1.1.11...v1.1.12) --- updated-dependencies: - dependency-name: brace-expansion dependency-version: 1.1.12 dependency-type: indirect dependency-group: npm_and_yarn ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* feat: templateable http uri * test: add test for templatable uri * test: add tests for templatable uri * feat: fast committed * feat: fast committed * feat: fast committed * feat: fast committed * feat: fast committed * revert: concurrent map fix * chore: update changelog * refactor: batch config * refactor: move create_events utility to test_util * test: update batch nofitier handling * refactor: new run_and_assert_sink_error_with_events utility function * refactor: new run_and_assert_sink_error_with_events utility function * refactor: new run_and_assert_sink_error_with_events utility function * clippy fixes * fix: clippy lints * chore: make generate-component-docs * make generate-component-docs --------- Co-authored-by: Pavlos Rontidis <[email protected]>
…retry (vectordotdev#23206) * Added ability to force the aws_s3 sink to retry failed requests on all errors. Added retry_all_errors to S3SinkConfig and S3RetryLogic structs. Setting retry_all_errors to the default value in the generate_config function. Added self.retry_all_errors to the condition in the is_retriable_error function. (vectordotdev#10870) * Added errors_to_retry field to S3SinkConfig as an Option<Vec<String>>. Changed retry_all_errors to Option<bool>. * Changed errors_to_retry from Option<Vec<String>> to Option<Vec<u16>>. Added configured_to_retry and check_response functions to s3_common/config.rs. Added configured_to_retry call to is_retriable_error result in RetryLogic. (vectordotdev#10870) * Moved retry_all_errors and errors_to_retry into S3RetryLogic struct and replaced them with retry_logic in S3SinkConfig. (vectordotdev#10870) * Added retry_logic to s3_flush_on_exhaustion integration test. (vectordotdev#10870) * Fixed format and build issues in s3_common/config.rs. (vectordotdev#10870) * Fixed panic error if retry_logic is None in sinks/aws_s3/config.rs. (vectordotdev#10870) * Changed build_processor function to call unwrap_or_default on retry_logic rather than unwrap_or. (vectordotdev#10870) * Fixed formatting issue in build_processor function. (vectordotdev#10870) * Updated docs for retry_logic. (vectordotdev#10870) * Added changelog fragment. (vectordotdev#10870) * Fixed documentation note for S3RetryLogic. (vectordotdev#10870) * Updated component docs. (vectordotdev#10870) * Updated the feature authors list for the changelog. (vectordotdev#10870) * Increased the version in Cargo.toml. (vectordotdev#10870) * Adjusted wording in documentation comments for S3RetryLogic and retry_logic trait in S3SinkConfig. (vectordotdev#10870) * Reverted vector version change in Cargo.toml. Adjusted wording in documentation comment for errors_to_retry. (vectordotdev#10870) * Updated autogenerated documentation for aws_s3. (vectordotdev#10870) * Changed configred_to_retry to should_retry_error and changed check_response to is_retriable_response. (vectordotdev#10870) * Replaced RetryLogic struct with RetryStrategy enum. (vectordotdev#10870) * Fixed formatting issue in sinks/aws_s3/config.rs. (vectordotdev#10870) * Replaced retry_logic with retry_strategy sinks/aws_s3/integration_tests.rs. (vectordotdev#10870) * Added jimmystewpot to allow.txt to fix spellcheck fail. (vectordotdev#10870) * Changed retry_strategy options to snake_case in the config file. (vectordotdev#10870) * Updated component docs for snake-case retry_strategy config options. (vectordotdev#10870) * Upped indicatif version to fix build error from previous version being yanked. (vectordotdev#10870) * Regenerated license file. (vectordotdev#10870) * Changed WriteToken to pass by reference in recover_archived_record to fix a clippy error. (vectordotdev#10870) * Pull in Cargo.toml/Cargo.lock from master * Pull in LICENSE-3rdparty.csv from master * Pull in Cargo.lock * Pull in Cargo.lock from master * Pull in vdev/Cargo.toml from master * Added "interpreting" spelling/expect.txt to fix spell check failing. (vectordotdev#10870) * Removed interpreting from expect.txt. Changed interepreting to interpreting in replace.cue. (vectordotdev#10870) * fix and improve RetryStrategy enum * Fixed formatting errors in aws_s3/config.rs and s3_common/config.rs. Changed documentation comments explain that retry_strategy settings extend, not override, default retry behavior for the sink. (vectordotdev#10870) * Update .github/actions/spelling/allow.txt --------- Co-authored-by: Thomas <[email protected]> Co-authored-by: Pavlos Rontidis <[email protected]> Co-authored-by: Thomas <[email protected]>
…ectordotdev#23330) * New interface around buffers to select impl at runtime * Expose a non-fixed sized queue in vector-buffers * Modifications to make max_bytes configurable * Modify Sample to test limiting behavior on bytes allocated * Unit test for semaphore guarding SeqQueue * Include new SegQueue in buffering benchmarks * Generated documentation updates * Add changelog fragment * Implement QueueImpl trait directly on crossbeam queue types * Add helper method to reduce terseness * Convert config to flat layout * Modify MemoryBufferSize to be a tuple variant - Also removing its configurable_component tag as it is no longer officially part of the configuration * Update error message * Prefer size_of over magic numbers * Remove stray comment * Revert test behavior to use arbitrary u16s * Update documentation * Addressing some comments - Replace if let chain with match expression - Replace map/sum with just calls to + - Replace function pointer in limited_queue.rs with enum + variant check * Revert "Modify MemoryBufferSize to be a tuple variant" - Previous commit hash: f87aeab0 * Revert "Config config to flat layout" - Previous commit hash: 4354874 * Fix config bug where flatten option isn't respected for variants * Rename MemoryBufferSize variant options - This makes the options more consistent with the existing ones like max_size * Add unit test for parsing memory buffer config w/ byte_size * Update doc comments * Update generated documentation * Fix bug in config generator with flattening enum values - When the flatten attribute was applied to a variant it would not be respected in the generated output * Modify MemoryBufferSize to be a tuple variant * Updating generated documentation * Remove unnecessary serde attribute * Move MaxSizes configurable attribute within the tuple - This correctly identifies the attributes as having the bytes unit type * Modify _heap_allocated to be a heap allocated array - Since the size is fixed and known at compile time this type is a better fit here then Vec --------- Co-authored-by: Pavlos Rontidis <[email protected]>
…otdev#23371) * Fix tags with multi_value_tags * Add changelog * Simplify tag getter by splitting into multiple fns * Fix clippy warning * Inline tags_getter * Remove useless metric.series access
* chore(deps): Bump sysinfo from 0.34.2 to 0.35.1 Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.34.2 to 0.35.1. - [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md) - [Commits](https://github.com/GuillaumeGomez/sysinfo/commits/v0.35.1) --- updated-dependencies: - dependency-name: sysinfo dependency-version: 0.35.1 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> * cargo vdev build licenses --------- Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Thomas <[email protected]>
* fix(ci): checkout changelog script from master * Add debug statement * Add pull_request to test modified workflow * Revert "Add pull_request to test modified workflow" + "Add debug statement" * Change ref to master * Re-add debug * Remove debug This reverts commit 02a67c4. * Remove whitespace
…sed (vectordotdev#23367) * chore: fix opensearch credentials provided in uri not used When opensearch credentials are provide in the URI, there are not used. They are not used because the config parser ignore the credentials extracted from the URI. This PR fixes that and add some tests to catch that behavior. * doc: document elasticsearch authenticated url behavior * Update src/sinks/elasticsearch/config.rs Co-authored-by: Pavlos Rontidis <[email protected]> * doc: update document elasticsearch authenticated url behavior --------- Co-authored-by: Pavlos Rontidis <[email protected]>
…layground Website (vectordotdev#23343) * Add Time Elapsed and Timezone Option * Use default tz by default. Safely handle error if no performance timing. * Make tz_str Optional. * cargo fmt * Changed 'took' to 'Duration: '. Changed 'TZ' to 'Select Timezone'. Changed position of elapsed time element to code section. * Remove default value to fix suggestion. * Readded default value. --------- Co-authored-by: forkingfrenzy <forkingfrenzy@local> Co-authored-by: Thomas <[email protected]>
…rdotdev#23387) * Allow strftime in UnsignedIntTemplates * Add changelog fragment * spelling * add newline to changelog * better event path usage --------- Co-authored-by: Pavlos Rontidis <[email protected]>
* cargo clippy --all --fix --allow-dirty * rust 1.88 - prep * remove obsolete clippy.toml setting * ran cargo fmt * clippy fix * Update vdev/src/commands/info.rs Co-authored-by: Thomas <[email protected]> * Update vdev/src/commands/info.rs Co-authored-by: Thomas <[email protected]> * cargo clippy --all-targets --all-features --fix * ran cargo fmt * more auto-fixes * replace depracted all function * unix auto fixes --------- Co-authored-by: Thomas <[email protected]>
* feat(ci): split up test.yml * Change path and chmod * Install deps * Use sudo to install protoc * Add wasm-pack to vrl playground job * Install nextest * Install missing libsals2 in jobs * Install protoc for unit and component spec * Bootstrap only in component docs job * Bootstrap ubuntu for unit tests * Remove unecessary libsasl2-dev * Remove rustup relative path * Revert vdev caching * Update vdev/README.md * Fix wrong cue vdev matcher * Remove cargo cache and add rust matcher * Fix markdown check * Bootstrap ubuntu in cue docs * Remove all-checks job * debug Revert "Bootstrap ubuntu in cue docs" This reverts commit 01d7d89. * Re-add reverted "Bootstrap ubuntu in cue docs" This reverts commit cc498fc. * Re-add all-checks job to satisfy branch protection rules
* fix(ci): pass in GITHUB_TOKEN to bypass rate limits * Add temp test file * Make token read only * Remove temp test file
* chore(dev): switch to 2024 edition * auto fixes and one manual fix in benches * cargo fmt --all * rename to avoid reserved words * ran cargo fmt
…ectordotdev#23397) * chore(ci): merge test/test-component-validation and upload results * Delete removed test-component-validation
* fix(elasticsearch sink): add _ assignment to unused var for feature * Use cfg_attr instead
…ectordotdev#23399) * chore(codecs): Compare correct decoded byte size in Validator tests - The byte size of the decoded frame was used in *received_bytes_total calculations when instead total size of payload on the wire is desired for comparison against the matching telemetry metric. * Remove stray dbg * Adding comment
…he npm_and_yarn group across 1 directory (vectordotdev#23768) chore(website deps): Bump axios Bumps the npm_and_yarn group with 1 update in the /website directory: [axios](https://github.com/axios/axios). Updates `axios` from 1.8.2 to 1.12.0 - [Release notes](https://github.com/axios/axios/releases) - [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md) - [Commits](axios/axios@v1.8.2...v1.12.0) --- updated-dependencies: - dependency-name: axios dependency-version: 1.12.0 dependency-type: indirect dependency-group: npm_and_yarn ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…ctordotdev#23770) * fix(ci): proper rustup and toolchain installation in 'prepare.sh' * final fixes
…ectordotdev#23560) * Force compression to be disabled in HEC indexer ack queries * Add changelog fragment * Add future work issue link comment * cargo fmt again --------- Co-authored-by: Pavlos Rontidis <[email protected]>
…artifact group (vectordotdev#23700) chore(ci): Bump actions/download-artifact in the artifact group Bumps the artifact group with 1 update: [actions/download-artifact](https://github.com/actions/download-artifact). Updates `actions/download-artifact` from 4.3.0 to 5.0.0 - [Release notes](https://github.com/actions/download-artifact/releases) - [Commits](actions/download-artifact@d3f86a1...634f93c) --- updated-dependencies: - dependency-name: actions/download-artifact dependency-version: 5.0.0 dependency-type: direct:production update-type: version-update:semver-major dependency-group: artifact ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* chore(vrl playground): improve output * ran cargo fmt * refactor
vectordotdev#23780) * fix: partial_cmp used in sort functions causing panics * Add changelog * Add authors to changelog * Use sort_unstable_by * Make tests use iterators * Fix changelog wording * Rename float -> to_float * Fix -> Fixed
…namespaces (vectordotdev#23601) * Add a config flag to allow not listwatching namespaces The namespaces cache will be an empty store in this case. Down the line all of the code _should_ just work for instance emitting an error log if you try to access namespace labels. * Add some tests for this feature * Fix formatting * Update docs * Add changelog fragment * Improve docs * Fix stray newline in changelog * Fix unrecognized-spelling * Thread through removal of namespace fields to more places * Apply docs suggestions from code review Co-authored-by: Rosa Trieu <[email protected]> * Apply suggestions from code review Co-authored-by: Pavlos Rontidis <[email protected]> * Clean up after fixes * Fix the fix of formatting * Re-generate docs * Collapse some ifs like clippy wants * Do it in a way supported by 2024 edition * Add generated docs again --------- Co-authored-by: Rosa Trieu <[email protected]> Co-authored-by: Pavlos Rontidis <[email protected]>
…ev#23792) fix `parse_nginx_log` docs rendering
…le (vectordotdev#23617) * fix panic in disk buffer when dealing with corrupted file * Allow clippy too many lines in test * cargo fmt * simplify test * Update changelog.d/disk_buffer_panic_if_corrupted_file.fix.md --------- Co-authored-by: Thomas <[email protected]> Co-authored-by: Pavlos Rontidis <[email protected]>
…eport (vectordotdev#23791) * Issue-23790: fix duration subtraction overflow in TimingStats::report Addressing issue [23790](vectordotdev#23790) Use saturating_sub and consistent total duration to avoid crash when segment timings exceed total elapsed time. * perf(file source): skip timing calculations when debug logging disabled Add early return in TimingStats::report() to avoid unnecessary calculations when DEBUG level is not enabled. * Update lib/file-source/src/file_server.rs * Add changelog * Update changelog.d/23790_fix_duration_subtraction_overflow.md Co-authored-by: Pavlos Rontidis <[email protected]> * Rename 23790_fix_duration_subtraction_overflow.md to 23790_fix_duration_subtraction_overflow.fix.md --------- Co-authored-by: Pavlos Rontidis <[email protected]>
vectordotdev#23774) * feat(prometheus_remote_write source): Add optional NaN value filtering - Add skip_nan_values configuration option (defaults to false) - Filter NaN samples for counters and gauges individually - Filter entire histograms/summaries if sum or component values contain NaN - Add comprehensive unit and integration tests for NaN filtering - Maintain backward compatibility with default behavior * cargo fmt * cleanup tests * ran cargo fmt * dry * rm unrelated test * make generate-component-docs --------- Co-authored-by: Pavlos Rontidis <[email protected]>
* docs(vrl): add documentation for IPCrypt functions Add documentation for the new `encrypt_ip` and `decrypt_ip` VRL functions that implement format-preserving encryption for IP addresses. These functions support two modes: - AES128: Scrambles entire IP address using AES-128 encryption - PFX: Prefix-preserving mode that maintains network hierarchy The functions implement the `ipcrypt-deterministic` and `ipcrypt-pfx` algorithms from the IPCrypt specification. Related PR: vectordotdev/vrl#1506 * Add newlines * update licenses * update vrl del and rebuild licenses --------- Co-authored-by: Pavlos Rontidis <[email protected]>
* fix(aws_s3 sink): fix default retry strategy * fmt * add known issue and workaround * Update src/sinks/s3_common/config.rs Co-authored-by: Thomas <[email protected]> * fix indentation * update cue docs --------- Co-authored-by: Thomas <[email protected]>
…res (vectordotdev#23733) * feat(aws_kinesis_streams sink): Retry only failed records on partial failures * Address code review comments * Resolve merge conflicts * remove unused import * clippy allow print in tests * Remove extra empty line * Remove println in tests * clippy --------- Co-authored-by: Pavlos Rontidis <[email protected]>
* chore(ci): publish dev environment weekly * rmv test-environment
* Proof of concept for chunking GELF encoding * Cleanup * Emit proper error and trace log * Chunk based on encoding format * Add configuration for gelf chunk size * Chunker is a property of the Serializer * Move in chunker with GELF * Revert "Move in chunker with GELF" This reverts commit 3a5712f. * Add tests to chunker * Rename trait to Chunking and enum to Chunker; replace Noop chunker with None * Remove vec allocation when not chunking * Move GELF chunker into its own file * Update docs * Docs * Update website docs * Add changelog.d entry * Test for large chunking/max chunk size * nit: early return when chunking is not necessary * nit: moved/renamed DatagramChunkingError to UdpChunkingError * docs: update changelog with event finalizer fix * Update changelog.d/event_finalizer_error_udp.fix.md * formatting & clippy --------- Co-authored-by: Pavlos Rontidis <[email protected]>
* chore(vdev): release prep skip vdev tags * ran cargo fmt * also update generate-release-cue.rb
* chore(releasing): Pinned VRL version to 0.27.0 * chore(releasing): Generated release CUE file * chore(releasing): Updated website/cue/reference/administration/interfaces/kubectl.cue vector version to 0.50.0 * chore(releasing): Updated distribution/install.sh vector version to 0.50.0 * chore(releasing): Add 0.50.0 to versions.cue * chore(releasing): Created release md file * bump alpine to 3.22 * replace revert with fix - need to support this properly in the future * allow new words/names * fmt fixes * Try to remove new authors from allow.txt * release description and highlights TODO * highlights, breaking changes, fixes * typo * minor improvements * Update website/cue/reference/releases/0.50.0.cue Co-authored-by: Thomas <[email protected]> * Update website/cue/reference/releases/0.50.0.cue Co-authored-by: Thomas <[email protected]> * chore(website): improve indexing for memory table docs (vectordotdev#23827) * chore(website): improve indexing for memory table docs * add table * add highlight for OTLP * fix date * add known issue note --------- Co-authored-by: Thomas <[email protected]>
* chore(dev): update environment image * ran cargo fmt
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: vparfonov The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
46 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.