Merge branch 'master' into support-avro-date-values

Author: omwbennett

.github/CODEOWNERS

@@ -3,8 +3,8 @@
 .github/workflows/regression.yml @vectordotdev/vector @vectordotdev/single-machine-performance
 regression/config.yaml @vectordotdev/vector @vectordotdev/single-machine-performance
 
-docs/ @vectordotdev/vector @vectordotdev/ux-team @vectordotdev/documentation
-website/ @vectordotdev/vector @vectordotdev/ux-team
+docs/ @vectordotdev/vector @vectordotdev/documentation
+website/ @vectordotdev/vector
 website/content @vectordotdev/vector @vectordotdev/documentation
 website/cue/reference @vectordotdev/vector @vectordotdev/documentation
 

.github/ISSUE_TEMPLATE/minor-release.md

@@ -37,23 +37,24 @@ cargo vdev release prepare --version "${NEW_VECTOR_VERSION}" --vrl-version "${NE
 ```
 
 Automated steps include:
-- [ ] Create a new release branch from master to freeze commits
+
+- Create a new release branch from master to freeze commits
   - `git fetch && git checkout origin/master && git checkout -b "${RELEASE_BRANCH}" && git push -u`
-- [ ] Create a new release preparation branch from `master`
+- Create a new release preparation branch from `master`
   - `git checkout -b "${PREP_BRANCH}" && git push -u`
-- [ ] Pin VRL to latest released version rather than `main`
-- [ ] Check if there is a newer version of [Alpine](https://alpinelinux.org/releases/) or [Debian](https://www.debian.org/releases/) available to update the release images in
+- Pin VRL to latest released version rather than `main`
+- Check if there is a newer version of [Alpine](https://alpinelinux.org/releases/) or [Debian](https://www.debian.org/releases/) available to update the release images in
       `distribution/docker/`. Update if so.
-- [ ] Run `cargo vdev build release-cue` to generate a new cue file for the release
-  - [ ] Copy VRL changelogs from the VRL version in the last Vector release as a new changelog entry
+- Run `cargo vdev build release-cue` to generate a new cue file for the release
+  - Copy VRL changelogs from the VRL version in the last Vector release as a new changelog entry
         ([example](https://github.com/vectordotdev/vector/blob/9c67bba358195f5018febca2f228dfcb2be794b5/website/cue/reference/releases/0.41.0.cue#L33-L64))
-- [ ] Update version number in `website/cue/reference/administration/interfaces/kubectl.cue`
-- [ ] Update version number in `distribution/install.sh`
-- [ ] Add new version to `website/cue/reference/versions.cue`
-- [ ] Create new release md file by copying an existing one in `./website/content/en/releases/` and
+- Update version number in `website/cue/reference/administration/interfaces/kubectl.cue`
+- Update version number in `distribution/install.sh`
+- Add new version to `website/cue/reference/versions.cue`
+- Create new release md file by copying an existing one in `./website/content/en/releases/` and
       updating version number
-- [ ] Commit these changes
-- [ ] Open PR against the release branch (`"${RELEASE_BRANCH}"`) for review
+- Commit these changes
+- Open PR against the release branch (`"${RELEASE_BRANCH}"`) for review
 
 ## 3. Manual Steps
 
@@ -79,7 +80,7 @@ Automated steps include:
       - [ ] Squash the release preparation commits (but not the cherry-picked commits!) to a single
           commit. This makes it easier to cherry-pick to master after the release.
     - [ ] Merge release preparation branch into the release branch.
-        - `git switch "${RELEASE_BRANCH}" && git merge --ff-only "${PREP_BRANCH}"`
+      - `git switch "${RELEASE_BRANCH}" && git merge --ff-only "${PREP_BRANCH}"`
 
 - [ ] Tag new release
   - [ ] `git tag v"${NEW_VECTOR_VERSION}" -a -m v"${NEW_VECTOR_VERSION}"`
@@ -94,7 +95,7 @@ Automated steps include:
 - [ ] Release updated Helm chart. See [releasing Helm chart](https://github.com/vectordotdev/helm-charts/blob/develop/RELEASING.md).
 - [ ] Release Homebrew. Refer to the internal releasing doc.
 - [ ] Create internal Docker images. Refer to the internal releasing doc.
-- [ ] Update the latest [release tag](https://github.com/vectordotdev/vector/release) description with the release announcement.
+- [ ] Update the latest [release tag](https://github.com/vectordotdev/vector/releases) description with the release announcement.
 - [ ] Create a new PR with title starting as `chore(releasing):`
   - [ ] Cherry-pick any release commits from the release branch that are not on `master`, to `master`.
   - [ ] Run `cargo vdev build manifests` and commit changes.

.github/PULL_REQUEST_TEMPLATE.md

@@ -9,13 +9,15 @@ This should help the reviewers give feedback faster and with higher quality. -->
 <!-- Please describe how you tested your changes. Also include any information about your setup. -->
 
 ## Change Type
+
 - [ ] Bug fix
 - [ ] New feature
 - [ ] Dependencies
 - [ ] Non-functional (chore, refactoring, docs)
 - [ ] Performance
 
 ## Is this a breaking change?
+
 - [ ] Yes
 - [ ] No
 
@@ -36,6 +38,7 @@ Changes to CI, website, playground and similar are generally not considered user
 -->
 
 ## Notes
+
 - Please read our [Vector contributor resources](https://github.com/vectordotdev/vector/tree/master/docs#getting-started).
 - Do not hesitate to use `@vectordotdev/vector` to reach out to us regarding this PR.
 - Some CI checks run only after we manually approve them.
@@ -48,7 +51,7 @@ Changes to CI, website, playground and similar are generally not considered user
   - Feel free to push as many commits as you want. They will be squashed into one before merging.
   - For example, you can run `git merge origin master` and `git push`.
 - If this PR introduces changes Vector dependencies (modifies `Cargo.lock`), please
-  run `make build-licenses` to regenerate the [license inventory](https://github.com/vectordotdev/vrl/blob/main/LICENSE-3rdparty.csv) and commit the changes (if any). More details [here](https://crates.io/crates/dd-rust-license-tool).
+  run `make build-licenses` to regenerate the [license inventory](https://github.com/vectordotdev/vrl/blob/main/LICENSE-3rdparty.csv) and commit the changes (if any). More details on the [dd-rust-license-tool](https://crates.io/crates/dd-rust-license-tool).
 
 
 <!--

.github/SUPPORT.md

@@ -32,21 +32,21 @@ you are observing.
 
 Essential details to include:
 
-- Errors: for each error, please provide the full error message snippet, and
+* Errors: for each error, please provide the full error message snippet, and
   details such as where the error is observed, at what stage in the process
   (e.g. at boot time, after some specific condition etc.).
-- What is the version of Vector (and the Helm chart if deploying via Helm) and
+* What is the version of Vector (and the Helm chart if deploying via Helm) and
   the versions of any other systems in use (like Elasticsearch, NATS, etc.).
-- What is your Vector configuration. See the below section on [how to format
+* What is your Vector configuration. See the below section on [how to format
   your config](#formatting).
-- How are you [deploying](https://vector.dev/docs/setup/deployment/) Vector?
-- What is your complete deployment architecture? For example: I have Logstash
+* How are you [deploying](https://vector.dev/docs/setup/deployment/) Vector?
+* What is your complete deployment architecture? For example: I have Logstash
   agents sending to Vector over syslog that is being forwarded to Loki.
 
 Situation specific (not exhaustive):
 
-- Did it occur after upgrading to a new version of Vector?
-- Are you trying out Vector for the first time, or did you have a previous
+* Did it occur after upgrading to a new version of Vector?
+* Are you trying out Vector for the first time, or did you have a previous
   working configuration?
 
 These are just some examples of questions that may or may not apply to your

.github/actions/install-vdev/action.yml

@@ -20,7 +20,8 @@ runs:
       uses: actions/cache@cdf6c1fa76f9f475f3d7449005a359c84ca0f306 # v5.0.3
       with:
         path: ~/.cargo/bin/vdev
-        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'Cargo.toml', 'Cargo.lock') }}
+        # WARNING: this key need to be in sync with the key in .github/actions/setup/action.yml
+        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'lib/vector-vrl/**', 'Cargo.toml', 'Cargo.lock') }}
         restore-keys: |
           ${{ runner.os }}-vdev-
 
@@ -36,7 +37,8 @@ runs:
       uses: actions/cache/save@cdf6c1fa76f9f475f3d7449005a359c84ca0f306 # v5.0.3
       with:
         path: ~/.cargo/bin/vdev
-        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'Cargo.toml', 'Cargo.lock') }}
+        # WARNING: this key need to be in sync with the key in .github/actions/setup/action.yml
+        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'lib/vector-vrl/**', 'Cargo.toml', 'Cargo.lock') }}
 
     - name: Set VDEV environment variable
       shell: bash

.github/actions/setup/action.yml

@@ -58,6 +58,10 @@ inputs:
     required: false
     default: false
     description: "Install cargo-hack for feature compilation checks."
+  cargo-llvm-cov:
+    required: false
+    default: false
+    description: "Install cargo-llvm-cov for code coverage."
   dd-rust-license-tool:
     required: false
     default: false
@@ -72,10 +76,10 @@ inputs:
     description: "Install vdev CLI tool (cached by vdev/ directory changes)."
 
   # prepare.sh - npm
-  markdownlint:
+  markdownlint-cli2:
     required: false
     default: false
-    description: "Install markdownlint (npm)."
+    description: "Install markdownlint-cli2 (npm)."
   datadog-ci:
     required: false
     default: false
@@ -90,7 +94,8 @@ runs:
       uses: actions/cache@cdf6c1fa76f9f475f3d7449005a359c84ca0f306 # v5.0.3
       with:
         path: ~/.cargo/bin/vdev
-        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'Cargo.toml', 'Cargo.lock') }}
+        # WARNING: this key need to be in sync with the key in .github/actions/install-vdev/action.yml
+        key: ${{ runner.os }}-vdev-${{ hashFiles('vdev/**', 'lib/vector-vrl/**', 'Cargo.toml', 'Cargo.lock') }}
         restore-keys: |
           ${{ runner.os }}-vdev-
         lookup-only: true
@@ -110,6 +115,7 @@ runs:
                    "${{ inputs.cargo-deny }}" \
                    "${{ inputs.cargo-msrv }}" \
                    "${{ inputs.cargo-hack }}" \
+                   "${{ inputs.cargo-llvm-cov }}" \
                    "${{ inputs.dd-rust-license-tool }}" \
                    "${{ inputs.wasm-pack }}"; do
           if [[ "$val" == "true" ]]; then
@@ -181,7 +187,7 @@ runs:
         # We explicitly put `mold-wrapper.so` right beside `mold` itself because it's hard-coded to look in the same directory
         # first when trying to load the shared object, so we can dodge having to care about the "right" lib folder to put it in.
         TEMP=$(mktemp -d)
-        MOLD_VERSION=1.2.1
+        MOLD_VERSION=2.40.4
         MOLD_TARGET=mold-${MOLD_VERSION}-$(uname -m)-linux
         curl -fsSL "https://github.com/rui314/mold/releases/download/v${MOLD_VERSION}/${MOLD_TARGET}.tar.gz" \
         --output "$TEMP/${MOLD_TARGET}.tar.gz"
@@ -211,7 +217,7 @@ runs:
         EOF
 
     - name: Install protoc
-      if: ${{ inputs.protoc == 'true' }}
+      if: ${{ inputs.protoc == 'true' || env.VDEV_NEEDS_COMPILE == 'true' }}
       shell: bash
       run: |
         echo "Installing protoc"
@@ -258,9 +264,10 @@ runs:
           ~/.cargo/bin/cargo-deny
           ~/.cargo/bin/cargo-msrv
           ~/.cargo/bin/cargo-hack
+          ~/.cargo/bin/cargo-llvm-cov
           ~/.cargo/bin/dd-rust-license-tool
           ~/.cargo/bin/wasm-pack
-          /usr/local/bin/markdownlint
+          /usr/local/bin/markdownlint-cli2
           /usr/local/bin/datadog-ci
         key: ${{ runner.os }}-prepare-binaries-${{ hashFiles('scripts/environment/*') }}
         restore-keys: |
@@ -277,9 +284,10 @@ runs:
         [[ "${{ inputs.cargo-deny }}" == "true" ]] && mods+=("cargo-deny")
         [[ "${{ inputs.cargo-msrv }}" == "true" ]] && mods+=("cargo-msrv")
         [[ "${{ inputs.cargo-hack }}" == "true" ]] && mods+=("cargo-hack")
+        [[ "${{ inputs.cargo-llvm-cov }}" == "true" ]] && mods+=("cargo-llvm-cov")
         [[ "${{ inputs.dd-rust-license-tool }}" == "true" ]] && mods+=("dd-rust-license-tool")
         [[ "${{ inputs.wasm-pack }}" == "true" ]] && mods+=("wasm-pack")
-        [[ "${{ inputs.markdownlint }}" == "true" ]] && mods+=("markdownlint")
+        [[ "${{ inputs.markdownlint-cli2 }}" == "true" ]] && mods+=("markdownlint-cli2")
         [[ "${{ inputs.datadog-ci }}" == "true" ]] && mods+=("datadog-ci")
         csm=$(IFS=,; echo "${mods[*]}")
 

.github/actions/spelling/README.md

@@ -1,7 +1,7 @@
 # check-spelling/check-spelling configuration
 
 File | Purpose | Format | Info
--|-|-|-
+--- | --- | --- | ---
 [dictionary.txt](dictionary.txt) | Replacement dictionary (creating this file will override the default dictionary) | one word per line | [dictionary](https://github.com/check-spelling/check-spelling/wiki/Configuration#dictionary)
 [allow.txt](allow.txt) | Add words to the dictionary | one word per line (only letters and `'`s allowed) | [allow](https://github.com/check-spelling/check-spelling/wiki/Configuration#allow)
 [reject.txt](reject.txt) | Remove words from the dictionary (after allow) | grep pattern matching whole dictionary words | [reject](https://github.com/check-spelling/check-spelling/wiki/Configuration-Examples%3A-reject)

.github/actions/spelling/advice.md

@@ -10,6 +10,7 @@
 <details><summary>If flagged items are :exploding_head: false positives</summary>
 
 If items relate to a ...
+
 * binary file (or some other file you wouldn't want to check at all).
 
   Please add a file path to the `excludes.txt` file matching the containing file.

.github/actions/spelling/allow.txt

@@ -60,6 +60,7 @@ Bedove
 Benss
 bigendian
 bindir
+binstall
 binfmt
 bitcast
 bitcode
@@ -137,6 +138,7 @@ dsmith
 DVB
 ede
 emoji
+emojis
 emqx
 enableable
 Enot
@@ -145,7 +147,9 @@ EPC
 esbuild
 esensar
 etld
+eventcreate
 eventloop
+Evt
 Evercoss
 exactlyonce
 Explay
@@ -497,6 +501,7 @@ Telstra
 Tencent
 Texet
 Thl
+timediff
 timeframe
 timeseries
 timespan
@@ -557,4 +562,11 @@ zstandard
 ZTE
 Zync
 sighup
+CPPFLAGS
+LDFLAGS
+libsasl
+pkgconfig
 CLAUDE
+grpcurl
+linting
+lexers

.github/actions/spelling/expect.txt

@@ -170,11 +170,13 @@ duser
 dynamicwireless
 dyno
 ebfcee
+ector
 edenhill
 edns
 eeyun
 efgh
 Elhage
+elopment
 emerg
 endianess
 endler
@@ -646,6 +648,7 @@ wayfor
 wday
 webgraphviz
 websites
+websockets
 wensite
 whostheboss
 willreturn