Bgd 5200 non root fluentbit sidecars

[Z4ck404]

• Use non root container images for telemetry fluent-bit sidecars.
• Use the version fluent-bit 3.0.5 bitnami non-root images

⚠️ Needs this PR to be merged and released first https://github.com/spotinst/bigdata-infrastructure/pull/479

Jira Ticket

https://spotinst.atlassian.net/browse/BGD-5200

Demo:

After applying the charts (see tests bellow), all components are running with the sidecars as non-root
kubectl get pods -o jsonpath="{range .items[*]}{'\n'}{.metadata.name}:{range .status.containerStatuses[*]}{'\n\t'}{.name}{'\t'}{.image}{'\t'}{.state}{end}{end}" -n spot-system

Tests

Before applying the charts bellow, set the the telemetry to true

  telemetry:
    enabled: true
    fluentbit:
      image:
        repository: public.ecr.aws/ocean-spark/fluent-bit
        tag: 3.0.5

Bigdata-noteboook-service

apply the charts to a running DP: helm upgrade bigdata-notebook-service-bdenv-v67 charts/bigdata-notebook-service -n spot-system --debug

The sidecar is running as non-root (version 3.0.5)

Bigdata-operator

spark-operator

• apply the charts : helm upgrade spark-operator-bdenv-v67 charts/spark-operator -n spot-system --debug

Bigdata-spark-watcher

• helm upgrade bigdata-spark-watcher-bdenv-v67 charts/bigdata-spark-watcher -n spot-system

Bigdata-proxy

helm upgrade bigdata-proxy-bdenv-v67 charts/bigdata-proxy -n spot-system

The logs from the sidecar :

The cluster is available ✅ :

Checklist:

• I have filled relevant self assessment (NodeJS, Frontend, Backend)

• I have run ESlint on my changes and fixed all warnings and errors (NodeJS & Frontend Services)

• My code follows the style guidelines of this project

• I have performed a self-review of my own code

• I have validated all the requirements in the Jira task were answered

• I have all neccessary approvals for the design/mini design of this task

• I have approved the API changes and granular permission patterns (documentation subtask) (For public services only)

[alextarasov-spot]

do we need to maintain the bigdata-notebook-service-storage-server since we disabled the component since the bdenv-v75?

[Z4ck404]

We don't need to.
I just wanted to fix all the charts 😅