Skip to content

add a new blog: Fluent Bit Operator becomes an official sub-project of the Fluent Community #24

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 39 additions & 0 deletions _posts/2021-08-12-fluentbit-operator-becomes-sub-project.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
---
layout: post
title: "Fluent Bit Operator becomes an official sub-project of the Fluent Community!"
date: 2021-08-12
categories: cloudnative logging news
author: Feynman Zhou(https://github.com/FeynmanZhou)
---

# Fluent Bit Operator becomes an official sub-project of the Fluent Community!
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i think we also need to explain the motivations of the following:

  1. Fluent Bit / Fluentd are deployed a lot within Kubernetes
  2. The importance of Operators within Kubernetes, and how they help users
  3. Why we have added this project within the Fluent organization

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For 1 and 2, I can add more detailed explanations. For the third one, could you please also give one brief reason that why Fluent organization chose to accept Fluent Operator as a sub-project?


[Fluent Bit Operator](https://github.com/fluent/fluentbit-operator) is the only existing operator which facilitates the deployment of [Fluent Bit](https://fluentbit.io/) and provides great flexibility in building a logging layer based on Fluent Bit and Kubernetes. With a dedicated observability team at [KubeSphere](https://kubesphere.io) created this project, multiple maintainers from [DigitalOcean](https://www.digitalocean.com/) and other organizations have been maintaining it for almost three years and delivered 12 major releases, today we are glad to announce that Fluent Operator has become an official sub-project of the Fluent Community!

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would move the getting started piece up here as the main Call to Action

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree.

## Why Fluent Bit Operator

As the dynamic configuration reloading without restart is not supported in Fluent Bit and it [has been asked in the community](https://github.com/fluent/fluent-bit/issues/365) for several years, the KubeSphere team initiated the Fluent Bit Operator to enable Fluent Bit to pick up and use the latest config whenever the Fluent Bit config changes without restarting the Fluent Bit Pod.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

While the config reloading is important I really like the focus you have on the three bullets below. "The Fluent Bit Operator provides three main benefits..." from there I feel it would be good to eloborate on each one and mention some of the benefits over a traditional helm-chart / daemonset deployment

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good suggesion! I will elaborate on them.


As a Kubernetes-native solution for Fluent system, Fluent bit Operator gracefully solved the dynamic config reloading issue of Fluent Bit. This makes things easier to use Fluent Bit as a log collection agent in Kubernetes in a Kubernetes native way. Fluent Bit Operator bridges the gap between Fluent Bit and Kubernetes, it provides the following features:

- Fluent Bit Management: Deploy and destroy Fluent Bit DaemonSet automatically.
- Custom Configuration: Select input/filter/output plugins via labels.
- Dynamic Reloading: Update configuration without rebooting Fluent Bit pods.

![fluentbit-operator-workflow](/assets/img/blog/2021-08-12-fluentbit-operator/fluentbit-operator-workflow.png){:class="img-responsive"}

## Evolving to the Fluent Operator

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would also mention the metrics piece that was added in Fluent Bit and how that will be coming in the operator as well

Sometimes, Fluentd is still needed as an optional sink to aggregate logs received from Fluent Bit, then filter and forward logs to more destinations. So we are working with adding Fluentd CRDs to Fluent Bit Operator and [rename the project to Fluent Operator](https://github.com/fluent/fluentbit-operator/issues/68), it will help the Fluent Bit and Fluentd to establish a more powerful Kubernetes-native log processing pipeline.

You can check out the proposal of [adding Fluentd to Fluent Operator as an optional log aggregation and forwarding layer](https://hackmd.io/7-CCpsJDQ52hXtfBM6X30Q?view=) if you are interested in this evolution.

![fluent-operator](/assets/img/blog/2021-08-12-fluentbit-operator/fluent-operator.png){:class="img-responsive"}

## Embracing the Fluent community and global developers

Fluent Bit Operator is currently a vendor-neutral and 100% community-driven project. We truly believe that the active community engagement will result in significant improvements to Fluent Bit Operator, as well as the Fluent ecosystem itself.

You are welcome to create issues and pull requests. We are actively resolving community issues, host community meetings, and providing answers on a dedicated [Slack channel](https://fluent-all.slack.com/archives/C02642TE9HR).

If you still haven’t used Fluent Bit Operator, you’re welcome to try it now by following the [quick start](https://github.com/fluent/fluentbit-operator#install). Let's discover more simplicity of running Fluent Bit Operator on Kubernetes.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From comment above, I would move this part to right after the intro for a faster CTA and hopefully more conversion

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Make sense, I will move it to the first paragraph.

Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.