Binary data ingestion
#2807
Replies: 1 comment 1 reply
-
|
@vbhavsar , Thank you for putting this proposal in. Do you have any specific use-cases in mind? Are you looking for a different set of processors as well? Would Data Prepper be receiving these over HTTP or are you also looking for TCP messaging? |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
Hi @dlvenable. Thank you for responding. The use case I had in mind was for reading binary data from Kafka. It looks like there already is a Kafka plugin. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently, data-prepper is primarily focused on handling text-based formats. I would like to propose the expansion of data-prepper's capabilities to support binary data ingestion, specifically the inclusion of popular binary serialization formats such as Protocol Buffers (protobuf) and Apache Thrift.
This enhancement would open up new possibilities for building versatile data pipelines that can seamlessly integrate with diverse systems and applications.
Beta Was this translation helpful? Give feedback.
All reactions