Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zero Buffer #5415

Open
MohammedAghil opened this issue Feb 5, 2025 · 0 comments
Open

Zero Buffer #5415

MohammedAghil opened this issue Feb 5, 2025 · 0 comments
Labels
enhancement New feature or request plugin - buffer A plugin for buffering incoming data untriaged

Comments

@MohammedAghil
Copy link

Is your feature request related to a problem? Please describe.
At present, The buffer implementations provide an asynchronous behavior, but there is a need to have a synchronous buffer mechanism to guaranteed immediate processing and direct synchronous flow of data from source to sink without buffering delays.
An example is Open Search API source where the data prepper events needs to be passed to in a synchronized way from source to sink.

Describe the solution you'd like

  • Provides synchronous, immediate pass-through behavior
  • Eliminates buffering delays by directly transferring data from write to read operations
  • Implements the Buffer interface to maintain compatibility with existing Data Prepper components

Additional context

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request plugin - buffer A plugin for buffering incoming data untriaged
Projects
Development

No branches or pull requests

2 participants