Skip to content

Cleanup prometheus metrics after Rebalancing #15

@marcosschroh

Description

@marcosschroh

Describe the bug
After a Rebalancing the StreamEngine could contain metrics of partitions that where assigned to other StreamEngine instances which are running in different node. We need to make sure that we clean the old metrics.

To Reproduce
Start with x amount of instances, scale up/down and the StreamEngine contains old metrics.

Solution

Use the ConsumerRebalanceListener to listen for Rebalancing events. We have an open PR on aiokafka to be able to create a consumer with a ConsumerRebalanceListener.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions