Skip to content

Add basic metrics to channels - #1207

Open
wence- wants to merge 3 commits into
rapidsai:mainfrom
wence-:wence/fea/1200
Open

Add basic metrics to channels#1207
wence- wants to merge 3 commits into
rapidsai:mainfrom
wence-:wence/fea/1200

Conversation

@wence-

@wence- wence- commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

This allows us to track message count and message volume.

By separating the send and receive side of the channel we can track if any message was spilled in the channel.

@wence- wence- added the improvement Improves an existing functionality label Sep 9, 2026
@wence-
wence- requested review from a team as code owners September 9, 2026 16:22
@wence- wence- added the non-breaking Introduces a non-breaking change label Sep 9, 2026

@TomAugspurger TomAugspurger left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks. Just a question on the names in the MetricsSnapshot but the proposed ones are fine too.

Comment thread cpp/include/rapidsmpf/streaming/core/channel.hpp
Comment thread cpp/include/rapidsmpf/streaming/core/channel.hpp
On send/receive the byte count of messages is recorded. These can be
obtained for inspection at a point in time by accessing the metrics() of a
channel.

@nirandaperera nirandaperera left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just some nitpiks

Comment thread python/rapidsmpf/rapidsmpf/streaming/core/channel.pyx
Comment thread cpp/tests/streaming/test_channel.cpp
Comment thread cpp/include/rapidsmpf/streaming/core/channel.hpp
@wence-

wence- commented Sep 9, 2026

Copy link
Copy Markdown
Contributor Author

/merge

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add monitoring hook to Channel.send / Channel.recv

3 participants