Skip to content

small perf improve in saturation analyzer - #608

Merged
ev-shindin merged 1 commit into
llm-d:mainfrom
biranofer:analizer-perf
Jan 21, 2026
Merged

small perf improve in saturation analyzer#608
ev-shindin merged 1 commit into
llm-d:mainfrom
biranofer:analizer-perf

Conversation

@biranofer

@biranofer biranofer commented Jan 20, 2026

Copy link
Copy Markdown
Collaborator

In saturation/analyzer.go in AnalyzeModelSaturation(), pass the computed nonSaturatedCount, AvgSpareKvCapacity, AvgSpareQueueLength into isScaleDownSafe(), from them it can compute the re-assignment of load w/o looping over all replicas again.

Related issue #607

@asm582

asm582 commented Jan 20, 2026

Copy link
Copy Markdown
Collaborator

/ok-to-test

@github-actions

Copy link
Copy Markdown
Contributor

🚀 E2E tests triggered by /ok-to-test

View the OpenShift E2E workflow run

@asm582

asm582 commented Jan 20, 2026

Copy link
Copy Markdown
Collaborator

@clubanderson, do we know why the OpenShift setup is failing?

@biranofer

Copy link
Copy Markdown
Collaborator Author

@clubanderson, do we know why the OpenShift setup is failing?

@asm582 I believe @ev-shindin is handling this in #610

@clubanderson

Copy link
Copy Markdown
Contributor

see #610 and #603 and #585

@ev-shindin

Copy link
Copy Markdown
Collaborator

/retest

@github-actions

Copy link
Copy Markdown
Contributor

🚀 E2E tests triggered by /retest

View the OpenShift E2E workflow run

@asm582 asm582 changed the title small perf improve in saturation analizer small perf improve in saturation analyzer Jan 20, 2026

@asm582 asm582 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@ev-shindin
ev-shindin merged commit aa48e6e into llm-d:main Jan 21, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants