Skip to content

Conversation

@bhearsum
Copy link
Contributor

At the moment, p50 pending for decision tasks on Try sits at 0s, while p95 ranges from 90s to 200s. The data shows that this is inversely correlated with the number of action tasks running (ie: p95 goes up when there are fewer action tasks). This makes sense, because they share this pool, and the action tasks are lower priority than decision tasks. This suggests to me that we may be able to reduce p95 for the decision tasks by having more workers always available.

Additionally:

  • Most hours of most days see more than 5 tasks per hour (with double and even triple digits being common at certain days/times)
  • The cost of this pool now is next to nothing (~$15 in the past week)

With all of this in mind, I'd like to try raising minCapacity to see if it will improve p95 pending.

image

At the moment, p50 pending for decision tasks on Try sits at 0s, while p95 ranges from 90s to 200s. The data shows that this is inversely correlated with the number of action tasks running (ie: p95 goes up when there are fewer action tasks). This makes sense, because they share this pool, and the action tasks are lower priority than decision tasks. This suggests to me that we may be able to reduce p95 for the decision tasks by having more workers always available.

Additionally:
* Most hours of most days see more than 5 tasks per hour (with double and even triple digits being common at certain days/times)
* The cost of this pool now is next to nothing (~$15 in the past week)

With all of this in mind, I'd like to try raising minCapacity to see if it will improve p95 pending.
@bhearsum bhearsum requested review from a team as code owners January 19, 2026 19:57
Copy link
Contributor

@jcristau jcristau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Worth a try.

@jcristau
Copy link
Contributor

the action tasks are lower priority than decision tasks

This doesn't match https://searchfox.org/firefox-main/rev/93aad2a6615f670b1279c229dd37f7397236131a/.taskcluster.yml#179-194?
decision tasks have lowest priority, while actions are very-low.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants