Skip to content

roachpb: deflake and unskip test make priority #110379

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 12, 2023

Conversation

kvoli
Copy link
Collaborator

@kvoli kvoli commented Sep 11, 2023

TestMakePriority was skipped in #110354 due to flakes. The test began
to flake after upgrading to go1.20 in #109773, as the global rand was
seeded differently.

Bump the number of trials from 100k to 750k in order to collect more
samples of the underlying distribution, which deflakes the test. This
doubles the average test time, from 200ms to 400ms on a GCP C2 instance.

Passes 50k runs:

dev test pkg/roachpb -f TestMakePriority -v --stress --count=50000
...
//pkg/roachpb:roachpb_test                             PASSED in 0.9s
Stats over 50000 runs: max = 0.9s, min = 0.3s, avg = 0.4s, dev = 0.0s

Fixes: #110303
Release note: None

@kvoli kvoli self-assigned this Sep 11, 2023
@cockroach-teamcity
Copy link
Member

This change is Reviewable

@kvoli kvoli force-pushed the 230911.deflake-make-priority branch from 9bec2d9 to 08518e6 Compare September 11, 2023 21:17
`TestMakePriority` was skipped in cockroachdb#110354 due to flakes. The test began
to flake after upgrading to `go1.20` in cockroachdb#109773, as the global rand was
seeded differently.

Bump the number of trials from 100k to 750k in order to collect more
samples of the underlying distribution, which deflakes the test. This
doubles the average test time, from 200ms to 400ms on a GCP C2 instance.

Passes 50k runs:

```
dev test pkg/roachpb -f TestMakePriority -v --stress --count=50000
...
//pkg/roachpb:roachpb_test                             PASSED in 0.9s
Stats over 50000 runs: max = 0.9s, min = 0.3s, avg = 0.4s, dev = 0.0s
```

Fixes: cockroachdb#110303
Release note: None
@kvoli kvoli force-pushed the 230911.deflake-make-priority branch from 08518e6 to ddf7669 Compare September 11, 2023 21:18
@kvoli kvoli marked this pull request as ready for review September 12, 2023 13:48
@kvoli kvoli requested a review from a team as a code owner September 12, 2023 13:48
Copy link
Collaborator

@arulajmani arulajmani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Solid deflaking! :lgtm:

Reviewed 2 of 2 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @nvanbenschoten)

Copy link
Contributor

@nvanbenschoten nvanbenschoten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 2 of 2 files at r1, all commit messages.
Reviewable status: :shipit: complete! 2 of 0 LGTMs obtained (waiting on @kvoli)

@kvoli
Copy link
Collaborator Author

kvoli commented Sep 12, 2023

TYFTR!

bors r=arulajmani,nvanbenschoten

@craig
Copy link
Contributor

craig bot commented Sep 12, 2023

Build succeeded:

@craig craig bot merged commit b99bcd9 into cockroachdb:master Sep 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

roachpb: TestMakePriority failed
4 participants