Upload evergreen test results to codecov.io #1736
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## v2.x #1736 +/- ##
=========================================
Coverage 87.54% 87.54%
Complexity 3182 3182
=========================================
Files 423 423
Lines 6336 6336
=========================================
Hits 5547 5547
Misses 789 789
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
alcaeus
force-pushed
the
evergreen-codecov-test-upload
branch
from
3a4b6e4 to
9ad2fff
Compare
.evergreen/config/functions.yml
Outdated
| working_dir: src | ||
| script: | | ||
| ${PREPARE_SHELL} | ||
| curl -Os https://cli.codecov.io/latest/linux/codecov |
There was a problem hiding this comment.
Since this isn't be pulled from a repository, it'd be prudent to integrity check the binary. I noted this didn't apply to the earlier GitHub Action integration (ae31f00) since you just reference their action (codecov/test-results-action).
There was a problem hiding this comment.
Added the shasum check for the time being. I can add the gpg signature check for the checksum file as well, but with evergreen sharing hosts between runs I'm not sure if we should be messing with the keychain.
.evergreen/config/functions.yml
Outdated
| printf "\n" >> mo-expansion.yml | ||
| printf "MONGODB_VERSION: '%s'\n" "${MONGODB_VERSION}" >> mo-expansion.yml | ||
| printf "TOPOLOGY: '%s'\n" "${TOPOLOGY}" >> mo-expansion.yml | ||
| cat mo-expansion.yml |
There was a problem hiding this comment.
Why was this necessary? $MONGODB_VERSION and $TOPOLOGY should already be available in the environment, since they're referenced in the previous shell.exec command. The inclusion of cat here also looks like it may be leftover debugging.
Based on the comment below, expansions.update was only necessary to add
MONGODB_URI and CRYPT_SHARED_LIB_PATH, which are written in drivers_orchestration.py.
There was a problem hiding this comment.
MONGODB_VERSION and TOPOLOGY are passed as variables to the bootstrap mongo-orchestration function only, so they are no longer available later in the run. Adding them to the expansion file created by the script allows us to reuse the values later.
| --report-type test_results \ | ||
| --disable-search \ | ||
| --fail-on-error \ | ||
| --token ${CODECOV_TOKEN} \ |
There was a problem hiding this comment.
Does this reference a variable from the Evergreen project config? I didn't see this when taking a look at the PHPLIB 2.x project settings.
There was a problem hiding this comment.
For some reason uploading the test result file worked even without a token. I have added it to the repo variables nonetheless.
In order to better use the flaky test feature of codecov.io, this PR adds a step to upload the test result file to codecov.io, as is already done for GitHub Actions.