Skip to content

Conversation

@lsm5
Copy link
Member

@lsm5 lsm5 commented Jul 16, 2025

Please see individual commits.

@lsm5 lsm5 changed the title fixes to have test-*-local Makefile targets work locally fixes to have test-*-local Makefile targets work Jul 16, 2025
@lsm5
Copy link
Member Author

lsm5 commented Jul 16, 2025

Moving the TMT-independent stuff from #2640 here for easier review.

@lsm5 lsm5 marked this pull request as ready for review July 16, 2025 20:04
@lsm5
Copy link
Member Author

lsm5 commented Jul 16, 2025

@mtrmac @cevich PTAL. We need not be concerned with packit jobs here. There's already #2640 that rebases on this PR.

Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just an immediate skim, not nearly a review,

Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A full review now.

@lsm5 lsm5 marked this pull request as draft July 23, 2025 18:26
@github-actions
Copy link

A friendly reminder that this PR had no activity for 30 days.

@packit-as-a-service
Copy link

Tests failed. @containers/packit-build please check.

@lsm5 lsm5 force-pushed the ci-agnostic branch 3 times, most recently from a7f91f2 to e8a0b12 Compare August 25, 2025 19:25
@github-actions github-actions bot removed the stale-pr label Aug 26, 2025
@lsm5 lsm5 force-pushed the ci-agnostic branch 6 times, most recently from 23980b7 to e44f514 Compare August 27, 2025 12:53
@lsm5
Copy link
Member Author

lsm5 commented Aug 27, 2025

I've replaced hack/test-*.sh with inline execution in the Makefile itself. Also, made changes to TMT test setup to reuse Makefile targets, along with other TMT changes such that other locations where these tests need to be run can simply refer to the URL and git ref like so: https://src.fedoraproject.org/rpms/skopeo/pull-request/83#_1__4-5 . The downstream execution results are at: https://artifacts.dev.testing-farm.io/06cfb608-0277-42b3-a476-3c4848367914/

I'll make a followup PR for some other packit related changes to avoid overwriting the downstream changes and ensure the git refs are updated on every release.

@lsm5 lsm5 marked this pull request as ready for review August 27, 2025 13:00
@lsm5
Copy link
Member Author

lsm5 commented Aug 27, 2025

Btw, we will also be able to get rid of the skopeo-tests subpackage this way. To be done in followup.

@lsm5
Copy link
Member Author

lsm5 commented Aug 27, 2025

@mtrmac @cevich PTA(nother)L when you get the chance. Thanks!

@lsm5 lsm5 mentioned this pull request Aug 27, 2025
lsm5 added 4 commits August 29, 2025 08:46
This is required for fetching golangci-lint if it doesn't exist.

Signed-off-by: Lokesh Mandvekar <[email protected]>
Use inline script and get rid of hack/test-system.sh

Signed-off-by: Lokesh Mandvekar <[email protected]>
Get rid of hack/test-integration.sh

Signed-off-by: Lokesh Mandvekar <[email protected]>
Reuses Makefile logic and also prints SKOPEO_BINARY value

Signed-off-by: Lokesh Mandvekar <[email protected]>
Copy link
Contributor

@mtrmac mtrmac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

LGTM overall, feel free to merge — just noting some items that might be worth another look.

test-system-local: $(if $(SKOPEO_BINARY),,bin/skopeo)
hack/warn-destructive-tests.sh
hack/test-system.sh SKOPEO_LDFLAGS="$(SKOPEO_LDFLAGS)" BUILDTAGS="$(BUILDTAGS)"
@echo "Testing with $(or $(SKOPEO_BINARY),$(eval SKOPEO_BINARY := "bin/skopeo")$(SKOPEO_BINARY)) ..."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AFAICS this does not export SKOPEO_BINARY as an environment variable, so the eval only affects the printed path here. Was that intentional?

(In practice it ultimately works the same, systemtest/helpers.bash defaults to essentially $(pwd)/bin/skopeo anyway.)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this was only meant to echo SKOPEO_BINARY if it's set or just use the default bin/skopeo so we know which binary is actually being tested. We're setting SKOPEO_BINARY in the TMT tests.

# SKOPEO_CONTAINER_TESTS (for acceptability to do destructive modification) and !CI
# (for necessity to adjust for in-container operation)
if ((SKOPEO_CONTAINER_TESTS)) && [[ "$CI" != true ]]; then
if [[ -r /etc/containers/storage.conf ]]; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Non-blocking: I don’t know about anyone that uses this — so if we are giving up on the “container outside of CI” setup, perhaps we should also explicitly remove the test-system target (and all of check as well??).

Or is this being removed because you have determined it’s no longer necessary?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

True, make test-system will fail without this. So, I'd be in favour of getting rid of this and test-system, and maybe replace the targets in check with -local .

I'd also be in favour of doing the same for test-integration.

That saves us the burden of worrying about skopeo_ci_dev image maintenance too.

@lsm5
Copy link
Member Author

lsm5 commented Aug 29, 2025

Thanks!

LGTM overall, feel free to merge — just noting some items that might be worth another look.

Thanks, I'll need an approving review to go ahead with the merge. It's currently blocked for me.

@mtrmac mtrmac merged commit 1666b13 into containers:main Aug 29, 2025
26 checks passed
@lsm5 lsm5 deleted the ci-agnostic branch August 29, 2025 18:30
lsm5 added a commit that referenced this pull request Sep 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants