Skip to content

[infra] clean up cibuildwheel build #1599

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Feb 3, 2025

Conversation

kevinjqliu
Copy link
Contributor

@kevinjqliu kevinjqliu commented Feb 2, 2025

Removes `CIBW_TEST_EXTRAS: "s3fs,glue" since we dont need the extra dependencies for tests

Removes skipping MacOS build in CIBW_TEST_SKIP

Test run on fork of release candidate on https://github.com/kevinjqliu/iceberg-python/actions/runs/13117565428

# Ignore tests for pypy since not all dependencies are compiled for it
# and would require a local rust build chain
CIBW_TEST_SKIP: "pp* *macosx*"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! I also noticed this when reviewing #1391. Should we remove that one on main apart from this PR?? I think that would be something that we want to include in 0.9.0 anyway

Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As pointed out in the comment, I'm not sure if we only want to use uv for the building of the artifacts. Since we don't do releases every so often, I don't think the few minutes are that important. I'd much rather avoid breaking something by using different tooling.

@@ -147,23 +147,23 @@ jobs:
run: python3 -m poetry build --format=sdist
if: startsWith(matrix.os, 'ubuntu')

- uses: astral-sh/setup-uv@v4 # required to use `uv` in cibuildwheel

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm a bit reluctant to only use uv just for building the wheels. I'd be in favor of replacing Poetry with uv first and see if that's possible. I'm hearing a lot of good stuff about uv, bit some blogs also suggest that it is still lacking some functionality.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

backed out of the uv changes, i created #1602 so we can take a look in the future

@kevinjqliu kevinjqliu force-pushed the kevinjqliu/release-faster branch from d111cb6 to b4b9ba7 Compare February 3, 2025 15:56
@kevinjqliu kevinjqliu changed the title [infra] speed up artifact build with uv [infra] clean up cibuildwheel build Feb 3, 2025
@kevinjqliu kevinjqliu marked this pull request as ready for review February 3, 2025 16:03
@kevinjqliu kevinjqliu requested a review from Fokko February 3, 2025 16:08
@kevinjqliu
Copy link
Contributor Author

The test run looks good

Copy link
Contributor

@Fokko Fokko left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good, thanks @kevinjqliu for cleaning this up and running the test-run 👍

@@ -75,13 +75,10 @@ jobs:
CIBW_ARCHS: "auto64"
CIBW_PROJECT_REQUIRES_PYTHON: ">=3.9,<3.13"
CIBW_TEST_REQUIRES: "pytest==7.4.2 moto==5.0.1"
CIBW_TEST_EXTRAS: "s3fs,glue"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice, wasn't aware that we could drop those. Should speed it up also quite a bit 👍

@Fokko Fokko merged commit f195dad into apache:main Feb 3, 2025
2 checks passed
@kevinjqliu kevinjqliu deleted the kevinjqliu/release-faster branch February 3, 2025 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants