Skip to content

Conversation

@robtandy
Copy link
Contributor

@robtandy robtandy commented Mar 5, 2025

Added CI github action to build python wheels.

You can see a successful run of this action here the source branch for this PR: https://github.com/robtandy/datafusion-ray/actions/runs/13680781621

In this PR, the build.yml github action will build wheels for:

  • macos aarch64
  • macos x86_64
  • manylinux x86_64
  • manylinux aarch64
  • source distribution

Notably missing here is a windows wheel. It should be addressed in a subsequent, in my opinion, PR as there is complexity around using the protobuf-src crate on the build machine as can be seen here: https://github.com/robtandy/datafusion-ray/actions/runs/13680113339/job/38250064986. I'm not sure if this should hold up the release, but i personally think no.

Structuring our developer workflow similar to datafusion-python has paid off as we were able to use a lot of their build.yml where the complexity came in was building for many linux and figuring out how to add a protobuf compiler into those cross comp docker images. Ultimately, it meant downloading and executing a release build of protoc.

It should address another of the items in the #2 checklist

Copy link
Member

@andygrove andygrove left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome work. Thank you @robtandy!

@robtandy
Copy link
Contributor Author

robtandy commented Mar 5, 2025

What are your thoughts on missing the windows wheel? I updated the comment to point to the trouble I had with it. Does this hold up 0.1.0 in your opinion?

@andygrove
Copy link
Member

What are your thoughts on missing the windows wheel? I updated the comment to point to the trouble I had with it. Does this hold up 0.1.0 in your opinion?

I don't think that lack of Windows support should hold up a 0.1.0 release.

@andygrove andygrove merged commit 6217cbe into apache:main Mar 5, 2025
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants