Skip to content

[services, hailtop] shift supported python versions from 3.10-13 to 3.12-14 - #15603

Merged
hail-ci-robot merged 20 commits into
hail-is:mainfrom
cjllanwarne:cjl_python_version_bump
Aug 7, 2026
Merged

hail-ci-robot merged 20 commits into
hail-is:mainfrom
cjllanwarne:cjl_python_version_bump

Conversation

@cjllanwarne

@cjllanwarne cjllanwarne commented Jul 20, 2026 •

Copy link
Copy Markdown
Collaborator

Change Description

Updates the default python version to 3.12 and shifts the list of supported versions to 3.12, 3.13, 3.14 to realign with the numpy's supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to work ok with 3.12 and numpy support has already expired on 3.11.

Security Assessment

Delete all except the correct answer:

  • This change potentially impacts the Hail Batch instance as deployed by Broad Institute in GCP

Impact Rating

  • This change has a low security impact

Impact Description

Python version updates in services and client libraries.

Appsec Review

  • Required: The impact has been assessed and approved by appsec

@cjllanwarne
cjllanwarne requested a review from chrisvittal July 20, 2026 19:21
@cjllanwarne
cjllanwarne requested a review from a team as a code owner July 20, 2026 19:21

@chrisvittal chrisvittal left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we're dropping 3.11, you can change the lockfile generation to 3.12 and regenerate those too.

@cjllanwarne
cjllanwarne requested a review from chrisvittal July 23, 2026 18:43
@cjllanwarne
cjllanwarne dismissed chrisvittal’s stale review July 23, 2026 18:43

Nice catch, now updated

@sarahgibs sarahgibs left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you!

Comment thread hail/python/hail/__init__.py Resolved
@cjllanwarne cjllanwarne changed the title [services, hailtop] shift supported python versions from 3.10-13 to 3.12-14 [services, hailtop] shift supported python versions from 3.10-13 to 3.11-14 Jul 24, 2026
@cjllanwarne
cjllanwarne force-pushed the cjl_python_version_bump branch from 3e94794 to 5059cfd Compare July 30, 2026 19:34
@cjllanwarne
cjllanwarne force-pushed the cjl_python_version_bump branch from 8a80cae to 45f0ae4 Compare August 3, 2026 20:51
@cjllanwarne cjllanwarne changed the title [services, hailtop] shift supported python versions from 3.10-13 to 3.11-14 [services, hailtop] shift supported python versions from 3.10-13 to 3.12-14 Aug 4, 2026
@cjllanwarne
cjllanwarne requested a review from chrisvittal August 4, 2026 18:23
@cjllanwarne cjllanwarne added the WIP Blocks CI from merging this PR (but still runs test) label Aug 4, 2026

@chrisvittal chrisvittal left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Escaping changes look good. I caught 1 thing in the docs.

Comment thread dev-docs/python-version-bump.md Outdated

- **`hail/python/hail/__init__.py`** has a runtime `version_info < (3, XY)` guard at import time. It must match `python_requires` in `setup.py` / `setup-hailtop.py`. Easy to miss because it's in the package `__init__` rather than near any build or setup file.

- **EMR consideration**: EMR 7.x ships Python 3.11 and upgrades slowly. Before dropping 3.11 support in a future bump, check current EMR release notes — keeping a non-default 3.11 client image is low cost and avoids breaking EMR users.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is now out of date.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed, thank you! Now removed

@cjllanwarne cjllanwarne removed the WIP Blocks CI from merging this PR (but still runs test) label Aug 7, 2026
@hail-ci-robot
hail-ci-robot merged commit 8e0548c into hail-is:main Aug 7, 2026
15 checks passed
cjllanwarne added a commit that referenced this pull request Aug 10, 2026
…-13 to 3.12-14" (#15660)

Reverts #15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
ehigham pushed a commit to ehigham/hail that referenced this pull request Aug 12, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
….12-14 (hail-is#15603)

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [x] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
….12-14 (hail-is#15603)

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [x] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
….12-14 (hail-is#15603)

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [x] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
….12-14 (hail-is#15603)

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [x] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants