Skip to content

[services, hailtop] Revert "shift supported python versions from 3.10-13 to 3.12-14" - #15660

Merged
cjllanwarne merged 1 commit into
mainfrom
revert-15603-cjl_python_version_bump
Aug 10, 2026
Merged

cjllanwarne merged 1 commit into
mainfrom
revert-15603-cjl_python_version_bump

Conversation

@cjllanwarne

Copy link
Copy Markdown
Collaborator

Reverts #15603

We need 3.11 to support our current dataproc (and spark) version.

I will follow up with a PR to do 90% of this again, but keeping 3.11 for now.

@cjllanwarne
cjllanwarne requested a review from ehigham August 10, 2026 14:56
@cjllanwarne
cjllanwarne requested a review from a team as a code owner August 10, 2026 14:56
Comment on lines +62 to 65
if major_version != 3 or minor_version < 9:
raise ValueError(
f'Python versions older than 3.12 (you are using {major_version}.{minor_version}) are not supported'
f'Python versions older than 3.9 (you are using {major_version}.{minor_version}) are not supported'
)

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Inconsistency between minimum Python version checks. This file now requires Python 3.9+ (minor_version < 9), but hail/python/hail/__init__.py requires Python 3.10+, and setup.py/setup-hailtop.py specify python_requires=">=3.10".

# docker.py says 3.9+ is ok:
if major_version != 3 or minor_version < 9:
    raise ValueError(f'Python versions older than 3.9...')

# But __init__.py requires 3.10+:
if version_info < (3, 10):
    raise EnvironmentError(f'Hail requires Python 3.10...')

This should be minor_version < 10 to match the rest of the codebase's 3.10+ requirement.

Suggested change
if major_version != 3 or minor_version < 9:
raise ValueError(
f'Python versions older than 3.12 (you are using {major_version}.{minor_version}) are not supported'
f'Python versions older than 3.9 (you are using {major_version}.{minor_version}) are not supported'
)
if major_version != 3 or minor_version < 10:
raise ValueError(
f'Python versions older than 3.10 (you are using {major_version}.{minor_version}) are not supported'
)

Spotted by Graphite

Fix in Graphite


Is this helpful? React 👍 or 👎 to let us know.

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is true but:

  1. I want a clean roll back to the status quo ante
  2. This will be fixed when we roll forwards again

@cjllanwarne cjllanwarne added the prio:high CI tests and merges this PR first label Aug 10, 2026
@cjllanwarne
cjllanwarne merged commit 5e5eedb into main Aug 10, 2026
14 of 15 checks passed
@cjllanwarne
cjllanwarne deleted the revert-15603-cjl_python_version_bump branch August 10, 2026 18:53
ehigham pushed a commit to ehigham/hail that referenced this pull request Aug 12, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…-13 to 3.12-14" (hail-is#15660)

Reverts hail-is#15603

We need 3.11 to support our current dataproc (and spark) version. 

I will follow up with a PR to do 90% of this again, but keeping 3.11 for
now.
kush-chandra pushed a commit to kush-chandra/hail that referenced this pull request Aug 19, 2026
…0-13 to 3.12-14" (hail-is#15663)

Reverts hail-is#15660; restores the changes in hail-is#15603. Should be
ready to merge again after the dataproc update (hail-is#15662)

---

## Change Description

Updates the default python version to 3.12 and shifts the list of
supported versions to 3.12, 3.13, 3.14 to realign with the numpy's
supported versions.

Update: 3.11 will NOT continue to be supported. EMR has been shown to
work ok with 3.12 and numpy support has already expired on 3.11.

## Security Assessment

Delete all except the correct answer:
- This change potentially impacts the Hail Batch instance as deployed by
Broad Institute in GCP

### Impact Rating

- This change has a low security impact

### Impact Description

Python version updates in services and client libraries.

### Appsec Review

- [ ] Required: The impact has been assessed and approved by appsec
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

prio:high CI tests and merges this PR first

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants