Search results

[WIP][PYTHON] Arrow UDF for aggregation

CONNECT

CORE

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51292

#51292 In apache/spark;

· zhengruifeng opened on Jun 26, 2025

[SPARK-52570][PS] Enable divide-by-zero for numeric rmod with ANSI enabled

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51275

#51275 In apache/spark;

· xinrong-meng opened on Jun 24, 2025

[SPARK-52561][PYTHON][INFRA] Upgrade the minimum version of Python to 3.10

BUILD

DOCS

INFRA

PYTHON

Status: Draft (not ready).

apache/sparknumber 51259

#51259 In apache/spark;

· zhengruifeng opened on Jun 24, 2025

[SPARK-52563][PS] Fix var naming bug in _assert_pandas_almost_equal

PYTHON

Status: Open (in progress).

apache/sparknumber 51253

#51253 In apache/spark;

· petern48 opened on Jun 23, 2025

[DRAFT][PYTHON] Improve Python UDF Arrow Serializer Performance

CORE

DOCS

PYTHON

SQL

Status: Draft (not ready).

apache/sparknumber 51225

#51225 In apache/spark;

· asl3 opened on Jun 19, 2025

[Test]

CONNECT

DOCS

ML

MLLIB

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51221

#51221 In apache/spark;

· WeichenXu123 opened on Jun 19, 2025

[SPARK-52444][SQL][CONNECT] Add support for Variant/Char/Varchar Literal

CONNECT

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51215

#51215 In apache/spark;

· dengziming opened on Jun 18, 2025

[SPARK-52503][SQL][CONNECT] Fix <code>drop</code> when the input column is not existent

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51196

#51196 In apache/spark;

· zhengruifeng opened on Jun 17, 2025

[WIP][SPARK-52394][PS] Fix autocorr divide-by-zero error under ANSI mode

PANDAS API ON SPARK

PYTHON

Status: Open (in progress).

apache/sparknumber 51192

#51192 In apache/spark;

· xinrong-meng opened on Jun 16, 2025

Better do idle python workers cleanup

CORE

PYTHON

Status: Draft (not ready).

apache/sparknumber 51143

#51143 In apache/spark;

· antban opened on Jun 10, 2025

[MINOR] Improve documentation of concat functions in pyspark

PYTHON

SQL

Status: Open (in progress).

apache/sparknumber 51086

#51086 In apache/spark;

· frapa opened on Jun 4, 2025

[SPARK-52171] [SS] StateDataSource join implementation for state v3

PYTHON

SQL

STRUCTURED STREAMING

Status: Open (in progress).

apache/sparknumber 51004

#51004 In apache/spark;

· liviazhu opened on May 24, 2025