Skip to content

Conversation

@merrily01
Copy link
Owner

Which issue does this PR close?

Closes #.

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

How was this patch tested?

Tartarus0zm and others added 14 commits October 21, 2025 14:14
Bumps [tikv-jemalloc-ctl](https://github.com/tikv/jemallocator) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/tikv/jemallocator/releases)
- [Changelog](https://github.com/tikv/jemallocator/blob/main/CHANGELOG.md)
- [Commits](tikv/jemallocator@0.6.0...0.6.1)

---
updated-dependencies:
- dependency-name: tikv-jemalloc-ctl
  dependency-version: 0.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [foldhash](https://github.com/orlp/foldhash) from 0.1.5 to 0.2.0.
- [Commits](orlp/foldhash@v0.1.5...v0.2.0)

---
updated-dependencies:
- dependency-name: foldhash
  dependency-version: 0.2.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [procfs](https://github.com/eminence/procfs) from 0.17.0 to 0.18.0.
- [Release notes](https://github.com/eminence/procfs/releases)
- [Commits](eminence/procfs@v0.17.0...v0.18.0)

---
updated-dependencies:
- dependency-name: procfs
  dependency-version: 0.18.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Bumps [bigdecimal](https://github.com/akubera/bigdecimal-rs) from 0.4.8 to 0.4.9.
- [Release notes](https://github.com/akubera/bigdecimal-rs/releases)
- [Commits](akubera/bigdecimal-rs@v0.4.8...v0.4.9)

---
updated-dependencies:
- dependency-name: bigdecimal
  dependency-version: 0.4.9
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* [AURON apache#1496] Introduce SparkOnHeapSpillManager

* fix
Bumps [tikv-jemallocator](https://github.com/tikv/jemallocator) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/tikv/jemallocator/releases)
- [Changelog](https://github.com/tikv/jemallocator/blob/main/CHANGELOG.md)
- [Commits](tikv/jemallocator@0.6.0...0.6.1)

---
updated-dependencies:
- dependency-name: tikv-jemallocator
  dependency-version: 0.6.1
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…rk-extension-shims-spark. (apache#1474)

#### Which issue does this PR close?

Closes apache#1473.

We plan to introduce support for `Spark 4`. Currently, the module name `spark-extension-shims-spark3` is tightly coupled with `Spark 3-specific` versions. To make the module naming more general and version-agnostic, we should rename it to `spark-extension-shims-spark`.

This change will make it easier to extend support for multiple Spark versions (e.g., Spark 3.x, Spark 4.x) without duplicating shim module definitions.

#### Rationale for this change

The local compilation passes.

```
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Apache Auron Parent Pom 7.0.0-SNAPSHOT:
[INFO] 
[INFO] Apache Auron Parent Pom ............................ SUCCESS [  2.009 s]
[INFO] Apache Auron Proto ................................. SUCCESS [ 13.495 s]
[INFO] Apache Auron Hadoop Shim 2.12 ...................... SUCCESS [  4.903 s]
[INFO] Apache Auron Core .................................. SUCCESS [  7.310 s]
[INFO] Apache Auron Common 2.12 ........................... SUCCESS [  7.611 s]
[INFO] Apache Auron Spark Version Annotation Macros 2.12 .. SUCCESS [  6.020 s]
[INFO] Apache Auron Spark UI 2.12 ......................... SUCCESS [  4.335 s]
[INFO] Apache Auron Spark Extension 2.12 .................. SUCCESS [ 24.360 s]
[INFO] Apache Auron Spark Extension Shims Spark 3.5.7_2.12  SUCCESS [ 18.153 s]
[INFO] Apache Auron Assembly .............................. SUCCESS [  9.452 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  01:38 min
[INFO] Finished at: 2025-10-20T11:30:21+08:00
[INFO] ------------------------------------------------------------------------
```

#### What changes are included in this PR?

Rename **spark-extension-shims-spark3** to **spark-extension-shims-spark**.

#### Are there any user-facing changes?

No.

#### How was this patch tested?

CI
…ache#1499)

* [AURON apache#1498] Enable the JniBridge in the auron-core module

* fix

* fix checkstyle

* fix

* fix

* fix

* fix

* fix compile

* opts NativeHelper

* opts
Tartarus0zm and others added 4 commits October 24, 2025 17:32
…nder the spark-extension module (apache#1510)

* [AURON apache#1509] Deprecated JniBridge and AuronCallNativeWrapper under the spark-extension module

* fix checkstyle

* fix checkstyle
…o missing `/tmp/spark-events/` directory
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants