Skip to content

Local tier budget accounting + eviction - #6509

Merged
joshua-spacetime merged 7 commits into
kim/tiered-storage-iofrom
kim/local-disk-eviction
Nov 11, 2026
Merged

joshua-spacetime merged 7 commits into
kim/tiered-storage-iofrom
kim/local-disk-eviction

Conversation

@kim

@kim kim commented Nov 6, 2026

Copy link
Copy Markdown
Contributor

Implements budget accounting for the local tier.

That is, if the local disk budget is exhausted, writing a new object will cause catalog
objects to be evicted. Eviction entails storing the object in remote storage, removing it
from local storage, and then dropping its permit.

If no remote storage is configured, nothing is evicted.

API and ABI breaking changes

N/A

Rollback safety impact

N/A

Expected complexity level and risk

3

Testing

TBD

@kim
kim force-pushed the kim/local-disk-eviction branch 3 times, most recently from 92402ea to fbdcaa7 Compare November 6, 2026 15:55
@kim
kim requested a review from joshua-spacetime November 6, 2026 15:55
@kim kim mentioned this pull request Nov 6, 2026
Comment thread crates/table/src/tiered/storage.rs Resolved
@kim
kim added this pull request to stack #6533 November 9, 2026 11:43
Comment thread crates/tiered-storage/src/lib.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
Comment thread crates/tiered-storage/src/lib.rs Resolved
Comment thread crates/table/src/tiered/storage.rs Resolved
# Description of Changes

Adds a bunch of metrics related to tiered storage.

# API and ABI breaking changes

N/A

# Rollback safety impact

N/A

# Expected complexity level and risk

2

# Testing

TBD
@joshua-spacetime
joshua-spacetime merged commit b057329 into master Nov 11, 2026
67 of 73 checks passed
@kim
kim deleted the kim/local-disk-eviction branch November 12, 2026 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants