Skip to content

Enhance README with recordsize rebalancing info #79

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
DonatelloXX wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Enhance README with recordsize rebalancing info #79

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,8 @@ and have a look at difference of the `CAP` value (`SIZE`/`FREE` vs `ALLOC` ratio

Due to the working principle of this script, which essentially creates a duplicate file on purpose, deduplication will most definitely prevent it from working as intended. If you use deduplication you probably have to resort to a more expensive rebalancing method that involves additional drives.

If you want your duplicated Data to be rabalanced you have to change the recordsize of the pool. Since duplication works on block level, every file write resulting in another block layout is rebalanced. For Example a 1MB file is split in 8 blocks at 128K recordsize. If you change the recordsize to 256K it results in 4 blocks which are not he same and thus will be rewritten/rebalanced. If the file was smaller than 128K it will not be rebalanced since the resulting block is the same at byte-level and thus will be deduplicated.

### Data selection (cold data)

Due to the working principle of this script, it is crucial that you **only run it on data that is not actively accessed**, since the original file will be deleted.
Expand Down