Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

load_gz: one MEMORY_REGION_ANALYSIS use fast load #262

Closed
wants to merge 2 commits into from

Conversation

xiaokamikami
Copy link
Contributor

The speed of loading a single gz file can be improved from 24 seconds to around 17 seconds

@shinezyy
Copy link
Contributor

The reaseon we do zero check before write is to keep the page untouched and take advantage of Linux COW to reduce memory usage. If neccesary, you can add a new option to load without checking and turn on zero checking by default.

@xiaokamikami xiaokamikami changed the title load_gz: fast load load_gz: one MEMORY_REGION_ANALYSIS use fast load Jan 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants