Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[query path] early filtering #97

Open
okayzed opened this issue Nov 23, 2018 · 1 comment
Open

[query path] early filtering #97

okayzed opened this issue Nov 23, 2018 · 1 comment

Comments

@okayzed
Copy link
Collaborator

okayzed commented Nov 23, 2018

this task is to add early filtering to the loading samples off disk. this allows us to skip over records that are not applicable instead of waiting until the query stage.

according to abadi, late materialization can speed up queries enormously, but its not clear to me how to late filter when each thread is loading a separate column off disk

@okayzed
Copy link
Collaborator Author

okayzed commented Dec 2, 2018

my first attempt was 1) slower than filtering after loading and 2) giving wrong answers. 😢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant