Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement FileIndex #34

Open
2 of 5 tasks
devillove084 opened this issue Aug 2, 2024 · 3 comments
Open
2 of 5 tasks

Implement FileIndex #34

devillove084 opened this issue Aug 2, 2024 · 3 comments

Comments

@devillove084
Copy link
Contributor

devillove084 commented Aug 2, 2024 •
edited
Loading

  • Implement basic IO Module
  • Implement a FunctionVistor(may be a simple one for poc) and FieldRef for FileIndexReader
  • Implement FileIndexFormat and FileIndexWriter/Reader and other interface
  • Implement BitmapFileIndex
  • Implement BloomfilterFileIndex

Regarding the work of implementing FileIndex, I will split it into multiple PRs to facilitate review and comment, so that there will be no problems in the implementation due to deviations in my personal understanding.
@devillove084
Copy link
Contributor Author

I've made some effort to separate the following implementation. If you have any suggestions for further improvement, please let me know. cc @Xuanwo

@Xuanwo
Copy link
Member

Xuanwo commented Aug 2, 2024

Thanks a lot for starting this!

devillove084 added a commit to devillove084/paimon-rust that referenced this issue Aug 4, 2024
@devillove084
feat(spec): impl file index format and interface (apache#34)
8105945
devillove084 added a commit to devillove084/paimon-rust that referenced this issue Aug 4, 2024
@devillove084
feat(spec): impl file index format and interface (apache#34)
42fe0af
@devillove084 devillove084 mentioned this issue Aug 4, 2024
Closed
@devillove084 devillove084 mentioned this issue Aug 23, 2024
Merged
This was referenced Aug 24, 2024
Closed
Open
@devillove084 devillove084 mentioned this issue Sep 4, 2024
Closed
@devillove084 devillove084 mentioned this issue Sep 18, 2024
Open
@devillove084 devillove084 mentioned this issue Sep 29, 2024
Open
@suxiaogang223
Copy link

suxiaogang223 commented Nov 30, 2024 •
edited
Loading

There is a new IndexFile called bit-slice bitmap index, i would like to try fellow your IndexFile framework to try to implement this functionality
apache/paimon#4464

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(index): implement file index format and interface devillove084/paimon-rust
3 participants
@Xuanwo @devillove084 @suxiaogang223