Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEA]: Add support for Kinetica as a VDB sink #366

Open
am-kinetica opened this issue Jan 22, 2025 · 0 comments
Open

[FEA]: Add support for Kinetica as a VDB sink #366

am-kinetica opened this issue Jan 22, 2025 · 0 comments
Labels
feature request New feature or request

Comments

@am-kinetica
Copy link

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Currently preventing usage

Please provide a clear description of problem this feature solves

We at Kinetica would like to develop a feature which enables the nv-ingest services to use kinetica as a vdb sink. Right now, it seems the only sink available to use is Milvus. We would like to develop this feature so that kinetica is available as an alternative.

From the code https://github.com/NVIDIA/nv-ingest/blob/main/src/nv_ingest/modules/sinks/vdb_task_sink.py it seems there is no way to develop such a feature since it is tied to the Milvus libraries only. We are in the process of developing the Morpheus Vector Database Service for Kinetica as available in the issue nv-morpheus/Morpheus#2058.

Describe the feature, and optionally a solution or implementation and any alternatives

Ideally, we are planning to develop a module like vdb_task_sink_kinetica.py which will enable Kinetica to be used as a vdb sink instead of Milvus.

Additional context

I think the module https://github.com/NVIDIA/nv-ingest/blob/main/src/nv_ingest/modules/sinks/vdb_task_sink.py needs to be altered suitably so that the Milvus specific code is factored out to a different module.

Any suggestions to how we may proceed would be extremely helpful.

@am-kinetica am-kinetica added the feature request New feature or request label Jan 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant