Feat:Support Milvus as DatabaseSink

[Yuukadesu]

Streampipes has powerful streaming data computation and processing capabilities, and also integrates many databases. However, I found that vector databases have not been integrated yet. I chose to integrate Milvus, which is a powerful vector database that can help us store and process vectors. I will integrate Milvus with reference to IotdbSink.

[Yuukadesu]

Milvus is an open-source high-performance vector database specifically designed for managing, indexing, and searching large-scale unstructured data such as text, images, audio, and more. Its core advantage lies in handling embeddings, which convert unstructured data into numerical vector representations that can effectively perform similarity searches. Milvus supports multiple types of search functions, including approximate nearest neighbor (ANN) search, filtered search, range search, and keyword search.

Milvus has high scalability and can handle billions of vectors in distributed environments.

Its distributed architecture is designed for scalability, ensuring that Milvus can seamlessly scale as data grows. Milvus' performance is optimized through advanced algorithms such as IVF, HNSW, and DiskANN, while its modular components support flexible scaling and efficient resource management.

You can integrate Milvus into your application through various SDKs such as Python, Java, and Go to easily access its powerful search functionality.

This is the official website of milvus https://milvus.io

I think integrating vector databases like Milvus can enhance the functionality of streampipes.