Now that the zvec connector has landed, I wanted to suggest an example and blog direction around it.
Picking this back up from our last conversation, where you pointed me at zvec's
PocketSearch post and flagged a possible CocoIndex angle to it around handling changes over time. I'd been thinking through a few zvec example ideas already, mostly around hybrid search over docs (Kuva's docs and release notes), but this one feels more directly tied to what zvec is showing. I spent some time with the post, the PocketSearch repo, and the mobile SDK before writing
this up.
Reading through it, zvec already has the retrieval side covered: local, embedded, and self-contained.
The post itself notes that upstream parsing keeps changing as more data sources get added, while the
retrieval layer stays stable. That upstream part, reading files, embedding them, keeping the index in
sync, is where I think CocoIndex fits.
Reminded me of the csv_to_kafka example (watch a local folder, reconcile only what changed in live-update mode); in this case, the zvec collection would be the target: point it at a folder of images, and as files are added, edited, or removed, the index / logic follows.
I'm thinking of it as local image/file search, starting with images since that's PocketSearch's
corpus. The query side (a CLI, a small UI) can wait until the indexing and freshness part feels right.
It also gives the connector a concrete example: zvec for retrieval, CocoIndex for the indexing path in
front of it. FTS is already in the connector, so OCR or caption text from screenshots could extend the same collection later on if needed.
Mostly want to check the direction before building anything out (and also before this draft here gets converted into the template referenced in this repo's README.
CC: @badmonster0, @feihongxu0824.
Now that the zvec connector has landed, I wanted to suggest an example and blog direction around it.
Picking this back up from our last conversation, where you pointed me at zvec's
PocketSearch post and flagged a possible CocoIndex angle to it around handling changes over time. I'd been thinking through a few zvec example ideas already, mostly around hybrid search over docs (Kuva's docs and release notes), but this one feels more directly tied to what zvec is showing. I spent some time with the post, the PocketSearch repo, and the mobile SDK before writing
this up.
Reading through it, zvec already has the retrieval side covered: local, embedded, and self-contained.
The post itself notes that upstream parsing keeps changing as more data sources get added, while the
retrieval layer stays stable. That upstream part, reading files, embedding them, keeping the index in
sync, is where I think CocoIndex fits.
Reminded me of the csv_to_kafka example (watch a local folder, reconcile only what changed in live-update mode); in this case, the zvec collection would be the target: point it at a folder of images, and as files are added, edited, or removed, the index / logic follows.
I'm thinking of it as local image/file search, starting with images since that's PocketSearch's
corpus. The query side (a CLI, a small UI) can wait until the indexing and freshness part feels right.
It also gives the connector a concrete example: zvec for retrieval, CocoIndex for the indexing path in
front of it. FTS is already in the connector, so OCR or caption text from screenshots could extend the same collection later on if needed.
Mostly want to check the direction before building anything out (and also before this draft here gets converted into the template referenced in this repo's README.
CC: @badmonster0, @feihongxu0824.