feat(bm25): BM25 ranked text search on standard posting lists - #9730

Open

shaunpatterson wants to merge 27 commits into

dgraph-io:mainfrom

shaunpatterson:sp/bm25

Commits on Jul 14, 2026

feat(search): add BM25 ranked text search

shaunpatterson
and
claude
committed
65cf423
fix(bm25): store TF/doclen in facets and fix query pipeline integration

shaunpatterson
and
claude
committed
f32557c
perf(bm25): replace facet storage with compact direct Badger KV encoding

shaunpatterson
and
claude
committed
88b2b3e
test(bm25): add 15 integration tests for mutation scenarios and edge cases

shaunpatterson
and
claude
committed
d08bd8d
test(bm25): add exact score verification, BM15 variant, and single-doc tests

shaunpatterson
and
claude
committed
f304180
feat(bm25): add block storage infrastructure for segmented column stores

shaunpatterson
and
claude
committed
d5450e3
feat(bm25): segmented block writes and WAND/Block-Max WAND query path

shaunpatterson
and
claude
committed
cd2f35a
feat(bm25): add legacy format fallback for migration and WAND unit tests

shaunpatterson
and
claude
committed
98db3c6
fix(bm25): address GPT-5 code review findings in WAND implementation

shaunpatterson
and
claude
committed
3e8dab7
fix(bm25): prevent stats double-counting on updates and fix BMW otherUB underestimate

shaunpatterson
and
claude
committed
2628738
fix(bm25): clamp startPos in skipTo to prevent negative sort.Search length

shaunpatterson
and
claude
committed
0121ea2
fix(bm25): address Gemini/GPT-5 code review findings

shaunpatterson
and
claude
committed
01da860
feat(bm25): rework BM25 onto standard posting lists

shaunpatterson
and
claude
committed
8779de6
fix(bm25): accumulate corpus stats across transactions

shaunpatterson
and
claude
committed
1a6f3ff
fix(bm25): reject @index(bm25) on list predicates

shaunpatterson
and
claude
committed
59f2676
chore(bm25): drop working design notes

shaunpatterson
and
claude
committed
9bdf757
fix(bm25): use tagged switch on err (staticcheck QF1002)

shaunpatterson
and
claude
committed
2b66331
fix(bm25): clear corpus stats on index drop/rebuild

shaunpatterson
and
claude
committed
66f0e40
fix(bm25): aggregate corpus stats during index rebuild

shaunpatterson
and
claude
committed
b6210b2
fix(bm25): bound query memory on the offset/filter paths with WAND top-k

shaunpatterson
and
claude
committed
c99e06f
fix(bm25): build a correct BM25 index in the bulk loader

shaunpatterson
and
claude
committed
91342f4
fix(bm25): bind score var from uid-keyed snapshot; drop dead helper
shaunpatterson
committed
250b79b
fix(bm25): deterministic UID tie-break in WAND top-k heap eviction

shaunpatterson
and
claude
committed
bf91ca2
feat(bm25): reject @noconflict on bm25 predicates; add tie-break e2e test

shaunpatterson
and
claude
committed
e8806a3

Commits on Jul 24, 2026

fix(bm25): clamp negative pagination, tighten schema guards, harden stats decode

shaunpatterson
and
claude
committed
5439b87

Commits on Jul 26, 2026

Merge remote-tracking branch 'upstream/main' into sp/bm25
shaunpatterson
committed
9fa857c
fix(test): whitelist Zero admin endpoints in dgraphtest clusters

shaunpatterson
and
claude
committed
8dca8a8