v1.38.6
v1.38.6 - Hybrid Diversity & MMR Improvements, LSM store inverted compaction improvements, Raft communication Fixes
Added 4
- Envelope search response with id, properties, references, and metadata fields
- POST /v1/search/{collection}/near-text REST near-text search endpoint
- Hybrid Diversity & MMR search capabilities
- Unified background-process activity and duration metrics for monitoring
Changed 4
- Do not load all lazy shards for property add
- Do not load lazy loaded shards on backup restore
- Make hashbeat FSM target gate allocation-free for replication performance
- Add EncodeInto for BlockEntry and BlockData in inverted index
Fixed 14
- Fold changes less than or equal to cutoff into the async-checkpoint bounded hashtree
- Concurrent writes during migration converge into the new bucket
- Abort in-flight usage scan when its collection is dropped
- Reindex task fails and retries on OnTaskCompleted schema-flip failure
- Mirror co-located properties on batch-ref and delta writes during reindex
- Capture values in keyOnly map cursor so keys are not dropped in lsmkv
- Memberlist retries on join with deadline
- Memberlist does not fail startup when a single node cannot join
- ABBA deadlock between updateReplicationConfig and lazy shard load that wedges RAFT FSM
- REST search response camelCase payload fields with nested reserved rerank object
- Key authentication singleflight on the key, not just the user
- RBAC regexp
- Namespace suspend checks namespace status for DB users
- HaltForTransfer overlap during concurrent COPY operations
Breaking Changes
none
New Features
none
Fixes
- feat(rest): envelope search response {id, properties, references, metadata} by @g-despot in https://github.com/weaviate/weaviate/pull/12133
- fix(async-repl): fold ≤cutoff changes into the async-checkpoint bounded hashtree by @jeroiraz in https://github.com/weaviate/weaviate/pull/12128
- feat(rest): POST /v1/search/{collection}/near-text — REST near-text search endpoint by @g-despot in https://github.com/weaviate/weaviate/pull/12077
- perf(replication): make hashbeat FSM target gate allocation-free by @jeroiraz in https://github.com/weaviate/weaviate/pull/12222
- Do not load all lazy shards for property add by @dirkkul in https://github.com/weaviate/weaviate/pull/12184
- fix(reindex): concurrent writes during migration converge into the new bucket (#11688, #298) by @etiennedi in https://github.com/weaviate/weaviate/pull/11985
- fix(usage): abort in-flight usage scan when its collection is dropped by @antas-marcin in https://github.com/weaviate/weaviate/pull/12187
- Do not load lazy loaded shards on backup restore by @dirkkul in https://github.com/weaviate/weaviate/pull/12186
- fix(dtm): fail/retry reindex task on OnTaskCompleted schema-flip failure (#297) by @etiennedi in https://github.com/weaviate/weaviate/pull/11986
- fix(reindex): mirror co-located props on batch-ref and delta writes by @etiennedi in https://github.com/weaviate/weaviate/pull/12210
- Stop commit log churn flaking vector storage size test by @dirkkul in https://github.com/weaviate/weaviate/pull/12231
- Backport to v1.36: fix flaky TestMakeUnboundedChannel_CapShrink by @asdine in https://github.com/weaviate/weaviate/pull/12236
- rest search: camelCase payload fields; nested reserved rerank object by @g-despot in https://github.com/weaviate/weaviate/pull/12227
- backport: fix(memberlist): retry on join with deadline by @moogacs in https://github.com/weaviate/weaviate/pull/12241
- perf(inverted): add EncodeInto for BlockEntry and BlockData by @amourao in https://github.com/weaviate/weaviate/pull/12150
- perf(lsmkv): pass data start offset to MarshalSortedKeys by @amourao in https://github.com/weaviate/weaviate/pull/12151
- fix(lsmkv): capture values in keyOnly map cursor so keys aren't dropped by @amourao in https://github.com/weaviate/weaviate/pull/12152
- perf(lsmkv): add reusable decode helpers for inverted node data by @amourao in https://github.com/weaviate/weaviate/pull/12154
- perf(lsmkv): add EncodeAppend arena-append primitive to varenc by @amourao in https://github.com/weaviate/weaviate/pull/12149
- perf(lsmkv): add reusable encode pipeline for inverted compaction by @amourao in https://github.com/weaviate/weaviate/pull/12160
- fix(memberlist): don't fail startup when a single node can't join (self-heal) by @moogacs in https://github.com/weaviate/weaviate/pull/12243
- Fix race in backup namespace test by @dirkkul in https://github.com/weaviate/weaviate/pull/12247
- fix(test): join usage poll goroutines so they cannot assert after test completion by @antas-marcin in https://github.com/weaviate/weaviate/pull/12237
- test(async-repl): gate scheduler close tests on dispatch round-trips, not channel-buffer sampling by @jeroiraz in https://github.com/weaviate/weaviate/pull/12250
- fix(db): ABBA deadlock between updateReplicationConfig and lazy shard load wedges RAFT FSM by @jfrancoa in https://github.com/weaviate/weaviate/pull/12238
- perf(lsmkv): wire inverted compaction through the reusable encode pipeline by @amourao in https://github.com/weaviate/weaviate/pull/12161
- Namespace suspend RAFT states by @dirkkul in https://github.com/weaviate/weaviate/pull/12239
- perf(lsmkv): reuse decode buffers in the inverted cursor by @amourao in https://github.com/weaviate/weaviate/pull/12163
- perf(lsmkv): reuse the propLengthsView across inverted compaction nodes by @amourao in https://github.com/weaviate/weaviate/pull/12233
- refactor(lsmkv): extract inverted block codec into inverted/blockenc by @amourao in https://github.com/weaviate/weaviate/pull/12244
- fix(lsmkv): repair stable/v1.37 build broken by the v1.36 merge (blockenc.PackedDecode) by @jeroiraz in https://github.com/weaviate/weaviate/pull/12257
- Hybrid Diversity & MMR by @trengrj in https://github.com/weaviate/weaviate/pull/11903
- Key the auth singleflight on the key, not just the user by @dirkkul in https://github.com/weaviate/weaviate/pull/12270
- Fix RBAC regexp by @dirkkul in https://github.com/weaviate/weaviate/pull/12251
- Namespace suspend: Check namespace status for DB Users by @dirkkul in https://github.com/weaviate/weaviate/pull/12266
- fix(rplc-mvmnt):
HaltForTransferoverlap during concurrent COPY ops by @tsmith023 in https://github.com/weaviate/weaviate/pull/12218 - feat(monitoring): unified background-process activity + duration metrics by @moogacs in https://github.com/weaviate/weaviate/pull/12275
Full Changelog: https://github.com/weaviate/weaviate/compare/v1.38.5...v1.38.6