v1.38.10
v1.38.10 - Search REST endpoint improvements, Namespaces & Usage module Fixes
Added 7
- Introduce includeRoles to backup/restore process
- Add opt-in gRPC transport to Backup-gcs
- Add plumbing for namespace exister
- Add bm25 keyword search endpoint (REST Search API 1/4)
- Add hybrid search endpoint (REST Search API 2/4)
- Add near-object search endpoint (REST Search API 3/4)
- Add aggregate counts endpoint (REST Search API 4/4)
Changed 6
- Size hashbeat digest buffers by set count, not leaf count
- Read the dimensions bucket once per usage sweep
- Warm the version map in the background at startup
- Unmarshal namespace snapshot outside of lock
- Size the roaringsetrange pread read buffer from the segment payload
- Read only the geo property when resolving a coordinate
Fixed 13
- Report the tenant's pre-freeze status on an aborted freeze
- Fix flaky teardown in async replication acceptance suites
- Report one error per object when a shard refuses a batch
- Move st.trackDBLoadProgress inside st.reloadDBFromSchema
- Gate tenant actions in namespaces
- Keep the geo vector cache across deletion cycles
- Don't dereference nil target combination in parseNearVec
- Serve a failed backup's reason from the participant status
- Keep error type through the objects manager
- Don't let SIGPIPE break the gh escape-sequence feature check
- Apply the filter to the BM25 search in hybrid aggregation
- Wait for the local schema before writes that resolve an index by name
- Fix three crashes and data corruptions in cluster state handling
Removed 1
- Remove TestReadSnapshotBufferAllocation which was flaky
From Weaviate
Breaking Changes
none
New Features
none
Fixes
- Remove TestReadSnapshotBufferAllocation which was flaky by @dirkkul in https://github.com/weaviate/weaviate/pull/12493
- perf(async-repl): size hashbeat digest buffers by set count, not leaf count by @jeroiraz in https://github.com/weaviate/weaviate/pull/12481
- Read the dimensions bucket once per usage sweep by @dirkkul in https://github.com/weaviate/weaviate/pull/12503
- perf(hfresh): warm the version map in the background at startup by @asdine in https://github.com/weaviate/weaviate/pull/12504
- Report the tenant's pre-freeze status on an aborted freeze by @dirkkul in https://github.com/weaviate/weaviate/pull/12508
- Unmarshal namespace snapshot outside of lock by @dirkkul in https://github.com/weaviate/weaviate/pull/12506
- Size the roaringsetrange pread read buffer from the segment payload by @dirkkul in https://github.com/weaviate/weaviate/pull/12499
- feat(backups): introduce
includeRolesto backup/restore process by @tsmith023 in https://github.com/weaviate/weaviate/pull/12322 - fix flaky teardown in async replication acceptance suites by @jeroiraz in https://github.com/weaviate/weaviate/pull/12520
- Backup-gcs: add opt-in gRPC transport by @dirkkul in https://github.com/weaviate/weaviate/pull/12447
- fix(batch): report one error per object when a shard refuses a batch by @g-despot in https://github.com/weaviate/weaviate/pull/12519
- fix(db): move
st.trackDBLoadProgressinsidest.reloadDBFromSchemaby @tsmith023 in https://github.com/weaviate/weaviate/pull/12524 - fix(async-repl): backport #12079 and #12127 to stable/v1.37 by @jfrancoa in https://github.com/weaviate/weaviate/pull/12547
- Namespaces: Gate tenant actions by @dirkkul in https://github.com/weaviate/weaviate/pull/12513
- Testcontainer endpoint + docstring fixes by @dirkkul in https://github.com/weaviate/weaviate/pull/12540
- Namespaces: Add plumbing for namespace exister by @dirkkul in https://github.com/weaviate/weaviate/pull/12541
- Keep the geo vector cache across deletion cycles by @dirkkul in https://github.com/weaviate/weaviate/pull/12557
- Fix non-compiling test by @dirkkul in https://github.com/weaviate/weaviate/pull/12562
- fix(grpc): don't dereference nil target combination in parseNearVec by @tsmith023 in https://github.com/weaviate/weaviate/pull/12567
- fix(backup): serve a failed backup's reason from the participant status by @etiennedi in https://github.com/weaviate/weaviate/pull/12548
- Keep error type through the objects manager by @dirkkul in https://github.com/weaviate/weaviate/pull/12510
- Read only the geo property when resolving a coordinate by @dirkkul in https://github.com/weaviate/weaviate/pull/12564
- fix(async-repl): surface root-prefilter skips in asyncReplicationStatus by @jeroiraz in https://github.com/weaviate/weaviate/pull/12566
- perf(lsmkv): targeted replace scan with newest-wins visibility by @amourao in https://github.com/weaviate/weaviate/pull/12396
- Keep the parked pread buffer on sequential replace cursor scans by @jeroiraz in https://github.com/weaviate/weaviate/pull/12571
- Complete updateIndexTenants when one tenant fails by @dirkkul in https://github.com/weaviate/weaviate/pull/12507
- Drop per-cycle allocations from the idle compaction path by @dirkkul in https://github.com/weaviate/weaviate/pull/12561
- perf(lsmkv): read targeted-scan ranges straight from the file by @amourao in https://github.com/weaviate/weaviate/pull/12592
- Parse replace nodes without allocating by @dirkkul in https://github.com/weaviate/weaviate/pull/12558
- Fixes bugs segment group tmp file recovery by @dirkkul in https://github.com/weaviate/weaviate/pull/12458
- Include GEO HNSW index in backups by @dirkkul in https://github.com/weaviate/weaviate/pull/12584
- Pin replacement replicas to a namespace's home node by @dirkkul in https://github.com/weaviate/weaviate/pull/12554
- Treat a non-positive vector cache maxSize as unbounded by @dirkkul in https://github.com/weaviate/weaviate/pull/12586
- fix(hfresh): hold the posting lock during version map warmup by @asdine in https://github.com/weaviate/weaviate/pull/12612
- fix(cache): count occupied slots, and add PreloadIfAbsent by @amourao in https://github.com/weaviate/weaviate/pull/12593
- Concurrently prefill geo caches using exinsg prefiller by @dirkkul in https://github.com/weaviate/weaviate/pull/12583
- fix(dtm): treat an unrecognized task status as in-flight by @etiennedi in https://github.com/weaviate/weaviate/pull/12549
- fix(storobj): bound vector reads by their declared segment by @amourao in https://github.com/weaviate/weaviate/pull/12594
- Fix Geo property bugs by @dirkkul in https://github.com/weaviate/weaviate/pull/12616
- feat(rest): bm25 keyword search endpoint (REST Search API 1/4) by @g-despot in https://github.com/weaviate/weaviate/pull/12245
- feat(rest): hybrid search endpoint (REST Search API 2/4) by @g-despot in https://github.com/weaviate/weaviate/pull/12246
- feat(rest): near-object search endpoint (REST Search API 3/4) by @g-despot in https://github.com/weaviate/weaviate/pull/12248
- feat(rest): aggregate counts endpoint (REST Search API 4/4) by @g-despot in https://github.com/weaviate/weaviate/pull/12249
- fix(tools): don't let SIGPIPE break the gh escape-sequence feature check by @antas-marcin in https://github.com/weaviate/weaviate/pull/12625
- Hybrid Aggregation: Apply the filter to the BM25 search by @dirkkul in https://github.com/weaviate/weaviate/pull/12622
- Wait for the local schema before writes that resolve an index by name by @dirkkul in https://github.com/weaviate/weaviate/pull/12587
- Fix three crashes and data corruptions in cluster state handling by @dirkkul in https://github.com/weaviate/weaviate/pull/12626
- test(usage): wait for storage to settle instead of relaxing the assertions by @antas-marcin in https://github.com/weaviate/weaviate/pull/12635
- fix(async-repl): never publish or load a stale hashtree snapshot by @jeroiraz in https://github.com/weaviate/weaviate/pull/12195
- fix(modules): don't panic when a batch has objects with no vectorizable properties by @antas-marcin in https://github.com/weaviate/weaviate/pull/12617
- fix(schema): reject invalid async replication config before RAFT commit by @jeroiraz in https://github.com/weaviate/weaviate/pull/12261
- Report every shard failure during index reconcile by @dirkkul in https://github.com/weaviate/weaviate/pull/12639
- fix(hybrid): fetch Boost.Depth-deep candidates in hybrid sub-searches by @hamodywe in https://github.com/weaviate/weaviate/pull/12537
- fix(usage): skip dropped named vectors when computing cold shard usage by @antas-marcin in https://github.com/weaviate/weaviate/pull/12681
- fix(usage): report legacy vector alongside named vectors in usage metrics by @antas-marcin in https://github.com/weaviate/weaviate/pull/12682
- Usage: Make cold tenants report the same data as hot tenants by @dirkkul in https://github.com/weaviate/weaviate/pull/12628
New Contributors
- @hamodywe made their first contribution in https://github.com/weaviate/weaviate/pull/12537
Full Changelog: https://github.com/weaviate/weaviate/compare/v1.38.9...v1.38.10