What's Changed Breaking Changes π feat(namespace): preserve Retry-After metadata on throttling errors by @hello-peter-tang in #10400 fix(clustering): restore brings back the target's definitions, keeping only the allocation mark by @LuQQiu in #10629 New Features π feat(cache): new cache metrics by @a-erofeev in #9781 feat(index): add composable segment statistics APIs by @ivscheianu in #9783 feat:β¦
What's Changed Breaking Changes π feat(dataset): add expire_versions to remove history without reading manifests by @jackye1995 in #9438 refactor(index): split Dataset index lifecycle by @Xuanwo in #10600 refactor(python): organize dataset bindings by capability by @Xuanwo in #10602 refactor(mem_wal): split write path responsibilities by @Xuanwo in #10605 Critical Fixes βΌοΈ fix(io): prevent scan scβ¦
What's Changed Bug Fixes π fix(blob): decode legacy blob pages in 2.2 files after promotion by @jackylee-ch in #10454 fix(blob): promote legacy blob input to v2 on fragment and update writes by @zhangyue19921010 in #10586 Full Changelog: v14.0.2...v14.0.3-rc.1
What's Changed Breaking Changes π feat(tools): add table manifest command by @bugwz in #7970 perf(index)!: parallelize zone statistics computation in scalar index training by @zhangyue19921010 in #8469 feat(dataset)!: expose manifest_size on Version by @hiltonhe in #9102 perf(index): reuse RaBitQ LUTs and share IVF query state by @xiaguanglei in #9190 perf(linalg)!: select f32/f64 cosine kernels oβ¦
What's Changed Critical Fixes βΌοΈ fix(index): fence older writers from row-address indices by @app/lance-gatefixer in #10352 Bug Fixes π fix(clustering): reject type changes, not renames, for new definitions by @LuQQiu in #10399 Other Changes refactor(index): share RTree loading and row-address remapping by @Xuanwo in #10464 Full Changelog: v15.0.0-beta.6...v15.0.0-beta.7
What's Changed Critical Fixes βΌοΈ fix(index): apply segment ownership in shared-scan batch IVF search by @sezruby in #9638 New Features π fix: protect fragment reuse history on stable-row-ID tables by @brendanclement in #9769 docs(format): specify PCA model storage and index compatibility by @beautygua in #9968 feat(index): reuse zone map write seeds across zone sizes and make the null bitmap optioβ¦
What's Changed Bug Fixes π fix(arrow): backport sliced validity alignment to v14 by @BubbleCal in #10412 Full Changelog: v14.0.1...v14.0.2
What's Changed Bug Fixes π fix(arrow): backport sliced validity alignment to v14 by @BubbleCal in #10412 Full Changelog: v14.0.1...v14.0.2-rc.1
What's Changed Bug Fixes π fix: delete files written by merge_insert analyze_plan by @wjones127 in #9869 fix(dataset): stream sub-batches through add_columns without a 2 GiB concat by @dsingh-exa in #9912 Performance Improvements π perf(encoding): seek constant pages by row instead of walking every row by @zhangyue19921010 in #10339 Full Changelog: v15.0.0-beta.4...v15.0.0-beta.5
What's Changed Bug Fixes π fix(io): remove dependency on unreleased object_store by @Xuanwo in #10364 Full Changelog: v14.0.0...v14.0.1
What's Changed Breaking Changes π fix(merge_insert): bound indexed join memory by @app/lance-gatefixer in #8374 fix(compaction): preserve row order across parallel tasks by @app/lance-gatefixer in #8400 New Features π feat(index): implement ZoneMap index version 1 by @LuQQiu in #10217 feat: support blob v2 assignments in UpdateBuilder by @wkalt in #10388 Bug Fixes π fix(exec): bound legacy take baβ¦
What's Changed Bug Fixes π fix(index): compact across compatible vector index segments by @kamronis in #8742 fix(encoding): stop duplicating a shared Arrow dictionary once per buffered batch by @zhangyue19921010 in #10361 fix(io): remove dependency on unreleased object_store by @Xuanwo in #10363 fix(dataset): keep data-file concatenation futures Send by @Xuanwo in #10370 Full Changelog: v15.0.0-beβ¦
What's Changed Bug Fixes π fix(io): remove dependency on unreleased object_store by @Xuanwo in #10364 Full Changelog: v14.0.0...v14.0.1-rc.1
What's Changed Breaking Changes π feat(format)!: add file metadata size hint by @Ali2Arslan in #9168 fix(mem_wal): stop publication after terminal L0 flush failures by @app/lance-gatefixer in #9959 refactor!: add lance-datafusion-exec so lance-index skips datafusion by @wjones127 in #10251 feat(encoding): add modern ALP miniblock compression by @Xuanwo in #10267 Critical Fixes βΌοΈ fix: support fileβ¦
What's Changed Breaking Changes π feat(encoding): compress v2.3 mini-block offsets by @Xuanwo in #8331 feat(index): change btree scalar index to row-address domain by @westonpace in #9481 refactor(index): pass index_version into ScalarIndexPlugin::load_index by @westonpace in #9518 feat(mem_wal): evaluate fuzzy conjunctions on the active memtable by @hamersaw in #9526 refactor!: vendor jsonb intoβ¦
What's Changed Breaking Changes π feat(encoding): compress v2.3 mini-block offsets by @Xuanwo in #8331 feat(index): change btree scalar index to row-address domain by @westonpace in #9481 refactor(index): pass index_version into ScalarIndexPlugin::load_index by @westonpace in #9518 feat(mem_wal): evaluate fuzzy conjunctions on the active memtable by @hamersaw in #9526 refactor!: vendor jsonb intoβ¦
What's Changed Breaking Changes π feat(index): implement version 1 zone write seeds by @LuQQiu in #10102 New Features π refactor(index): expose native RaBitQ scan primitives by @BubbleCal in #9834 feat(index): add native RaBitQ plane reads and resident columns by @BubbleCal in #9835 feat(index): add row-addressable native RaBitQ cache bodies by @BubbleCal in #9836 perf(index): load native RaBitQ rβ¦
Release root for 15.0.0-beta.N series (same base as 14.1.0-beta.N)
What's Changed Breaking Changes π feat(encoding): compress v2.3 mini-block offsets by @Xuanwo in #8331 feat(index): change btree scalar index to row-address domain by @westonpace in #9481 refactor(index): pass index_version into ScalarIndexPlugin::load_index by @westonpace in #9518 feat(mem_wal): evaluate fuzzy conjunctions on the active memtable by @hamersaw in #9526 refactor!: vendor jsonb intoβ¦
Release root for 14.1.0-beta.N series
What's Changed New Features π feat(index): add a PCA model and vector pre-transform by @beautygua in #9967 Performance Improvements π perf(dataset): take rows by id without reading deletion files by @dshepelev15 in #10163 perf(dataset): open only the data files that hold a projected field by @dshepelev15 in #10178 Full Changelog: v14.0.0-beta.23...v14.0.0-beta.24
What's Changed New Features π feat(index): allow training IVF from supplied samples by @BubbleCal in #10188 Full Changelog: v14.0.0-beta.22...v14.0.0-beta.23
What's Changed Critical Fixes βΌοΈ fix: include overlay-stale rows in indexed merge insert by @app/lance-gatefixer in #9865 fix(encoding): read RLE-compressed mini-block dictionary values by @lichuang in #10145 New Features π feat(index): f64 centroids support in streaming coreset k-means by @a-erofeev in #8662 feat(format): define provider-managed clustering metadata by @LuQQiu in #9878 feat(formatβ¦
What's Changed New Features π feat(index): distributed execution of optimize indices by @zhangyue19921010 in #9871 Bug Fixes π fix(fts): size the staged finalize from the build's memory config and report one progress stage by @LuQQiu in #10141 Full Changelog: v14.0.0-beta.20...v14.0.0-beta.21
What's Changed Bug Fixes π fix(io): reject zero multipart upload concurrency by @kamronis in #9756 fix(merge_insert): build update_if structs by name on indexed joins by @wkalt in #9950 fix: read struct children added below a list item at any depth by @wkalt in #9954 fix(io): resolve locations that the rest of the stack accepts by @LuciferYang in #10009 fix(io): record the IO that currently goes uβ¦
What's Changed New Features π feat(format): define Arrow-ordered zone write seeds by @LuQQiu in #9564 feat(dataset): spill carried lineage in merge insert by @BubbleCal in #10062 Bug Fixes π fix(mem_wal): make shard manifest versions safe to prune by @xuanyu-z in #9953 fix(mem_wal): retry a failed memtable flush before any later generation by @hamersaw in #10031 fix(mem_wal): reject unhashable priβ¦
What's Changed Bug Fixes π fix(index): trace segment coverage across recorded compactions by @brendanclement in #9946 fix(index): reject mixed row domains in scalar index segments by @BubbleCal in #10004 fix(scanner): align row offset statistics with output schema by @BubbleCal in #10030 Full Changelog: v14.0.0-beta.17...v14.0.0-beta.18
What's Changed Bug Fixes π fix(index): harvest zone map seeds from the serving data file by @BubbleCal in #10003 Full Changelog: v14.0.0-beta.16...v14.0.0-beta.17
What's Changed Breaking Changes π feat(index): change btree scalar index to row-address domain by @westonpace in #9481 perf(mem_wal): optimize Blob v2 writes and promotion by @jackye1995 in #9717 feat(cleanup): add configurable delete concurrency by @majin1102 in #9774 New Features π feat(python): expose the fragment ids of a dataset by @zhangyue19921010 in #9592 feat: record row-address moves forβ¦
What's Changed Breaking Changes π feat(mem_wal): evaluate fuzzy conjunctions on the active memtable by @hamersaw in #9526 Bug Fixes π fix(file): verify 2.1+ nullability against name-selected columns by @jackylee-ch in #9247 fix: avoid panic for missing duplicate field id by @zhangyue19921010 in #9448 fix: enforce AIMD delete request budget by @kamronis in #9707 fix: keep stable row IDs when cloninβ¦