What's Changed New Features ๐ feat(io): apply byte-sized batch budget to blob materialization by @lichuang in #8927 feat(index): implement stable partition mapping readers by @LuQQiu in #9064 feat(knn): expose ANNIvfBatchExec's query, width and inputs by @hamersaw in #9262 feat(mem_wal): evaluate cross-column predicates on the fresh tier by @hamersaw in #9292 Bug Fixes ๐ fix(index): narrow f16/f64โฆ
What's Changed Breaking Changes ๐ perf(encoding)!: initialize only the page metadata a read will touch by @Ali2Arslan in #7465 New Features ๐ feat(format): specify carried-column storage and allow carrying a keyed column by @vivek-bharathan in #8856 feat(core): define mapping readers with ordered compaction support by @LuQQiu in #9106 feat(mem_wal): cross-column FTS on the fresh tier by @hamersawโฆ
What's Changed New Features ๐ feat(format): define a unified tagged fragment reuse history by @LuQQiu in #9136 feat(io): expose Hugging Face resolve cache option by @Xuanwo in #9236 Bug Fixes ๐ fix(label_list): bound index build memory with a sorted stream by @vivek-bharathan in #8840 fix(datafusion): coerce numeric literals to and from Float16 by @LuciferYang in #8847 fix(linalg): point length-coโฆ
What's Changed Breaking Changes ๐ feat!: expose file writer page options in dataset APIs by @ddupg in #9192 New Features ๐ feat: expose exact V2 versions in bindings by @Xuanwo in #8585 feat(overlay): add a writer for data overlay files by @wjones127 in #8761 feat(encoding): implement plan_decoded_bytes for fixed-width structural decoder by @westonpace in #8792 feat(mem_wal): evaluate compound FTSโฆ
Release root for 13.0.0-beta.N series (same base as 12.1.0-beta.N)
What's Changed Breaking Changes ๐ feat(io)!: paginated directory listing on ObjectStore by @wjones127 in #8606 perf(mem_wal)!: serve the shard manifest from the store that wrote it by @hamersaw in #8640 feat(table): predecessor-conditioned publication for external manifest stores by @wkalt in #8800 feat(namespace)!: accept multiple columns for the merge insert on key by @wjones127 in #8915 feat: mโฆ
Release root for 12.1.0-beta.N series
What's Changed New Features ๐ feat(python): return matched row offsets from fragment update_columns by @zhangyue19921010 in #8891 feat(index): split IVF partitions to target size and join undersized ones in one optimize pass by @BubbleCal in #9051 Bug Fixes ๐ fix(encoding): prevent bits_per_value=0 in FullZipLayout for FSL with AllNull child by @westonpace in #9130 fix: load external fragment reusโฆ
What's Changed New Features ๐ feat(java): support segment-based distributed vector search by @summaryzb in #7169 Bug Fixes ๐ fix: honor zero scanner limits by @app/lance-gatefixer in #9111 Performance Improvements ๐ perf(fts): accelerate wide and queries with bulk intersection by @BubbleCal in #9030 perf(fts): bound classic conjunction scoring in dense windows by @BubbleCal in #9033 Full Changelogโฆ
What's Changed Breaking Changes ๐ feat: make data file parts serializable by @Xuanwo in #9072 New Features ๐ fix(mem-wal): resolve writer shard spec identity by @u70b3 in #8112 feat(java): expose merge insert write mode by @zhangyue19921010 in #8918 feat(index): proportional hierarchical k-means for IVF training by @BubbleCal in #9050 feat: expose public accessor for the fragment reuse index by @bโฆ
What's Changed New Features ๐ feat: resolve stable file format to 2.2 by @Xuanwo in #8657 Bug Fixes ๐ fix(index): replace scalar cache entries on store rotation by @u70b3 in #7962 fix(index): widen the RaBitQ FastScan accumulator above 1024 dims by @wombatu-kun in #8842 fix: copy sliced arrays from logical offsets by @jackye1995 in #9048 Performance Improvements ๐ perf(cleanup): avoid reading maniโฆ
What's Changed New Features ๐ feat(java): align inverted index options by @ddupg in #8829 feat(java): complete transaction operation mappings by @everySympathy in #8925 feat(mem_wal): record what a flushed SSTable holds by @xuanyu-z in #8981 Bug Fixes ๐ fix(index): declare FM index row address results by @app/lance-gatefixer in #8855 fix: let analyze_plan run under a caller-provided TaskContext byโฆ
What's Changed New Features ๐ feat(java): expose referenced file metadata by @everySympathy in #8962 Bug Fixes ๐ fix(sql): classify malformed SQL queries as invalid input by @wjones127 in #8974 Documentation ๐ docs(linalg): document SIMD conversion panics by @app/lance-gatefixer in #8862 Full Changelog: v12.0.0-beta.12...v12.0.0-beta.13
What's Changed Breaking Changes ๐ feat(table): predecessor-conditioned publication for external manifest stores by @wkalt in #8800 feat(namespace)!: accept multiple columns for the merge insert on key by @wjones127 in #8915 New Features ๐ feat(python): add LanceDataset.slice() method by @Sapnilb15 in #8059 feat(java): expose createIndex progress callbacks by @hfutatzhanghb in #8823 feat: add calleโฆ
What's Changed Bug Fixes ๐ fix(index): keep a commit alive when an index cannot be opened by @wombatu-kun in #8441 fix(compaction): reject unsafe binary column layouts by @app/lance-gatefixer in #8510 Performance Improvements ๐ perf(merge_insert): probe the most selective indexed key first and stop early by @LuciferYang in #8719 perf(commit): drop O(C^2) field lookups from column index validationโฆ
What's Changed New Features ๐ feat: budget blob materialization readahead by @jackye1995 in #8919 Bug Fixes ๐ fix(linalg): widen u8 distance accumulators by @app/lance-gatefixer in #8888 Full Changelog: v12.0.0-beta.9...v12.0.0-beta.10
What's Changed Other Changes revert: add column slice stitching by @Xuanwo in #8926 Full Changelog: v12.0.0-beta.8...v12.0.0-beta.9
What's Changed Bug Fixes ๐ fix(fts): align v1 merge reads with writer batches by @BubbleCal in #8922 Full Changelog: v12.0.0-beta.7...v12.0.0-beta.8
What's Changed New Features ๐ feat(python): expose more scanner options on LanceFragment by @keunhong in #8429 feat(cleanup): support cleaning specific dataset versions by @hfutatzhanghb in #8617 feat(python): restore index retraining by @ddupg in #8786 feat(mem_wal): let a writer read its own indexed prefix by @hamersaw in #8835 fix(mem_wal): honor distance_range in the LSM vector planner by @hamโฆ
What's Changed New Features ๐ feat: add column slice stitching by @Xuanwo in #8660 Bug Fixes ๐ fix(python): declare the index training helpers as returning FixedSizeListArray by @jonasdedden in #8491 fix(python): annotate count_rows, versions and optimize_indices by @jonasdedden in #8493 fix: support Time32 integer casts in filters by @app/lance-gatefixer in #8508 fix: keep LabelList index currentโฆ
What's Changed Breaking Changes ๐ refactor!: compose exact current-format readers by @Xuanwo in #8024 refactor: centralize exact dataset write policy by @Xuanwo in #8025 refactor: move file-version selectors to lance-file by @Xuanwo in #8026 refactor: centralize dataset version policies by @Xuanwo in #8027 refactor: make index file versions exact by @Xuanwo in #8028 feat(mem_wal): return the sealeโฆ
What's Changed Bug Fixes ๐ fix: validate primary key nullability on every path that can change it by @xuanyu-z in #8101 fix(index): keep an index this build cannot read out of the erase path by @wombatu-kun in #8427 fix(python): don't seed IVF centroids with NaN vectors by @jonasdedden in #8782 fix(hnsw): make a persisted HNSW cover its rows and reject invalid ones by @xuanyu-z in #8834 fix(fs): fโฆ
What's Changed New Features ๐ perf(java): reduce fragment statistics allocations by @everySympathy in #8452 feat: add mixed data file version capability by @Xuanwo in #8580 Bug Fixes ๐ fix(encoding): read wrapped miniblock level counts by @app/lance-gatefixer in #8410 fix(fts): preserve global scoring for no-impact indexes by @BubbleCal in #8748 fix(fts): canonicalize fuzzy expansion across segmenโฆ
What's Changed New Features ๐ feat(encoding): add CANDIDATE_BATCH_SIZES and plan_decoded_bytes trait defaults by @westonpace in #8791 Bug Fixes ๐ fix(python): spell misnamed without a hyphen so the typos gate passes by @jackylee-ch in #8766 Performance Improvements ๐ perf(rowids): reuse cursors across sequential batches by @jiaoew1991 in #8713 perf(fts): complete ambiguous WAND ties without full rโฆ
What's Changed New Features ๐ feat(mem_wal): make write backpressure injectable and account index memory by @hamersaw in #7831 Full Changelog: v12.0.0-beta.1...v12.0.0-beta.2
What's Changed Breaking Changes ๐ feat(io)!: paginated directory listing on ObjectStore by @wjones127 in #8606 perf(mem_wal)!: serve the shard manifest from the store that wrote it by @hamersaw in #8640 New Features ๐ feat(python): expose ObjectStoreProvider registration in pylance by @farazshaikh in #8522 feat: support BinaryView in packed blob writer via iterator-based extraction by @lichuang inโฆ
Release root for 12.0.0-beta.N series (same base as 11.1.0-beta.N)
What's Changed Breaking Changes ๐ refactor!: compose exact current-format readers by @Xuanwo in #8024 refactor: centralize exact dataset write policy by @Xuanwo in #8025 refactor: move file-version selectors to lance-file by @Xuanwo in #8026 refactor: centralize dataset version policies by @Xuanwo in #8027 refactor: make index file versions exact by @Xuanwo in #8028 feat(mem_wal): return the sealeโฆ
What's Changed Breaking Changes ๐ refactor!: compose exact current-format readers by @Xuanwo in #8024 refactor: centralize exact dataset write policy by @Xuanwo in #8025 refactor: move file-version selectors to lance-file by @Xuanwo in #8026 refactor: centralize dataset version policies by @Xuanwo in #8027 refactor: make index file versions exact by @Xuanwo in #8028 feat(mem_wal): return the sealeโฆ
Release root for 11.1.0-beta.N series