3 Releases published by 1 person

• python-v1.0.0 python-v1.0.0: Zero to One

  published May 28, 2025

• python-v1.0.1

  published May 30, 2025

• python-v1.0.2

  published Jun 2, 2025

64 Pull requests merged by 15 people

• feat: add convenience extension for kernel engine types

  #3510 merged Jun 1, 2025

• refactor: move LazyTableProvider into python crate

  #3509 merged Jun 1, 2025

• fix: setting wrong schema in table provider for merge

  #3508 merged Jun 1, 2025

• fix: constraint parsing, roundtripping

  #3503 merged May 30, 2025

• refactor!: have DeltaTable::version return an Option

  #3500 merged May 30, 2025

• chore!: remove get_earliest_version

  #3499 merged May 29, 2025

• chore: prepare for the next python release

  #3498 merged May 29, 2025

• ci: improve coverage collection

  #3497 merged May 29, 2025

• chore: update runner

  #3494 merged May 29, 2025

• docs: update link to df

  #3489 merged May 28, 2025

• fix: ensure projecting only columns that exist in new files afte sche…

  #3487 merged May 28, 2025

• refactor!: remove and deprecate some python methods

  #3488 merged May 28, 2025

• chore: exclude Invariants from the default writer v2 feature set

  #3486 merged May 28, 2025

• test: improve storage config testing

  #3485 merged May 28, 2025

• refactor!: get transaction versions for specific applications

  #3484 merged May 28, 2025

• docs: fix bullet list formatting in dagster docs

  #3483 merged May 28, 2025

• fix: set casting safe param to False

  #3481 merged May 28, 2025

• chore: update kernel to 0.11

  #3480 merged May 28, 2025

• chore: update migration docs

  #3479 merged May 28, 2025

• fix: schema conversion, add conversion test cases

  #3468 merged May 28, 2025

• chore: remove unused stats_parsed field

  #3475 merged May 27, 2025

• feat: add a table description and name to the Delta Table from Python

  #3464 merged May 26, 2025

• refactor: remove protocol error

  #3473 merged May 26, 2025

• chore: more typos

  #3471 merged May 25, 2025

• chore: remove unused time_utils

  #3470 merged May 25, 2025

• feat: write checkpoints with kernel

  #3466 merged May 25, 2025

• fix: correct spelling errors found by CI spell checker

  #3465 merged May 25, 2025

• chore: update kernel

  #3462 merged May 25, 2025

• chore: set correct markers

  #3469 merged May 25, 2025

• fix: use more accurate log path parsing

  #3461 merged May 25, 2025

• refactor: use full paths in log processing

  #3456 merged May 25, 2025

• refactor: remove pyarrow dependency

  #3459 merged May 24, 2025

• chore: mark more tests which require datafusion

  #3458 merged May 23, 2025

• ci: add spellchecker to pr tests

  #3457 merged May 23, 2025

• chore: ensuring default builds work without datafusion

  #3453 merged May 22, 2025

• refactor: use LogStore in Snapshot / LogSegment APIs

  #3452 merged May 20, 2025

• test: avoid circular dependency with core/test crates

  #3450 merged May 19, 2025

• feat: expose kernel Engine on LogStore

  #3446 merged May 18, 2025

• refactor: more specific factory parameter names

  #3445 merged May 17, 2025

• docs: add 1.0.0 migration guide

  #3443 merged May 17, 2025

• chore: minor table module refactors

  #3442 merged May 17, 2025

• chore: remove unused code and deps

  #3441 merged May 17, 2025

• chore: experiment with using sccache in GitHub Actions

  #3437 merged May 16, 2025

• feat: optimize datafusion predicate pushdown and partition pruning

  #3436 merged May 16, 2025

• fix: ignore temp log entries

  #3423 merged May 16, 2025

• chore: prepare py-1.0 release

  #3435 merged May 16, 2025

• chore: make codecov more vigorously enforced to help ensure quality

  #3434 merged May 15, 2025

• chore: rely on the testing during coverage generation to speed up tests

  #3431 merged May 15, 2025

• feat: spawn io with spawn service

  #3426 merged May 15, 2025

• chore: bump crate versions which are due for release

  #3430 merged May 15, 2025

• feat: added a check for gc code to run

  #3419 merged May 15, 2025

• feat: during LakeFS file operations, skip merge when 0 changes

  #3346 merged May 14, 2025

• chore(deps): bump foyer to v0.17.2 to prevent from wrong result

  #3428 merged May 14, 2025

• chore: include license file in deltalake-derive crate

  #3417 merged May 7, 2025

• fix: drop column update

  #3416 merged May 7, 2025

• fix: build Unity Catalog crate without DataFusion

  #3420 merged May 7, 2025

• chore: missed a version bump for core

  #3415 merged May 5, 2025

• chore: bringing dat integration testing in ahead of kernel replay

  #3411 merged May 5, 2025

• chore(deps): update foyer requirement from 0.16.1 to 0.17.0

  #3412 merged May 5, 2025

• chore(deps): update sqlparser requirement from 0.53.0 to 0.56.0

  #3413 merged May 5, 2025

• fix: if field contains space in constraint expression, checks will fail

  #3374 merged May 3, 2025

• feat: introduce VacuumMode::Full for cleaning up orphaned files

  #3368 merged May 3, 2025

• chore: reduce scope of feature flags and compilation requirements for subcrates

  #3409 merged May 3, 2025

• chore: commit the contents of the 0.26.0 release

  #3408 merged May 3, 2025

8 Pull requests opened by 7 people

• feat: implement object store that caches to disk

  #3439 opened May 17, 2025

• feat: add log file caching layer

  #3440 opened May 17, 2025

• feat: wiring up some kernel log utilization via DefaultLogStore

  #3444 opened May 17, 2025

• fear: read CDF with Kernel

  #3467 opened May 25, 2025

• [RFC] feat!: kernel based log replay - take 2

  #3474 opened May 26, 2025

• fix: make DeltaTable pickleable

  #3501 opened May 30, 2025

• fix: creating new DeltaTable with invalid table name path no longer creates empty directory

  #3504 opened May 31, 2025

• fix: retry advancement of `PreparedCommit` into `PostCommit` in case version 0 already exists (created by another writer)

  #3513 opened Jun 2, 2025

28 Issues closed by 4 people

• allow_unsafe_rename option stopped working in version 1

  #3493 closed Jun 2, 2025

• bug: timezone not preserved & raise exc on merge operation

  #3507 closed Jun 1, 2025

• Don't retry lakefs commit or merge on `412` response (precondition failed)

  #3429 closed May 30, 2025

• predicate appears to ignore partition and stats in pruning

  #3491 closed May 28, 2025

• Expose a python method to use RecordBatchReader instead of PyArrow Dataset

  #1814 closed May 28, 2025

• `max_rows_per_file` ignored when writing with rust engine

  #3490 closed May 28, 2025

• v1.0 Release tracking issue

  #3250 closed May 28, 2025

• When not matched by source triggers full scan

  #3476 closed May 27, 2025

• Alter table description

  #3401 closed May 26, 2025

• Remove pyarrow dependency (make opt-in), replace with arro3 for core components

  #3455 closed May 24, 2025

• Link to Slack in `README.md` has expired

  #2694 closed May 22, 2025

• Add analytics to documentation page

  #2203 closed May 22, 2025

• docs: add analytics

  #1939 closed May 22, 2025

• Support generating Substrait plans

  #830 closed May 22, 2025

• Python: Create PySpark integration tests for reading/writing

  #579 closed May 22, 2025

• Add user guide to Rust docs

  #831 closed May 22, 2025

• First pass at Rust documentation

  #861 closed May 22, 2025

• ADBC Driver

  #954 closed May 22, 2025

• delta-rs includes pending versions written by spark

  #3422 closed May 16, 2025

• Use `object_store` spawnService

  #3427 closed May 15, 2025

• Merge touches more partitions than necessary?

  #3432 closed May 15, 2025

• Generated columns feature needs to be checked

  #3180 closed May 15, 2025

• lakefs: during file operations, skip merge when 0 changes

  #3190 closed May 14, 2025

• Onelake incompatible with rustls

  #3243 closed May 13, 2025

• Column __delta_rs_update_predicate when update a table

  #3414 closed May 7, 2025

• Unable to use deltalake with MinIO

  #3418 closed May 6, 2025

• Add DAT tests for Rust

  #863 closed May 5, 2025

• Vacuum command should support "full" mode too!

  #2349 closed May 3, 2025

3 Issues opened by 3 people

• Initial table creation may fail with multiple writers

  #3505 opened May 31, 2025

• deletion vector for vacuuming

  #3454 opened May 22, 2025

• Checkpoints not used by write_deltalake?

  #3410 opened May 4, 2025

25 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• nested fields count towards limit of stats calculation of first 32 columns

  #3172 commented on May 5, 2025 • 0 new comments

• trying to access table in s3 hangs forever with current_thread runtime flavor

  #3336 commented on May 5, 2025 • 0 new comments

• Schema merge failed since switch to Datafusion if a field is a list of structs

  #3339 commented on May 5, 2025 • 0 new comments

• After checkpoint statistics are not available in add_actions_table if stats written as struct

  #3375 commented on May 5, 2025 • 0 new comments

• delta-rs fails to open a table with domainMetadata action in checkpoint

  #3360 commented on May 5, 2025 • 0 new comments

• Delta rs seems to allocate a lot of memory

  #3371 commented on May 5, 2025 • 0 new comments

• CDF not working due to vacuum deleting files that are still referenced by logs

  #3392 commented on May 5, 2025 • 0 new comments

• Error reading generationExpression in column metadata

  #3326 commented on May 5, 2025 • 0 new comments

• Partition pruning does not work when values in predicate do not match column datatype

  #3278 commented on May 5, 2025 • 0 new comments

• Support downcasting nanoseconds timestamps when converting a Parquet table to a Delta table

  #1721 commented on May 12, 2025 • 0 new comments

• DeltaTable.hisotry(): return `timestamp` column as `datetime` (not epoch integer)

  #3109 commented on May 13, 2025 • 0 new comments

• Add multiple constraints at once

  #1986 commented on May 15, 2025 • 0 new comments

• MERGE should raise when multiple source rows match target row

  #2407 commented on May 16, 2025 • 0 new comments

• Memory alignment error when writing Polars Dataframe with list of string datatype

  #3407 commented on May 18, 2025 • 0 new comments

• Error during vacuum: the length + offset of the sliced StructArray cannot exceed the existing length

  #3237 commented on May 21, 2025 • 0 new comments

• Support column mapping

  #930 commented on May 22, 2025 • 0 new comments

• Shallow clones

  #2456 commented on May 22, 2025 • 0 new comments

• Error reading V2 UUID-named checkpoint

  #3215 commented on May 22, 2025 • 0 new comments

• [tracking] Kernelize!

  #3298 commented on May 29, 2025 • 0 new comments

• Deletion vectors

  #1094 commented on May 29, 2025 • 0 new comments

• `to_pyarrow_table()` on a table in S3 kept getting "Generic S3 error: error decoding response body"

  #2595 commented on May 29, 2025 • 0 new comments

• Opening an incorrect table path causes an empty directory to be made

  #3060 commented on May 30, 2025 • 0 new comments

• [RFC] feat!: kernel-based log replay

  #3137 commented on May 6, 2025 • 0 new comments

• feat: expand ListingSchemaProvider to support register and deregister table

  #3150 commented on May 4, 2025 • 0 new comments

• docs: add standalone partition pages in user guide

  #3192 commented on May 4, 2025 • 0 new comments