Skip to content

Releases: apache/iceberg-rust

v0.5.1

05 Jun 05:18
80feb07
Compare
Choose a tag to compare

What's Changed

  • Chore: Add AboveMax and BelowMin by @Fokko in #820
  • fix: Reading a table with positional deletes should fail by @Fokko in #826
  • chore: Updated Changelog for 0.4.0-rc3 by @sungwy in #830
  • fix(datafusion): Align schemas for DataFusion plan and stream by @gruuya in #829
  • Add crate for sqllogictest. by @liurenjie1024 in #827
  • chore(deps): Bump crate-ci/typos from 1.28.3 to 1.28.4 by @dependabot in #832
  • chore: update download link to 0.4.0 by @sungwy in #836
  • refactor: Remove spawn and channel inside arrow reader by @Xuanwo in #806
  • chore: improve and fix the rest example by @goldmedal in #842
  • feat: Bump opendal to 0.51 by @Xuanwo in #839
  • fix: support both gs and gcs schemes for google cloud storage by @chenzl25 in #845
  • feat: Expose disable_config_load opendal GCS option by @chenzl25 in #847
  • fix: project_bacth to project_batch by @feniljain in #848
  • build: check in Cargo.lock by @xxchan in #851
  • ci: use officail rustsec/audit-check action by @xxchan in #843
  • feat: add s3tables catalog by @flaneur2020 in #807
  • fix: fix sql catalog drop table by @Li0k in #853
  • ci: add rust-cache action by @xxchan in #844
  • chore: Fix cargo.lock not updated by @Xuanwo in #855
  • fix(catalog): delete metadata file when droping table in MemoryCatalog by @lewiszlw in #854
  • chore(deps): Bump serde from 1.0.216 to 1.0.217 by @dependabot in #860
  • chore(deps): Bump reqwest from 0.12.10 to 0.12.11 by @dependabot in #859
  • chore(deps): Bump aws-sdk-s3tables from 1.1.0 to 1.2.0 by @dependabot in #858
  • Add orbstack guide by @lewiszlw in #856
  • feat: support metadata table "snapshots" by @xxchan in #822
  • feat: Support metadata table "Manifests" by @flaneur2020 in #861
  • feat: support serialize/deserialize DataFile into avro bytes by @ZENOTME in #797
  • [doc] Remove registry mirror recommendations by @kevinjqliu in #866
  • fix: valid identifier id in nested map fail by @ZENOTME in #864
  • chore: datafusion 44 upgrade by @gruuya in #867
  • fix: parse var len of decimal for parquet statistic by @ZENOTME in #837
  • ci: use taiki-e/install-action to install tools from binary by @xxchan in #852
  • chore(deps): Bump crate-ci/typos from 1.28.4 to 1.29.4 by @dependabot in #873
  • chore(deps): Bump aws-sdk-s3tables from 1.2.0 to 1.3.0 by @dependabot in #874
  • chore(deps): Bump reqwest from 0.12.11 to 0.12.12 by @dependabot in #875
  • chore(deps): Bump moka from 0.12.8 to 0.12.9 by @dependabot in #876
  • chore(deps): Bump async-trait from 0.1.83 to 0.1.84 by @dependabot in #877
  • chore(deps): Bump tempfile from 3.14.0 to 3.15.0 by @dependabot in #878
  • Split metadata tables into separate modules by @rshkv in #872
  • Rename 'metadata_table' to 'inspect' by @rshkv in #881
  • Metadata table scans as streams by @rshkv in #870
  • chore(deps): Bump tokio from 1.42.0 to 1.43.0 by @dependabot in #885
  • chore(deps): Bump moka from 0.12.9 to 0.12.10 by @dependabot in #886
  • chore(deps): Bump aws-sdk-glue from 1.74.0 to 1.76.0 by @dependabot in #887
  • chore(deps): Bump serde_json from 1.0.134 to 1.0.135 by @dependabot in #889
  • chore(deps): Bump aws-config from 1.5.11 to 1.5.13 by @dependabot in #888
  • Handle converting Utf8View & BinaryView to Iceberg schema by @phillipleblanc in #831
  • feat(puffin): Parse Puffin FileMetadata by @fqaiser94 in #765
  • ci: check MSRV correctly by @xxchan in #849
  • fix: spark version in integration_tests by @feniljain in #894
  • refine: refine interface of ManifestWriter by @ZENOTME in #738
  • feat(datafusion): Support cast operations by @Fokko in #821
  • chore(deps): Bump opendal from 0.51.0 to 0.51.1 by @dependabot in #898
  • chore(deps): Bump async-trait from 0.1.84 to 0.1.85 by @dependabot in #897
  • chore(deps): Bump arrow-schema from 53.3.0 to 53.4.0 by @dependabot in #900
  • chore(deps): Bump aws-sdk-s3tables from 1.3.0 to 1.4.0 by @dependabot in #899
  • fix: fix timesmtap_ns serde name by @ZENOTME in #905
  • add python version support range to pyproject.toml by @trim21 in #903
  • feat: support scan nested type(struct, map, list) by @ZENOTME in #882
  • fix: Sort Order ID in TableMetadataBuilder changes should be updated by @c-thiel in #909
  • Add pyspark DataFusion integration test by @gruuya in #850
  • test: replace assert!(<actual> == <real>) by assert_eq!(<actual>, <real>) in some tests by @hussein-awala in #910
  • refactor: fix a typo in manifest_entries field name by @hussein-awala in #911
  • chore(deps): Bump aws-sdk-s3tables from 1.4.0 to 1.6.0 by @dependabot in #912
  • chore(deps): Bump uuid from 1.12.0 to 1.12.1 by @dependabot in #913
  • chore(deps): Bump aws-config from 1.5.13 to 1.5.15 by @dependabot in #914
  • chore(deps): Bump arrow-array from 53.3.0 to 53.4.0 by @dependabot in #915
  • Add Truncate for Binary type by @Fokko in #920
  • Bump number of open Dependabot PRs by @Fokko in #921
  • chore(deps): Bump tempfile from 3.15.0 to 3.16.0 by @dependabot in #931
  • chore(deps): Bump arrow-select from 53.3.0 to 53.4.0 by @dependabot in #927
  • chore(deps): Bump aws-sdk-s3tables from 1.6.0 to 1.7.0 by @dependabot in #926
  • chore(deps): Bump arrow-ord from 53.3.0 to 53.4.0 by @dependabot in #930
  • chore(deps): Bump serde_json from 1.0.135 to 1.0.138 by @dependabot in #929
  • chore(deps): Bump arrow-cast from 53.3.0 to 53.4.0 by @dependabot in #925
  • chore(deps): Bump aws-sdk-s3tables from 1.7.0 to 1.8.0 by @dependabot in #938
  • chore(deps): Bump arrow-string from 53.3.0 to 53.4.0 by @dependabot in #937
  • chore(deps): Bump crate-ci/typos from 1.29.4 to 1.29.5 by @dependabot in #934
  • chore(deps): Bump parquet from 53.3.0 to 53.4.0 by @dependabot in #935
  • chore(deps): Bump async-trait from 0.1.85 to 0.1.86 by @dependabot in #936
  • fix(s3): path-style-access means no virtual-host by @twuebi in #944
  • Table Scan Delete File Handling: Positional and Equality Delete Support by @sdd in #652
  • feat(glue): use the same props for creating aws sdk and for FileIO by @omerhadari in #947
  • chore: use shared containers for integration tests by @gruuya in #924
  • feat(puffin): Add PuffinReader by @fqaiser94 in #892
  • fix: Make s3tables catalog public by @zilder in #918
  • fix(metadata): export iceberg schema in manifests table by @flaneur2020 in #871
  • chore: fix...
Read more

v0.4.0

24 Dec 03:18
Compare
Choose a tag to compare

What's Changed

  • io: add support for role arn and external id s3 props by @mattheusv in #553
  • fix: ensure S3 and GCS integ tests are conditionally compiled only when the storage-s3 and storage-gcs features are enabled by @sdd in #552
  • docs: fix main iceberg example by @jdockerty in #554
  • io: add support to set assume role session name by @mattheusv in #555
  • test: refactor datafusion test with memory catalog by @FANNG1 in #557
  • chore: add clean job in Makefile by @ChinoUkaegbu in #561
  • docs: Fix build website permission changed by @Xuanwo in #564
  • Object Cache: caches parsed Manifests and ManifestLists for performance by @sdd in #512
  • Update the paths by @Fokko in #569
  • docs: Add links for released crates by @Xuanwo in #570
  • Python: Use hatch for dependency management by @sungwy in #572
  • Ensure that RestCatalog passes user config to FileIO by @sdd in #476
  • Move zlib and unicode licenses to allow by @Fokko in #566
  • website: Update links for 0.3.0 by @Xuanwo in #573
  • feat(timestamp_ns): Implement timestamps with nanosecond precision by @Sl1mb0 in #542
  • fix: correct partition-id to field-id in UnboundPartitionField by @FANNG1 in #576
  • fix: Update sqlx from 0.8.0 to 0.8.1 by @FANNG1 in #584
  • chore(deps): Update typed-builder requirement from 0.19 to 0.20 by @dependabot in #582
  • Expose Transforms to Python Binding by @sungwy in #556
  • chore(deps): Bump crate-ci/typos from 1.23.6 to 1.24.1 by @dependabot in #583
  • Table Scan: Add Row Group Skipping by @sdd in #558
  • chore: bump crate-ci/typos to 1.24.3 by @sdlarsen in #598
  • feat: SQL Catalog - namespaces by @callum-ryan in #534
  • feat: Add more fields in FileScanTask by @Xuanwo in #609
  • chore(deps): Bump crate-ci/typos from 1.24.3 to 1.24.5 by @dependabot in #616
  • fix: Less Panics for Snapshot timestamps by @c-thiel in #614
  • feat: partition compatibility by @c-thiel in #612
  • feat: SortOrder methods should take schema ref if possible by @c-thiel in #613
  • feat: add client.region by @jdockerty in #623
  • fix: Correctly calculate highest_field_id in schema by @liurenjie1024 in #590
  • Feat: Normalize TableMetadata by @c-thiel in #611
  • refactor(python): Expose transform as a submodule for pyiceberg_core by @Xuanwo in #628
  • feat: support projection pushdown for datafusion iceberg by @FANNG1 in #594
  • chore: Bump opendal to 0.50 by @Xuanwo in #634
  • feat: add Sync to TransformFunction by @xxchan in #638
  • feat: expose arrow type <-> iceberg type by @xxchan in #637
  • doc: improve FileIO doc by @xxchan in #642
  • chore(deps): Bump crate-ci/typos from 1.24.5 to 1.24.6 by @dependabot in #640
  • Migrate to arrow-* v53 by @sdd in #626
  • feat: expose remove_all in FileIO by @xxchan in #643
  • feat (datafusion integration): convert datafusion expr filters to Iceberg Predicate by @a-agmon in #588
  • feat: Add NamespaceIdent.parent() by @c-thiel in #641
  • Table Scan: Add Row Selection Filtering by @sdd in #565
  • fix: compile error due to merge stale PR by @xxchan in #646
  • scan: change ErrorKind when table dont have spanshots by @mattheusv in #608
  • fix: avoid to create operator of memory storage every time by @ZENOTME in #635
  • feat (datafusion): making IcebergTableProvider public to be used without a catalog by @a-agmon in #650
  • test (datafusion): add test for table provider creation by @a-agmon in #651
  • fix: page index evaluator min/max args inverted by @sdd in #648
  • chore: fix typo in FileIO Schemes by @wcy-fdu in #653
  • fix: TableUpdate Snapshot deserialization for v1 by @c-thiel in #656
  • feat: Reassign field ids for schema by @c-thiel in #615
  • feat: add gcp oauth support by @twuebi in #654
  • fix(arrow): Use new ParquetMetaDataReader instead by @Xuanwo in #661
  • chore(deps): bump typos crate to 1.25.0 by @matthewwillian in #662
  • RecordBatchTransformer: Handle schema migration and column re-ordering in table scans by @sdd in #602
  • docs: installation of the new iceberg_catalog_rest added to the docs by @nishant-sachdeva in #355
  • feat(datafusion): Support pushdown more datafusion exprs to Iceberg by @FANNG1 in #649
  • feat: Derive PartialEq for FileScanTask by @Xuanwo in #660
  • feat: SQL Catalog - Tables by @callum-ryan in #610
  • ci: Allow install a non-debian-packaged Python package by @Xuanwo in #666
  • docs: README uses iceberg-rust instead of we by @caicancai in #667
  • chore(deps): Bump crate-ci/typos from 1.25.0 to 1.26.0 by @dependabot in #668
  • feat: Add equality delete writer by @Dysprosium0626 in #372
  • Revert "feat: Add equality delete writer (#372)" by @Xuanwo in #672
  • ci: Fix CI for bindings python by @Xuanwo in #678
  • fix: OpenDAL is_exist => exists by @sdd in #680
  • feat: Expose ManifestEntry status by @zheilbron in #681
  • feat: allow empty projection in table scan by @sundy-li in #677
  • chore(deps): Bump crate-ci/typos from 1.26.0 to 1.26.8 by @dependabot in #683
  • fix: bump parquet minor version by @xxchan in #684
  • fix(type): fix type promote to ignore field name. by @chenzl25 in #685
  • feat: implement IcebergTableProviderFactory for datafusion by @yukkit in #600
  • feat: Safer PartitionSpec & SchemalessPartitionSpec by @c-thiel in #645
  • chore(deps): Bump crate-ci/typos from 1.26.8 to 1.27.0 by @dependabot in #687
  • feat: TableMetadata accessors for current ids of Schema, Snapshot and SortOrder by @c-thiel in #688
  • chore: upgrade to DataFusion 43 by @gruuya in #691
  • chore(deps): Bump crate-ci/typos from 1.27.0 to 1.27.3 by @dependabot in #693
  • feat: Expose length of Iterators by @c-thiel in #692
  • feat: Implement TableRequirement checks by @c-thiel in #689
  • feat: Add ViewUpdate to catalog by @c-thiel in #690
  • chore: update .asf.yaml by @c-thiel in #701
  • datafusion: Create table provider for a snapshot. by @ryzhyk in #707
  • Add Python Release Action to publish pyiceberg_core dist to Pypi by @sungwy in #705
  • chore: Mark last-field-id as deprecated by @Fokko in #715
  • TableMetadataBuilder by @c-thiel in #587
  • Add fallback attribute to all strip_options. by @ryzhyk in #708
  • fix: Remove check of last_column_id by @liurenjie1024 in #717
  • Fix error running data fusion queries - Physical input schema should be...
Read more

v0.3.0

19 Aug 10:20
v0.3.0
79711ac
Compare
Choose a tag to compare

What's Changed

Read more

Iceberg-rust 0.2.0

20 Feb 09:07
adef9bd
Compare
Choose a tag to compare

What's Changed

Read more