Skip to content

Releases: aws-samples/dbt-glue

1.9.0

12 Dec 08:54
d8259f9
Compare
Choose a tag to compare
  • Allow to load big seed files
  • Migrates the PySpark code for the Iceberg file format at a macro level, making the impl.py file more readable.
  • Fixes the get_columns_in_relation function to work for both Iceberg and non-Iceberg tables without hard-coding the catalog name.
  • Fixes the get_location table function to work for both Iceberg and non-Iceberg tables on macOS and Windows.
  • Adds a helper function to retrieve the Iceberg catalog namespace from the profile.yaml file.
  • Adds merge_exclude_columns and incremental_predicates features.
  • Drop Python 3.8 support
  • Upgrade default Glue version to 5.0
  • Upgrade dependencies: dbt-core 1.9.0 and dbt-spark 1.9.0
    https://github.com/aws-samples/dbt-glue/blob/main/CHANGELOG.md

1.8.6

26 Sep 04:28
7c00efa
Compare
Choose a tag to compare
  • Fix session provisioning timeout and delay handling
  • Add write options for Delta format
  • Add on_schema_change possibility
  • Fix table materialization for Delta models
  • Change GlueColumn parent from base Column to SparkColumn
  • Fix unraised DbtDatabaseError
  • Fix get_columns_in_relation function to stop returning additional partition columns
  • Fix null values handling in seeds
  • Fix exceptions import for FailedToConnectError and ExecutableError
  • Fix the case-sensitive comparison on the seed name

https://github.com/aws-samples/dbt-glue/blob/main/CHANGELOG.md