Skip to content

1.9.0

Latest
Compare
Choose a tag to compare
@moomindani moomindani released this 12 Dec 08:54
d8259f9
  • Allow to load big seed files
  • Migrates the PySpark code for the Iceberg file format at a macro level, making the impl.py file more readable.
  • Fixes the get_columns_in_relation function to work for both Iceberg and non-Iceberg tables without hard-coding the catalog name.
  • Fixes the get_location table function to work for both Iceberg and non-Iceberg tables on macOS and Windows.
  • Adds a helper function to retrieve the Iceberg catalog namespace from the profile.yaml file.
  • Adds merge_exclude_columns and incremental_predicates features.
  • Drop Python 3.8 support
  • Upgrade default Glue version to 5.0
  • Upgrade dependencies: dbt-core 1.9.0 and dbt-spark 1.9.0
    https://github.com/aws-samples/dbt-glue/blob/main/CHANGELOG.md