Releases: aws-samples/dbt-glue
Releases · aws-samples/dbt-glue
1.9.0
- Allow to load big seed files
- Migrates the PySpark code for the Iceberg file format at a macro level, making the impl.py file more readable.
- Fixes the get_columns_in_relation function to work for both Iceberg and non-Iceberg tables without hard-coding the catalog name.
- Fixes the get_location table function to work for both Iceberg and non-Iceberg tables on macOS and Windows.
- Adds a helper function to retrieve the Iceberg catalog namespace from the profile.yaml file.
- Adds merge_exclude_columns and incremental_predicates features.
- Drop Python 3.8 support
- Upgrade default Glue version to 5.0
- Upgrade dependencies: dbt-core 1.9.0 and dbt-spark 1.9.0
https://github.com/aws-samples/dbt-glue/blob/main/CHANGELOG.md
1.8.6
- Fix session provisioning timeout and delay handling
- Add write options for Delta format
- Add on_schema_change possibility
- Fix table materialization for Delta models
- Change GlueColumn parent from base Column to SparkColumn
- Fix unraised DbtDatabaseError
- Fix get_columns_in_relation function to stop returning additional partition columns
- Fix null values handling in seeds
- Fix exceptions import for FailedToConnectError and ExecutableError
- Fix the case-sensitive comparison on the seed name
https://github.com/aws-samples/dbt-glue/blob/main/CHANGELOG.md