Releases: dbt-labs/dbt-bigquery
Releases · dbt-labs/dbt-bigquery
dbt-bigquery v1.5.0b2
dbt-bigquery v1.5.0b1
dbt-bigquery 1.5.0-b1 - February 22, 2023
Features
- add option to specify excluded columns on merge (#5260)
- dbt-constraints support for BigQuery as per dbt-core issue #1358 (#444)
Fixes
- Make BQ access_grant updates thread safe (#266)
- Use IEC standard abbreviations (GiB, TiB, etc) (#477)
- Pin dataproc serverless spark runtime to
1.1(#531)
Under the Hood
- Remove manual retry to get python job status on cluster (#422)
- remove tox call to integration tests (#459)
Contributors
dbt-bigquery v1.4.1
dbt-bigquery v1.3.1
dbt-bigquery v1.4.0
dbt-bigquery Changelog
- This file provides a full account of all changes to
dbt-bigquery. - Changes are listed under the (pre)release in which they first appear. Subsequent releases include changes from previous releases.
- "Breaking changes" listed under a version may require action from end users or external maintainers when upgrading to that version.
- Do not edit this file directly. This file is auto-generated using changie. For details on how to document a change, see the contributing guide
dbt-bigquery 1.4.0 - January 25, 2023
Features
- Support for ingestion time partition table on BigQuery as incremental materialization (#75, #136)
- incremental predicates (#283, #284)
- Migrate dbt-utils current_timestamp macros into core + adapters (#324, #323)
- Optimize insert_overwrite incremental strategy with WRITE_TRUNCATE / Partition copy (#77, #167)
- Support BigQuery 'labels' and 'hours_to_expiration' configs for seeds. (#125, #133)
- Fetch table description to
catalog.json, so it can be shown in dbt docs (#173, #174)
Fixes
- use execution_project in python models (#355, #356)
- fix args for console link logging (#362, #363)
- stop eliminating trailing whitespace in incremental merge sql (#457, #458)
Under the Hood
- use gcp retry logic for new connections (#229, #230)
- event logging changes to be in parity with dbt-core post pr#6291 (#6139, #410)
- fix issue with tox 4.0.0 release which changes passenv syntax for space-separated variables (#411, #411)
- Truncates Job Labels to 63 Characters (#202, #442)
- Partition By unit test was failing, referenced the incorrect exception to be raised (#443, #445)
- Update exception names to match dbt-core (#441, #460)
Dependencies
- Bump google-cloud-bigquery dependency to < 3.3.3 (#269, #332)
- Add supoort for python 3.11 (#407, #431)
Contributors
- @Kayrnt (#136, #167, #363)
- @McKnight-42, (#174)
- @darrylng (#133)
- @dave-connors-3 (#284)
- @eplus-aolalere (#332)
- @ericapetersson (#356)
- @ernestoongaro (#442)
- @halvorlu (#174)
Previous Releases
For information on prior major and minor releases, see their changelogs:
dbt-bigquery v1.4.0rc1
dbt-bigquery Changelog
- This file provides a full account of all changes to
dbt-bigquery. - Changes are listed under the (pre)release in which they first appear. Subsequent releases include changes from previous releases.
- "Breaking changes" listed under a version may require action from end users or external maintainers when upgrading to that version.
- Do not edit this file directly. This file is auto-generated using changie. For details on how to document a change, see the contributing guide
dbt-bigquery 1.4.0-rc1 - January 11, 2023
Features
- incremental predicates (#283, #284)
- Support BigQuery 'labels' and 'hours_to_expiration' configs for seeds. (#125, #133)
- Fetch table description to
catalog.json, so it can be shown in dbt docs (#173, #174)
Fixes
Under the Hood
- use gcp retry logic for new connections (#229, #230)
- Truncates Job Labels to 63 Characters (#202, #442)
- Partition By unit test was failing, referenced the incorrect exception to be raised (#443, #445)
- Update exception names to match dbt-core (#441, #460)
Dependencies
Contributors
dbt-bigquery 1.4.0-b1 - December 15, 2022
Features
- Support for ingestion time partition table on BigQuery as incremental materialization (#75, #136)
- Migrate dbt-utils current_timestamp macros into core + adapters (#324, #323)
- Optimize insert_overwrite incremental strategy with WRITE_TRUNCATE / Partition copy (#77, #167)
Fixes
Under the Hood
- event logging changes to be in parity with dbt-core post pr#6291 (#6139, #410)
- fix issue with tox 4.0.0 release which changes passenv syntax for space-separated variables (#411, #411)
Dependencies
Contributors
- @Kayrnt (#136, #167, #363)
- @eplus-aolalere (#332)
- @ericapetersson (#356)
Previous Releases
For information on prior major and minor releases, see their changelogs:
dbt-bigquery v1.4.0b1
dbt-bigquery 1.4.0-b1 - December 15, 2022
Features
- Support for ingestion time partition table on BigQuery as incremental materialization (#75, #136)
- Migrate dbt-utils current_timestamp macros into core + adapters (#324, #323)
- Optimize insert_overwrite incremental strategy with WRITE_TRUNCATE / Partition copy (#77, #167)
Fixes
Under the Hood
- event logging changes to be in parity with dbt-core post pr#6291 (#6139, #410)
- fix issue with tox 4.0.0 release which changes passenv syntax for space-separated variables (#411, #411)
Dependencies
Contributors
- @Kayrnt (#136, #167, #363)
- @eplus-aolalere (#332)
- @ericapetersson (#356)
dbt-bigquery 1.3.0
dbt-bigquery 1.3.0 - October 12, 2022
Features
- Implement
create_schemavia SQL, instead of Python method, allowing users to override if desired. drop_schema remains a Python method for the time being. (#182, #183) - Added table and incrementail materializations for python models via DataProc. (#209, #226)
- Add support for Dataproc Serverless (#248, #303)
- Array macros (#307, #308)
- add type_boolean as a data type macro (#315, #313)
- Migrate dbt-utils current_timestamp macros into core + adapters (#324, #323)
Under the Hood
- Implement minimal changes to support dbt Core incremental materialization refactor. (#232, #223)
- Add changie to dbt-bigquery (#254, #253)
- Add location/job_id/project_id to adapter response to enable easy job linking (#92, #250)
- Adding
slot_msgoBigQueryAdapterResponse(#194, #195) - specify supported_languages for materialization that support python models (#288, #290)
- Convert df to pyspark DataFrame if it is pandas before writing (#301, #301)
- Update BQ job and call retry settings (#311, #310)
- Enable pandas-on-Spark DataFrames for dbt python models (#316, #317)
- Convert df to pyspark DataFrame if it is koalas before writing (#320, #321)
Dependency
Contributors
- @Kayrnt (#250)
- @chamini2 (#301)
- @colin-rogers-dbt (#323, #310)
- @dbeatty10 (#308, #317, #321)
- @graciegoheen (#308)
- @jpmmcneill (#313)
- @ueshin (#321)
- @yu-iskw (#195)
dbt-bigquery 1.3.0rc3
dbt-bigquery 1.3.0-rc3 - October 06, 2022
Under the Hood
- Manual pull operation for Dataproc cluster submission(#338)