0.4.9
Core Library
- SCD2 support by @jorritsandbrink in #1168 https://dlthub.com/devel/general-usage/incremental-loading#scd2-strategy
- A fully configurable layout for filesystem files by @sultaniman in #1182 https://dlthub.com/devel/dlt-ecosystem/destinations/filesystem#files-layout
- picks file format matching item format to minimize number of rewrites during loading by @rudolfix in #1222
- fix athena iceberg's trailing location by @romanperesypkin in #1230
- Pass options to parse iso like strings by @VioletM in #1219
- pipeline state can be restored from filesystem destination by @sh-rp in #1184 - https://dlthub.com/devel/dlt-ecosystem/destinations/filesystem#syncing-of-dlt-state
- Remove
staging-optimized
replace strategy forsynapse
by @jorritsandbrink in #1231 - fixes bug, where configs where not injected for async functions by @sh-rp in #1241
- feat(transform): implement columns pivot map function by @IlyaFaer in #1152
- Add max_table_nesting to resource decorator by @sultaniman in #1242
- adds csv options to write headers, change delimiter, quotation style by @rudolfix in #1239
- Check for default schema and schema name in streamlit session by @sultaniman in #1155
- Add seconds and millisecond timestamps to filesystem date placeholders by @sultaniman in #1260
- send dlt telemetry wherever you want, not only segment by @zem360 in #1236
- Make merge write-disposition fall back to staging append if no primary or merge keys are specified by @sh-rp in #1225
- Add snowflake application parameter to configuration by @sultaniman in #1266
Docs
- Added docs for deploying dlt with Prefect. by @dat-a-man in #1138
- a note on scd2 incoming high ts change by @rudolfix in #1273
- adding images and wordsmithing to Prefect walkthrough by @WillRaphaelson in #1276
Verified Sources
- Use
pyarrow
,pandas
,connectorx
orsqlalchemy
backends when reading tables withsql_database
. See README for details. dlt-hub/verified-sources#425 - Google ads source is available dlt-hub/verified-sources#428
- Pages endpoint for notion dlt-hub/verified-sources#429
New Contributors
- @romanperesypkin made their first contribution in #1230
- @WillRaphaelson made their first contribution in #1276
Full Changelog: 0.4.8...0.4.9