v0.16.0

v0.16.0 (2022-12-19)

✨ New

• #1262 Support string "__NULL__" wherever null values are allowed in stream maps configuration

🐛 Fixes

• #1214 Avoid duplicate entries in required array of JSON schema helpers

Meltano Singer SDK v0.15.0

v0.15.0 (2022-12-08)

✨ New

• #1157 Built-in handling of default-target-schema for SQL Targets -- Thanks @BuzzCutNorman!
• #1087 S3 batch storage -- Thanks @jamielxcarter!
• #1197 Support patternProperties in JSON schema helpers
• #1188 Support boolean additional_properties in JSON schema helper objects

🐛 Fixes

• #1237 Catch and retry ConnectionResetError exceptions in HTTP taps
• #1238 Ensure metric tags coming from stream context can be JSON-serialized
• #1233 Add level and logger name to default log format
• #1219 Schema passthrough for whitelisted fields
• #1174 Do not emit log message if no record properties were ignored
• #1192 Change max record age for emitting state messages to 5 instead of 30 mins -- Thanks @spacecowboy!

⚡ Performance Improvements

• #1196 Improve performance of record message serialization -- Thanks @Jack-Burnett!

📚 Documentation Improvements

• #1243 Document inherited PluginBase attributes and methods
• #1209 Fix argument descriptions for OAuthAuthenticator

v0.14.0

v0.14.0 (2022-11-16)

✨ New

• #1175 Add datetime capabilities in stream maps -- Thanks @qbatten!
• #1114 Add ability to override DDL for column operations such as ADD, ALTER, and RENAME.

🐛 Fixes

• #1182 Update SQLConnector import for SQL target cookiecutter -- Thanks @radbrt!
• #1168 SQLConnector.table_exists() to use separate table_name and schema_name instead of fully qualified name -- Thanks @BuzzCutNorman!
• #1164 Write a valid final state message at the end of each stream sync -- Thanks @laurentS!

v0.13.1

v0.13.1 (2022-11-08)

🐛 Fixes

• #1126 Resolve failure in _increment_stream_state() when using LOG_BASED replication.
• #1111 Add proper handling for _MAX_RECORDS_LIMIT in SQL taps.

⚙️ Under the Hood

• #1115 Add support for Python 3.11.
• #1091 Move SQLConnector into a separate connectors module, for use by both SQLStream and SQLSink

v0.13.0

v0.13.0 (2022-10-24)

✨ New

• #1096 Add JSON Schema Property(..., secret=True) helper for designating passwords and other credentials within config.
• #1098 Add JSON Schema helpers for allowed_values (enum) and examples.
• #1039 Support converting Singer property names to valid database identifiers for SQL targets.

🐛 Fixes

• #1093 Add environment support to the cookie cutter for meltano.yml.
• #1036 Create target tables when receiving the SCHEMA message (during add_sink ) to ensure target tables are created even if no records arrive for a stream.

v0.12.0

v0.12.0 (2022-10-17)

✨ New

• #978 Users can now configure a dedicated metrics logger using SINGER_SDK_LOG_CONFIG.

🐛 Fixes

• #1043 Support Windows-style storage paths in BATCH message type config -- Thanks @BuzzCutNorman!
• #1001 Fixed column name rendering for the allow_column_alter error message.

⚡ Performance

• #1032 SQL streams now only include columns in the SELECT statement which are selected in the catalog.

📚 Documentation Improvements

• #1020 Fixed typo in docs/stream_maps.md -- Thanks @spacecowboy!
• #1060 Add explanation and recommendations for context usage.
• #1074 Document an example implementation and usage of pagination with BaseHATEOASPaginator.

v0.11.1

v0.11.1 (2022-09-27)

🐛 Fixes

• #999 Resolve issue where file paths created by taps in BATCH mode can't be processed by the Sink.

v0.11.0

v0.11.0 (2022-09-23)

✨ New

• #904 Add support for file-based processing with a new BATCH message type in taps and targets.
• #968 Add docs for VS Code debugging, including CLI entry points in cookiecutter templates.

🐛 Fixes

• #979 Resolve install failures on certain images due to missing wheels for ciso8601.
• #972 Resolve issue where TypeError is thrown by SQLConnector cookiecutter implementation due to super() references.

📚 Documentation Improvements

• #988 Add pipe before SDK logo in header.
• #970 Move cookiecutter TODOs into markdown comments.

⚙️ Under the hood

• #979 Remove dependency on pipelinewise-singer-python and move Singer library code into private module singer_sdk._singerlib.

v0.10.0

v0.10.0 (2022-09-08)

✨ New

• #829 Add validation for primary keys, replication keys and state partitioning keys to built-in tap tests -- Thanks @laurentS!
• #732 Implement paginator classes to for automatic pagination handling in API-based taps.

🐛 Fixes

• #898 Fix SQL type merging for pre-existing target tables -- Thanks @BuzzCutNorman!
• #856 Fix typo RecordsWitoutSchemaException -> RecordsWithoutSchemaException.

⚙️ Under the Hood

• Use __future__.annotations on singer_sdk.helpers._singer.

v0.9.0

v0.9.0 (2022-08-24)

✨ New

• #842 Add authenticate_request method to APIAuthenticatorBase class to handle more generic authentication requests in custom authenticators.

🚀 Changes

• #919 Add ConnectionError to list of backoff exceptions for auto-retry -- Thanks, @jlloyd-widen!
• #759 Apply start_date as the starting_replication_value if more recent than the latest bookmark -- Thanks, @ericboucher!

🐛 Fixes

• #917 Allow Singer schemas to include the required and enum fields -- Thanks, @Jack-Burnett!

⚙️ Under the Hood

• #908 Allow overriding the bulk insert statement in SQLSink.

📚 Documentation Improvements

• #900 Add constructor parameters to class reference documentation.