ChangeLog

Release 0.10.5 - 2024-02-22

* Added max_s3_upload_threads_per_task option to Redshift
* Swap name + drop instead of drop + rename in MySQL replace mode
* Upgrade the Gradle wrapper to 7.6.4, the Gradle plugin for Embulk plugins to 0.6.2, embulk-util-config to 0.3.4, and embulk-util-json to 0.3.0

Release 0.10.4 - 2024-01-15

* Add assume role authentication for Redshift

Release 0.10.3 - 2023-10-10

* Use NVARCHAR(max) for CLOB, instead of TEXT, when creating a table in SQLServer
* Use execute() instead of executeUpdate() for afterLoad/beforeLoad
* Add logging to avoid loss of information when exception changes during retries
* Fix double casting on getTimestamp

Release 0.10.2 - 2021-09-30

* Make temp tables suffix length flexible
* Remove embulk-output-db2 and embulk-output-oracle to be externalized in other repositories

Release 0.10.1 - 2021-06-16

* Fix Exec.newSomething() to CONFIG_MAPPER_FACTORY.newSomething()

Release 0.10.0 - 2021-06-16

* Catch up with Embulk v0.10 API/SPI
* Map an Embulk config directly to java.time.ZoneId with embulk-util-config's ZoneIdModule
* Release for Maven Central
* Fix a compile error in embulk-output-sqlserver

Release 0.9.0 - 2020-09-04

* Updated the whole build process -- using the "org.embulk.embulk-plugins" Gradle plugin, and else.
* Caught up with the latest API/SPI -- getLogger, Optional, BufferAllocator, and else.
* Stopped using Joda-Time, and started to use embulk-util-timestamp in formatting and parsing timestamps.

Release 0.8.7 - 2019-12-23

* embulk-output-sqlserver supported 'schema' and 'temp_schema' option in native mode (@nickolay ++).

Release 0.8.6 - 2019-08-22

* Changed the default JDBC driver for SQL Server from jTDS JDBC Driver to Microsoft JDBC Driver (@hieudion++).
* embulk-output-sqlserver supported connection_timeout and socket_timeout (@hieudion++).
* embulk-output-redshift supported IAM role for accessing to S3 by Redshift COPY command (@ynishi++).

Release 0.8.5 - 2019-05-10

* Fixed a bug that embulk-output-mysql may insert incorrect records by re-retry.

Release 0.8.4 - 2019-05-08

* Fixed a bug that embulk-output-mysql may insert duplicate records by retry.

Release 0.8.3 - 2019-05-07

* Supported java.sql.Types.NUMERIC in Oracle OCI.
* Updated aws-java-sdk version from 1.10.77 to 1.11.523 in order to support AWS Signature Version 4, which will be required by S3 after June 24, 2019 (@tatsuo48++).
* Enable to set transaction isolation level.
* Fixed a bug that embulk-output-mysql loses records during retry.
* JdbcOutputConnector and JdbcOutputConnection were refactored.

Release 0.8.2 - 2019-01-30

* Supported Redshift TEXT type.
* Supported concurrent execution of 'CREATE TABLE' in order to execute embulk-output-jdbc in parallel.

Release 0.8.1 - 2018-11-16

* Enabled to insert \r , \n and \t into Redshift.
* Upgrade embulk-util-aws-credentials (@jami-i++).
* SQL Server native mode supported string value longer than 7999 (@nickolay++).

Release 0.8.0 - 2017-12-26

* Upgraded the bundled MySQL JDBC driver version from 5.1.34 to 5.1.44 (@y-ken++).
  Please check release notes for MySQL Connector/J (https://dev.mysql.com/doc/relnotes/connector-j/5.1/en/news-5-1.html) .

Release 0.7.13 - 2017-12-08

* When retrying to create temporary table for table name duplication, generates another temporary table name.
* Enabled to change MySQL/PostgreSQL JDBC driver.
* Added option (delete_s3_temp_file) not to delete embulk-output-redshift temporary files on S3.
* Fixed access violation in embulk-output-sqlserver native client when inserting NULL values of numeric types.
* Added options (create_table_constraint, create_table_option) to customize CREATE TABLE statement.

Release 0.7.12 - 2017-11-24

* Fixed a bug where embulk-output-redshift ignores an exception thrown by `DROP TABLE` statement (@mjalkio++).
* embulk-output-sqlserver native client mode supported Mac OS and Linux (@kitsuyui++).
* Avoided using deprecated TimestampFormatter constructors.

Release 0.7.11 - 2017-08-16
* Fixed a bug where embulk-output-redshift merge mode doesn't insert new records (@mjalkio++).

Release 0.7.10 - 2017-07-14

* Added ssl option for embulk-output-mysql (@hiroyuki-sato++).
* Logging JDBC driver version (@hiroyuki-sato++).
* MySQL Connector/J version will be upgrade from 5.1.35 to 5.1.42 or higher in the near future.

Release 0.7.9 - 2017-06-23

* Enabled to specify database or schema of intermediate tables.
* Supported schema for SQL Server.
* embulk-output-mysql will warn if the client timezone is different from the server timezone
  because wrong datetime values will be stored.
  `useLegacyDatetimeCode=false` will be set by default in future (@hiroyuki-sato++).
* Modified .gitignore to ignore IntelliJ files (@hiroyuki-sato++).
* When running multiple embulk-output-jdbc processes, they could use same intermediate tables in rare cases and would fail. Fixed this problem.
* Modified query for Redshift merge mode to avoid error "This type of correlated subquery pattern is not supported" (@hey-jude++).

Release 0.7.8 - 2017-05-10

* Upgrade to AWS SDK for Java 1.10.77 in order to support ap-northeast-2 region (@hey-jude++).
* Support upper case table name in Redshift.

Release 0.7.7 - 2017-04-13

* Enabled to execute SQL before loading.

Release 0.7.6 - 2017-03-23

* Supported merge mode for Oracle.

Release 0.7.5 - 2017-03-10

* embulk-output-postgresql can create table with a column of numeric type without precision.

Release 0.7.4 - 2017-02-24

* embulk-output-postgresql merge_direct mode supported database types which needs explicit cast such as uuid (@kakoni++).

Release 0.7.3 - 2017-01-06

* Supported merge_direct mode for PostgreSQL.

Release 0.7.2 - 2016-12-19

* Supported merge mode for SQL Server.
* Supported json type in replace mode.

Release 0.7.1 - 2016-11-25

* Enabled to execute SQL after loading.
* Redshift merge mode uses UPDATE-INSERT instead of DELETE-INSERT in order to retain columns not contained in input schema (@Olaktal++).

Release 0.7.0 - 2016-10-26

* Added embulk-output-db2 to support IBM DB2.

Release 0.6.5 - 2016-10-11

* Enabled to merge Redshift table with an identity column.

Release 0.6.4 - 2016-09-30

* Improvee performance of embulk-output-oracle oci mode.
* embulk-output-sqlserver bundled jTDS, open source JDBC driver for SQL Server, and used it in default (@uu59++).
* Enabled to use S3 bucket whose region is different from Redshift region.
* Enabled to use varchar without length specifier in embulk-output-postgresql merge mode.

Release 0.6.3 - 2016-08-18

* Fixed the default value of ssl property of embulk-output-redshift (@AntoineAugusti++).

Release 0.6.2 - 2016-08-10

* Retry when deadlock occurs in MySQL (@joker1007++).
* Added merge_rule option to define values for existing records (@tomykaira++).
* Supported SSL in Redshift (@AntoineAugusti++).

Release 0.6.1 - 2016-06-23

* Supported merge mode in embulk-output-redshift (@rolandhawk++).
* Case insensitive for table names and column names.
* embulk-output-oracle OCI mode throws an exception for duplicate keys instead of disabling the index.
* Fixed unclosed connection.

Throws exception

Release 0.6.0 - 2016-04-26

* Supported NCLOB (JDBC SQL type).
* Supported json (embulk type and embulk-output-jdbc value_type).

Release 0.5.1 - 2016-03-29

* Supported schema in embulk-output-oracle.
* Supported multibyte object name in embulk-output-oracle OCI mode.
* Supported AWS root account in embulk-output-redshift (@lance-edmodo++).
* Improved performance of embulk-output-redshift by uploading and copying in background.
* Ignore port if instance is specified in embulk-output-sqlserver (@emanon-was++).
* Improved performance of embulk-output-sqlserver by supporting native library.

Release 0.5.0 - 2016-01-15

* C library used in embulk-output-oracle OCI mode is replaced with Java classes using jnr-ffi.
  It is more portable and maintainable than ever.
* Added embulk-output-sqlserver.

Release 0.4.5 - 2016-01-13

* Upgraded embulk version to 0.8.0.
  JSON type support will be added at a later major version.

Release 0.4.4 - 2015-01-04

* Supported NCHAR/NVARCHAR2 in Oracle OCI.

Release 0.4.3 - 2015-12-17

* insert, truncate_insert and merge modes support to create the target table automatically if not exists.
  (insert_direct, merge_direct and replace mode already supported.)
* Updated README about modes.

Release 0.4.2 - 2015-12-08

This release requires embulk >= 0.7.1.

* Supported Oracle VARCHAR2 in insert mode.
* Supported SSL in PostrgreSQL.
* Bump AWS Java SDK version to fix date problem under Java 8u60 (@dlackty++).
* Enabled to build native library for embulk-output-oracle in linux Java 8.

Release 0.4.1 - 2015-07-06

This release requires embulk >= 0.6.16.

* Enabled to specify S3 key prefix for Redshift temporary files.
* Fixed a bug that causes SQLException on commit in INSERT/TRUNCATE_INSERT/MERGE modes when no input file exists (@muziyoshiz++).


Release 0.4.0 - 2015-06-11

* Fixed timezone handling. Now behavior is independent from JVM's execution
  environment.
* replace mode ignores schema of existent table. You can use truncate_insert
  mode instead to keep the schema.
* PostgreSQL output uses TIMESTAMP WITH TIME ZONE for the type of timestamp.
* PostgreSQL output stores time with microseconds in addition to seconds.
  value by default.
* Oracle output supports column_options.value_type=decimal.
* Oracle output uses MS932 instead of Shift_JIS
* options: parameter accepts integer values in addition to strings.
* Fixed MySQL exception when the destination table does not exist.
* Redshift can store a string "\N" and NULL correctly.


Release 0.3.0 - 2015-05-18

This release requires embulk >= 0.6.8.

* Added implementation of insert, insert_direct, merge, merge_direct, truncate_insert, and replace modes.
  * insert mode is renamed to insert_direct. insert is a new mode.
  * merge mode is renamed to merge_direct. merge is a new mode.
  * removed "merge_direct" mode support from postgresql. Instead, added new "merge" mode.
* Added implementation of java.sql.Types.TINYINT, SMALLINT, INTEGER, REAL, DATE, TIME, NUMERIC, DECIMAL, and NVARCHAR family.
  * BooleanColumnSetter doesn't parse string into boolean value any more.
  * TimestampColumnSetter doesn't allow string any more (#31)
* Added default_timezone option
* Added column_options option

Release 0.2.4 - 2015-05-12

* Fixed a bug that prevented insert mode for PostgreSQL from working (@takumakanari++)


Release 0.2.3 - 2015-04-23

* Supported merge mode for MySQL and PostgreSQL (@takumakanari++)
* Fixed NullPointerException when a NULL value appears in a column to skip.


Release 0.2.2 - 2015-04-07

* Skips columns if matching column names don't exist in the target table
  rather than making the transaction failed (@libra++)
* Improved performance of embulk-output-oracle (@hito4t)
* embulk-output-oracle supports insert_method parameter.
  * "normal" uses regular JDBC INSERT statements.
  * "direct" uses the optimized direct path inserts.
  * "oci" uses direct path inserts with Oracle Call Interface (OCI). This is
  the fastest but requires native library in addition to JDBC driver.


Release 0.2.1 - 2015-03-15

* Added embulk-output-oracle (by @hito4t)


Release 0.2.0 - 2015-02-27

* Removed invalid commit and rollback calls causing exceptions at cleanup.
* jdbc: url parameter replaced driver_name, host, port, and database
parameters. If you are using jdbc input plugin, you need to rewrite config
file as following:

Old configuration:

  driver_class: com.ibm.db2.jcc.DB2Driver
  driver_name: db2
  host: localhost
  port: 50000
  database: mydb

New configuration:

  driver_class: com.ibm.db2.jcc.DB2Driver
  url: jdbc:db2://localhost:50000/mydb