You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
github-actionsbot
changed the title
[Bug] [Module Name] pgsql 同步到doris,update操作无法读取before,导致空指针异常
[Bug] [Module Name] pgsql is synchronized to doris, and the update operation cannot read before, resulting in a null pointer exception.
Nov 19, 2024
Search before asking
What happened
尝试使用flink sql local模式同步pgsql的数据到doris, 当在pgsql中修改数据时,在AbstractSqlSinkBuilder类以下代码发生空指针异常
rowCollect( columnNameList, columnTypeList, out, RowKind.UPDATE_BEFORE, (Map) value.get("before"))
将该行代码注释后可以正常同步。
What you expected to happen
如果pgsql中的表没有设置REPLICA IDENTITY为FULL时,将读取不到before的数据,因此这里可能需要兼容一下。
How to reproduce
EXECUTE CDCSOURCE demo_doris WITH ( 'connector' = 'postgres-cdc', 'hostname' = '192.168.0.37', 'port' = '5432', 'database-name' = 'db', 'schema-name' = 'public', 'username' = '111111', 'password' = '111111', 'checkpoint' = '10000', 'scan.startup.mode' = 'initial', 'parallelism' = '1', 'table-name' = 'public\.i_.*', 'debezium.decimal.handling.mode'='string', 'source.decoding.plugin.name' = 'pgoutput', 'sink.connector' = 'doris', 'sink.fenodes' = '192.168.0.223:8030', 'sink.username' = '1111111', 'sink.password' = '1111111', 'sink.doris.batch.size' = '1000', 'sink.sink.max-retries' = '1', 'sink.sink.db' = 'ods_pg', 'sink.sink.properties.format' ='json', 'sink.sink.properties.read_json_by_line' ='true', 'sink.table.identifier' = '#{schemaName}.#{tableName}', 'sink.sink.label-prefix' = '#{schemaName}_#{tableName}_5' );
这里我的flink sql,pgsql需要做一些设置支持逻辑复制。
Anything else
No response
Version
1.1.0
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: