Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [executor jar] Using executjar to execute doris to synchronize mysql table failed #3827

Closed
2 of 3 tasks
sprybee opened this issue Sep 23, 2024 · 3 comments
Closed
2 of 3 tasks
Labels
Bug Something isn't working Invalid Invalid Waiting for reply Waiting for reply

Comments

@sprybee
Copy link

sprybee commented Sep 23, 2024

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

使用executjar执行doris同步mysql表失败
这是我的执行命令

EXECUTE JAR WITH (
'uri'='rs:/rdb_2_doris/flink-doris-connector-1.16-1.6.1.jar',
'main-class'='org.apache.doris.flink.tools.cdc.CdcTools',
'args'='mysql-sync-database --database dcmsdb  --mysql-conf hostname=xxxx  --mysql-conf port=3306  --mysql-conf username=xxxx  --mysql-conf password=xxxx  --mysql-conf database-name= --including-tables ""  --sink-conf fenodes=xxxxx  --sink-conf username=xxxx   --sink-conf password=xxxx     --sink-conf jdbc-url=xxxxx  --sink-conf sink.label-prefix=label7272 --table-conf replication_num=2'
);

What you expected to happen

java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_382]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.16.1.jar:1.16.1]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_382]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_382]
	at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:171) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_382]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
	... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:130) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:63) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:138) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at cn.hutool.http.HttpRequest.send(HttpRequest.java:1350) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_382]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_382]
	at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_382]
	at java.net.Socket.connect(Socket.java:556) ~[?:1.8.0_382]
	at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1228) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) ~[?:1.8.0_382]
	at cn.hutool.http.HttpConnection.connect(HttpConnection.java:387) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.send(HttpRequest.java:1345) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
2024-09-23 18:25:49,473 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint        [] - Fatal error occurred in the cluster entrypoint.
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
	at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_382]
	at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_382]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:337) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$2(ApplicationDispatcherBootstrap.java:254) ~[flink-dist-1.16.1.jar:1.16.1]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_382]
	at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_382]
	at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:171) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:68) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.lambda$withContextClassLoader$0(ClassLoadingUtils.java:41) ~[flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:49) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:48) [flink-rpc-akka_db92178b-0741-4f35-a4f6-329e9c15cef7.jar:1.16.1]
	at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692) [?:1.8.0_382]
	at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175) [?:1.8.0_382]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
	... 13 more
Caused by: org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:130) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:63) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.lang.RuntimeException: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:138) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: cn.hutool.core.io.IORuntimeException: ConnectException: Connection timed out (Connection timed out)
	at cn.hutool.http.HttpRequest.send(HttpRequest.java:1350) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more
Caused by: java.net.ConnectException: Connection timed out (Connection timed out)
	at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_382]
	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_382]
	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_382]
	at java.net.Socket.connect(Socket.java:607) ~[?:1.8.0_382]
	at java.net.Socket.connect(Socket.java:556) ~[?:1.8.0_382]
	at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.<init>(HttpClient.java:242) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.New(HttpClient.java:339) ~[?:1.8.0_382]
	at sun.net.www.http.HttpClient.New(HttpClient.java:357) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1228) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1162) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1056) ~[?:1.8.0_382]
	at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:990) ~[?:1.8.0_382]
	at cn.hutool.http.HttpConnection.connect(HttpConnection.java:387) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.send(HttpRequest.java:1345) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.doExecute(HttpRequest.java:1188) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1051) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.http.HttpRequest.execute(HttpRequest.java:1027) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.resource.impl.LocalResourceManager.readFile(LocalResourceManager.java:135) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.connect(RsURLConnection.java:38) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.url.RsURLConnection.getInputStream(RsURLConnection.java:43) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.utils.URLUtils.toFile(URLUtils.java:56) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at cn.hutool.core.lang.Opt.map(Opt.java:279) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:92) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:79) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.trans.dml.ExecuteJarOperation.getStreamGraph(ExecuteJarOperation.java:74) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.executeJarJob(Submitter.java:256) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.flinksql.Submitter.submit(Submitter.java:140) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at org.dinky.app.MainApp.main(MainApp.java:53) ~[dinky-app-1.16-1.1.0-jar-with-dependencies.jar:?]
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_382]
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_382]
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_382]
	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_382]
	at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:98) ~[flink-dist-1.16.1.jar:1.16.1]
	at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:301) ~[flink-dist-1.16.1.jar:1.16.1]
	... 12 more

How to reproduce

1、安装doris
2、安装mysql
3、下载flink_doris-connecot并执行上述语句

Anything else

No response

Version

1.1.0

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@sprybee sprybee added Bug Something isn't working Waiting for reply Waiting for reply labels Sep 23, 2024
@github-actions github-actions bot changed the title [Bug] [executor jar] 使用executjar执行doris同步mysql表失败 [Bug] [executor jar] Using executjar to execute doris to synchronize mysql table failed Sep 23, 2024
@Zzm0809
Copy link
Contributor

Zzm0809 commented Sep 25, 2024

链接超时, 请排查 dinky 所在服务器与 yarn 各个节点的网络互通情况

@sprybee
Copy link
Author

sprybee commented Sep 25, 2024

链接超时, 请排查 dinky 所在服务器与 yarn 各个节点的网络互通情况

dinky目前稳定运行20+SQL任务,和yarn链接应该没问题吧?
上述报错用的是dinky的jar包提交,会不会有其他的问题呢?

Copy link

github-actions bot commented Nov 1, 2024

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

@github-actions github-actions bot added the Invalid Invalid label Nov 1, 2024
@Zzm0809 Zzm0809 closed this as completed Nov 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working Invalid Invalid Waiting for reply Waiting for reply
Projects
None yet
Development

No branches or pull requests

2 participants