Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download hangs during parallel transfer #413

Open
jjkoehorst opened this issue May 25, 2022 · 0 comments
Open

Download hangs during parallel transfer #413

jjkoehorst opened this issue May 25, 2022 · 0 comments
Labels
Milestone

Comments

@jjkoehorst
Copy link

I am using the jargon api to download some big files and most of the times this goes correct but sometimes it throws an unexpected length read when reading int error. This would normally not be such a big issue as I catch errors and try to download it again. However in this case it just hangs and I am not sure how to make sure that the jargon exception that is thrown is thrown through.

Any thoughts? Perhaps it could be in the call back listener or the transfer control block?

                StatusCallbackListener statusCallbackListener = new StatusCallbackListener();
                TransferControlBlock defaultTransferControlBlock = DefaultTransferControlBlock.instance();
                TransferOptions transferOptions = dataTransferOperationsAO.buildTransferOptionsBasedOnJargonProperties();
                transferOptions.setIntraFileStatusCallbacks(true);
                transferOptions.setIntraFileStatusCallbacksNumberCallsInterval(1);
                transferOptions.setIntraFileStatusCallbacksTotalBytesInterval(2);
                logger.debug("isComputeChecksumAfterTransfer " + transferOptions.isComputeChecksumAfterTransfer());
                logger.debug("isComputeAndVerifyChecksumAfterTransfer " + transferOptions.isComputeAndVerifyChecksumAfterTransfer());
                defaultTransferControlBlock.setTransferOptions(transferOptions);
                dataTransferOperationsAO.getOperation(irodsFile, localFile, statusCallbackListener, defaultTransferControlBlock);
Transfer status: 9GB of 30GB 30.00%
Transfer status: 10GB of 30GB 33.33%
Transfer status: 11GB of 30GB 36.67%
07:53:29.987 [pool-3-thread-1] ERROR org.irods.jargon.core.transfer.AbstractParallelTransferThread - unexpected length read when reading int
07:53:29.990 [pool-3-thread-1] ERROR org.irods.jargon.core.transfer.ParallelGetTransferThread - exception in parallel transfer
org.irods.jargon.core.exception.JargonException: unexpected length read when reading int
	at org.irods.jargon.core.transfer.AbstractParallelTransferThread.readInt(AbstractParallelTransferThread.java:53) ~[IRODSTransfer.jar:?]
	at org.irods.jargon.core.transfer.ParallelGetTransferThread.processingLoopForGetData(ParallelGetTransferThread.java:259) [IRODSTransfer.jar:?]
	at org.irods.jargon.core.transfer.ParallelGetTransferThread.get(ParallelGetTransferThread.java:179) [IRODSTransfer.jar:?]
	at org.irods.jargon.core.transfer.ParallelGetTransferThread.call(ParallelGetTransferThread.java:147) [IRODSTransfer.jar:?]
	at org.irods.jargon.core.transfer.ParallelGetTransferThread.call(ParallelGetTransferThread.java:32) [IRODSTransfer.jar:?]
	at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
07:53:29.999 [pool-3-thread-1] ERROR org.irods.jargon.core.transfer.ParallelGetTransferThread - a jargon exception occurred in the get loop
07:53:29.999 [pool-3-thread-1] ERROR org.irods.jargon.core.transfer.ParallelGetTransferThread - unchecked exception in transfer
@korydraughn korydraughn added this to the 4.3.5.0 milestone Aug 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants