ReadTimeoutError while downloading files with the b.fetch() command using Quilt’s Python client

[EmiliyaStol]

I wrote Python code to download all Image.csv files from a single source folder (for example: "source_2") using Quilt’s Python client. I am using the b.fetch() command to dowload the files.
I am running into an issue where the run is timing out while downloading the files. I am receiving the message "TimeoutError: The read operation timed out" and "urllib3.exceptions.ReadTimeoutError: AWSHTTPSConnectionPool(host='cellpainting-gallery.s3.amazonaws.com', port=443): Read timed out." in the terminal.
How can I efficiently download a large amount of files from the Cell Painting Gallery?

[shntnu]

How can I efficiently download a large amount of files from the Cell Painting Gallery?

We recommend using https://github.com/broadinstitute/cpg/tree/main/cpgdata (cc @leoank: FYI)

[leoank]

Hey @EmiliyaStol, Let me know if you face any issues using cpgdata. The readme exactly covers your user case.