Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RFE: Limit concurrent copies from SD Card to improve performance #116

Open
sandymac opened this issue Jun 19, 2023 · 1 comment
Open

RFE: Limit concurrent copies from SD Card to improve performance #116

sandymac opened this issue Jun 19, 2023 · 1 comment

Comments

@sandymac
Copy link

sandymac commented Jun 19, 2023

RFE: Limit concurrent copies from SD Card

Context:

Trying to import about 50 files from a GoPro 9's SD Card

  • Camera: GoPro 9
  • Operating System: Windows 11
  • Version: 1.8

Expected Behavior:

Copy one file at a time (better for local storage) or limit it to a few (maybe better for network sources).

All files at once has significant overhead, unfortunate failure mode, and likely causes unnecessary disk fragmentation or unnecessary defragmentation effort in destination drives.

Current Behavior:

Currently mmt seems to copy every file it discovers on the SD Card simultaneously.
This has negative throughput impact as the SD Card is internally paging between blocks of data to read it.
In Windows Task Manager view for the SD Card's drive I noticed the Read Speed almost double as the number of active file copies went from 40+ to a handful.

Also, when a SD Card become unavailable during a copy I got partial data in the destination for many files. I'd rather only 1 file be incomplete than dozens. Also if destination drive were to fill up, I'd prefer some complete copies instead of many partial copies.

Steps to Reproduce:

Have lots of new media to import.

@sandymac
Copy link
Author

Here is the SD Card getting 25MB/s towards the start of a 96 file import
Screenshot 2023-06-19 175048

and here it is getting 47 MB/s towards the end of the import when many of the files had completed and there was less thrashing
Screenshot 2023-06-19 190002

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant