Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autopagination hangs in staging and prod. #478

Open
DailyDreaming opened this issue Nov 1, 2019 · 2 comments
Open

Autopagination hangs in staging and prod. #478

DailyDreaming opened this issue Nov 1, 2019 · 2 comments

Comments

@DailyDreaming
Copy link
Contributor

DailyDreaming commented Nov 1, 2019

Right now running hca dss get-bundles-all --replica aws seems to hang for a long long time in staging and prod (it seems okay to run in dev and integration because there is so little in there).

Passing the --no-paginate flag seems to allow this to return a page successfully as per the old behavior.

@DailyDreaming DailyDreaming changed the title Odd autopagination behavior. Autopagination hangs in staging and prod. Nov 1, 2019
@amarjandu
Copy link
Contributor

it might be an option to print out object that X-OpenAPI-Paginated-Content-Key is referring to while paging through the results.
Another option is to increase the --per-page amount from 500 to 1000, it took
time hca dss get-bundles-all --replica aws --per-page 500
real 13m36.207s to complete,
while an s3 ls for the same bucket/prefix took
real 9m32.096s to complete.

@DailyDreaming
Copy link
Contributor Author

DailyDreaming commented Nov 2, 2019

Do you think the user should wait 9 minutes for a response?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants