Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some confusion about the nx_benchmarks.csv file. #6

Open
WangFengtu1996 opened this issue Jul 23, 2020 · 2 comments
Open

some confusion about the nx_benchmarks.csv file. #6

WangFengtu1996 opened this issue Jul 23, 2020 · 2 comments

Comments

@WangFengtu1996
Copy link

HI, all
I want to know the means about some auguments (like Devices BatchSizeGPU BatchSizeDLC WS_GPU WS_DLA input and output)

  • The BatchSizeGPU is the number of picture inferencing once?

Thanks for your time.

@ak-nv
Copy link
Contributor

ak-nv commented Jul 28, 2020

As the name suggest, batchsizeGPU is the default batch size for GPU wheareas batchsizeDLA is for DLA. WS is for WorkSpace this is TensorRT parameter which "controls the maximum amount of workspace that may be allocated" For more information

Please let me know if you have any question.

@WangFengtu1996
Copy link
Author

Hi,
I have some new questions.

  • How to be sure the proper value of batchsizeGPU, batchsizeDLA WS for different models?
  • How to understand these parameter to have an impact on the performance for NX?
  • what role s do DLA and GPU play in the benchmarking?
  • Is NX's performance is sum of DLC and GPU?

thanks for your time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants