Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

onnx Export Problem. #44

Open
GlimSH opened this issue Jan 3, 2023 · 9 comments
Open

onnx Export Problem. #44

GlimSH opened this issue Jan 3, 2023 · 9 comments
Labels
question Further information is requested

Comments

@GlimSH
Copy link

GlimSH commented Jan 3, 2023

Hello, I studied using the project and checked the results. I tried to convert it to onnx, but there is a problem.

Is there any way to solve it?

@RizwanMunawar
Copy link
Owner

@GlimSH! Onnx conversion is not supported yet! I will add this module soon.

@RizwanMunawar RizwanMunawar added the question Further information is requested label Jan 3, 2023
@JasonRuan5
Copy link

@RizwanMunawar Thanks for the great code! Just wonder if onnx conversion is ok now? We can convert pt to onnx and trt engine, but the trt engine cannot be load in C++. It would be great if it can!

@RizwanMunawar
Copy link
Owner

@JasonRuan5! At moment onnx conversion is not optimized for C++ integration. I am working on this module, but It will take time to develop. Meanwhile, you can check my Patreon subscription from the link mentioned below, which will provide you access to all my coming projects and LinkedIn project codes.

✅✅✅✅✅✅✅✅✅

https://patreon.com/MuhammadRizwanMunawarWork?utm_medium=clipboard_copy&utm_source=copyLink&utm_campaign=creatorshare_creator&utm_content=join_link

✅✅✅✅✅✅✅✅✅

Thanks.

@JasonRuan5
Copy link

@RizwanMunawar Thanks for such a quick response. Just wonder what is main difference between "converting .pt to .onnx and onnx to trt with trtexec" and "converting pt to engine directly"? Engine cannot be load if converted via onnx, but ok if converted directly. I am new to onnx and tensorrt, we are looking for sample code to segment image after loading the engine. Any suggestions/advices will be greatly appreciated!

@RizwanMunawar
Copy link
Owner

@JasonRuan5! There is no direct method for conversion of Pytorch(.pt) to Tensorrt (.engine). You will need to convert the model to onnx and then you can convert it into the trt. For jetson nano the way for conversion to (.engine) is different.

It seems that the conversion of (onnx->engine) has some issues in input shape and output shape or quantization modules etc. I am not sure at the moment what will be the best possible way because I am working on this module yet.

@madinwei
Copy link

madinwei commented Apr 3, 2023

@GlimSH! Onnx conversion is not supported yet! I will add this module soon.

Hello, @RizwanMunawar , thank you for this awesome repository and code.
is the onnx conversion ready now? I have to use c++ for my application. it will help me a lot if I can use my trained model on my data with it.
Looking forward to you reply, and Happy Ramadan

@RizwanMunawar
Copy link
Owner

@madinwei I am working on this stuff, but not been completed yet. It can take time, but I will try to add this module as soon as possible. Thanks.

@RomeroRomeroMartin
Copy link

Hello @RizwanMunawar, where can I find information to do the onnx conversion for my own, until your module is not available?

Thanks

@Sameersingh79
Copy link

@RizwanMunawar Any update on the onnx conversion??

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

6 participants