You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is probably a repetitive problem, but I still haven't found how to solve it.
I used FastAPI to build API interfaces and used onnxruntime to load models. However, due to the limited number of models and gpu memory, I hope to release this part of the occupied gpu memory after each interface call is completed. But it seems that I can never fully release it, and there will still be some models occupying gpu memory.
I want to know if there is any way to solve this problem for Python.
The text was updated successfully, but these errors were encountered:
This is probably a repetitive problem, but I still haven't found how to solve it.
I used FastAPI to build API interfaces and used onnxruntime to load models. However, due to the limited number of models and gpu memory, I hope to release this part of the occupied gpu memory after each interface call is completed. But it seems that I can never fully release it, and there will still be some models occupying gpu memory.
I want to know if there is any way to solve this problem for Python.
The text was updated successfully, but these errors were encountered: