-
Notifications
You must be signed in to change notification settings - Fork 1.9k
fixes ort memory leak #5517
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fixes ort memory leak #5517
Conversation
/azp run |
Azure Pipelines could not run because the pipeline triggers exclude this branch/path. |
|
||
~OnnxRuntimeOutputCacher() | ||
{ | ||
if (_isDisposed) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does it ever hit this code path?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The finalizer is hit. I dont think the Dispose call is though. I left it in cause it would be better to switch to a dispose call when we are able to.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We shouldn't be using a finalizer here.
- We should ensure
OnnxRuntimeOutputCacher
instances get disposed properly. - In the cases where
Dispose()
is never called by the user, and this object is no longer referenced, all the references to the underlyingDisposableNamedOnnxValue
will be removed as well. IfDisposableNamedOnnxValue
is holding on to native memory, it should have a finalizer (or more preferrably use a SafeHandle). The managed object that manages the native memory is responsible for ensuring proper clean up.
We shouldn't be using finalizers to dispose managed objects. Finalizers should only be used for managing native resources.
Fixes the ORT memory leak by disposing of the NamedOnnxValues and makes the OnnxRuntimeOutputCacher disposable and adds a finalizer.