Skip to content
This repository was archived by the owner on Nov 17, 2023. It is now read-only.
This repository was archived by the owner on Nov 17, 2023. It is now read-only.

GPU memory cannot be released after MXPredFree #19718

@rrjia

Description

@rrjia

Hi,

I use the C++ APIs of MXNet to do some classification tasks. But I find that MXNet does not release GPU memory when calling MXPredFree(). When my program exits, all occupied GPU memory is released. So when I run my program, I can do classification just once, otherwise GPU memory is not enough. I think this is a very serious problem. I hope MXNet developers @tqchen @mli @piiswrong can look into this issue and resolve it ASAP. Thanks!

The sequence of function calls is as follows:
(1) MXPredCreate
(2) MXPredSetInput
(3) MXPredForward
(4) MXPredGetOutput
(5) MXPredFree

after i call MXPredCreate the GPU memory will capture by mxnet, by i can not release gpu memory bu mxnet c_predict_api

Metadata

Metadata

Assignees

No one assigned

    Labels

    C++Related to C++

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions