Reusing MXPredCreateMultiThread's PredictHandles


#1

Can we reuse PredictHandles created from MXPredCreateMultiThread? Is there any catch for this like waiting or freeing something?


#2

@szha @eric-haibin-lin would you be able to comment on this one? See this was added a couple of weeks ago in https://github.com/apache/incubator-mxnet/pull/12456. Cheers!


#3

I think reuse is fine. As far as I remember, a symbol executor is created when a PredictHandle is used for the first time. The only requirement is that the PredictHandle has to be used in its own thread.