Fix memory leak in InmemReader #254
Conversation
| data_buf_.Serialize(bin_file); | ||
| } | ||
| delete [] block_; | ||
| free(block_); |
There was a problem hiding this comment.
Hi, does there any different between delete [] and free()?
There was a problem hiding this comment.
I am new to C++. Please point me out when if I got anything mistaken. The difference was answered in here. Since _block is a char pointer, I think the free operator would be a better one since a char does not have any constructor nor any destructor.
| // Free the memory of data matrix. | ||
| virtual void Clear() { | ||
| data_buf_.Reset(); | ||
| data_samples_.Reset(); |
There was a problem hiding this comment.
data_samples_.Reset() will clear some memory, why remove this line of code? Thanks.
There was a problem hiding this comment.
As I was debugging and walking through the code, I discovered that the Row variable in both data_buf and data_sample are storing pointers that point to the same memory.
Besides, even though the Reset method is called on one DMatrix, the Row variable in another DMatrix will not be reset. This causes the Row variable to keep storing SparseRow pointers pointing to the memory that was already freed.
Calling the Reset method again on data_sample will cause a segfault. So, I removed data_sample.Reset(); because this line is unnecessary.
There was a problem hiding this comment.
Is it because of Clear added to destructor of InmemReader? I found that we use default destructor for InmemReader before. In other words, the member function Clear of InmemReader (maybe including FromDMReader) class never used in program,
4 participants
xLearn::InmemReader suffers from the problem of memory leak, which will affect the performance of training/prediction on large dataset.