RE: [EXTERNAL] Re: Memory bloat on concurrency - Any fix to release memory post query run

Hi Jennie, Apologies, I have MonetDB-11.25.23 installed. I guess this version has the memory leaks issues fixed. Let me know if there is any other version of SP available. Meanwhile I will send across the details. Regards, Sreejith -----Original Message----- From: users-list [mailto:users-list-bounces+sreejith.sharma=harman.com@monetdb.org] On Behalf Of Ying Zhang Sent: Thursday, August 10, 2017 8:36 PM To: Communication channel for MonetDB users Subject: [EXTERNAL] Re: Memory bloat on concurrency - Any fix to release memory post query run Hai Sreejith, There is no way to manually force MonetDB to release memory. However, what you described is not supposed to happen. Not very long ago (but should be before the version you use), we have put quite some efforts in release unused memory earlier (i.e. free a variable as soon as it’s not needed, instead of waiting until the end of query execution to release all variables at once) so as to reduce MonetDB’s virtual memory usage. Can you please upgrade to the latest release Jul2017-SP1 (11.27.5)? The version you’re using is a bit old. In the bug-fix releases following that, several memory leaks were fixed [1]. If your problem persists, can you please give us the necessary data sample, schema, queries and script to reproduce your problem? Regards, Jennie [1] https://clicktime.symantec.com/a/1/2SmZnQfkzCIOWj3BYqEvQrPIz-CbpXjoikixwTcM6ZQ=?d=THHydlHeoPzbgOMuBtR7AYATbzUPaY-BBAZqe-6pJRMPmHEokVbZu0xxGL0mYpM6NvA8bNhnFJZKh8P3r2TOyW9S_yUzbvEU2RtDvtSooFyoDqeoVg8QWehPciigNFMKlqALFQmrJ3HmcGcVQU1ENt3jrCdH8hP6B6i9-BE9-vtWR5DYOeEOUMDkvDVLwEcwPaYAmL-QdKsFrQV_Hj8D5M0HzCzufne3VuxVi0YiqteCCVKXoqcmH-iLccvYmesa4KDyTeeo7lUUlaoYlPJ2mqytsgEd3KR9ZB-jLGfA3t0mVqPMgBzjoFbl3fdrjlD2yXMbpKlyUfGSMH8p1pil2Pupq2Q-HyzHQNYn7VsPuy6qJqF2PjutuzKMWGgz-f-ecv6p4QWArvqhrTpz-7R3rN575pdQ4hD_jsRqJtoXLzVHq8u4nR_kCq43FaCrC7mVey8du9nf1zk9_Ck2-OUHhNLG4sVXCw%3D%3D&u=https%3A%2F%2Fwww.monetdb.org%2FOldReleaseNotes%2FDec2016

On 10 Aug 2017, at 11:26, Sharma, Sreejith wrote:

Hi,

I have been using monetdb (11.25.3) in CentOS for one of application. I have been working on a PSR testing for this application and have noticed on high concurrency and on same pattern of query running again and again causing memory to bloat up and doesn’t release once the query run completes. I understand that the data is lifted into memory and the result set is also cached, however I assume this should be release once the system is idle which I don’t see it as of now.

Is there any way or parameter to release the unused memory blocks? I have asked this before, but couldn't get to the root to fix this.

Regards, Sreejith _______________________________________________ users-list mailing list users-list@monetdb.org https://clicktime.symantec.com/a/1/4arWuVyzE5LkZgTnAIJx3HZzMUb40yXaiaLm4ghdQpw=?d=THHydlHeoPzbgOMuBtR7AYATbzUPaY-BBAZqe-6pJRMPmHEokVbZu0xxGL0mYpM6NvA8bNhnFJZKh8P3r2TOyW9S_yUzbvEU2RtDvtSooFyoDqeoVg8QWehPciigNFMKlqALFQmrJ3HmcGcVQU1ENt3jrCdH8hP6B6i9-BE9-vtWR5DYOeEOUMDkvDVLwEcwPaYAmL-QdKsFrQV_Hj8D5M0HzCzufne3VuxVi0YiqteCCVKXoqcmH-iLccvYmesa4KDyTeeo7lUUlaoYlPJ2mqytsgEd3KR9ZB-jLGfA3t0mVqPMgBzjoFbl3fdrjlD2yXMbpKlyUfGSMH8p1pil2Pupq2Q-HyzHQNYn7VsPuy6qJqF2PjutuzKMWGgz-f-ecv6p4QWArvqhrTpz-7R3rN575pdQ4hD_jsRqJtoXLzVHq8u4nR_kCq43FaCrC7mVey8du9nf1zk9_Ck2-OUHhNLG4sVXCw%3D%3D&u=https%3A%2F%2Fwww.monetdb.org%2Fmailman%2Flistinfo%2Fusers-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://clicktime.symantec.com/a/1/4arWuVyzE5LkZgTnAIJx3HZzMUb40yXaiaLm4ghdQpw=?d=THHydlHeoPzbgOMuBtR7AYATbzUPaY-BBAZqe-6pJRMPmHEokVbZu0xxGL0mYpM6NvA8bNhnFJZKh8P3r2TOyW9S_yUzbvEU2RtDvtSooFyoDqeoVg8QWehPciigNFMKlqALFQmrJ3HmcGcVQU1ENt3jrCdH8hP6B6i9-BE9-vtWR5DYOeEOUMDkvDVLwEcwPaYAmL-QdKsFrQV_Hj8D5M0HzCzufne3VuxVi0YiqteCCVKXoqcmH-iLccvYmesa4KDyTeeo7lUUlaoYlPJ2mqytsgEd3KR9ZB-jLGfA3t0mVqPMgBzjoFbl3fdrjlD2yXMbpKlyUfGSMH8p1pil2Pupq2Q-HyzHQNYn7VsPuy6qJqF2PjutuzKMWGgz-f-ecv6p4QWArvqhrTpz-7R3rN575pdQ4hD_jsRqJtoXLzVHq8u4nR_kCq43FaCrC7mVey8du9nf1zk9_Ck2-OUHhNLG4sVXCw%3D%3D&u=https%3A%2F%2Fwww.monetdb.org%2Fmailman%2Flistinfo%2Fusers-list