- users-list - monetdb.org

MonetDB not cleaning intermediate results which leads to filling up disk space
by abraun_75＠yahoo.de 19 Oct '15

19 Oct '15

Hi, Right now I am evaluating MonetDB and try to analyze a dataset that consists of 10 million rows. The data set has 2 tables, table a stores 10 million rows, table b stores 1 million rows. Both tables are being joined and some statistical values are being calculated (QUARTILE, AVG, SUM and GROUP BY). MonetDB is promising fast here. When starting up the database and executing the query the result is being returned within 4 seconds. I tried to execute the same SQL query 1000 times sequentially and to my surprise after the 60th iteration monetDB crashed because of insuffcient disk space. As far as I read intermediate results are being materialized within the bat folder. The .tail files are not being removed after a query was executed successfully and the files are not even removed after the database conenction is being closed. When I restart the server (dbfarm) the files are cleaned up perfectly. I am just wondering if this default behaviour can be changed? Are there any ways to enforce cleaning up the files? How to avoid a server crash because of insufficient memory? For the system I am planning to use monetDB for I am not able to restart the server before I execute the SQL queries. Thank you very much, Alex

5 8

current schema
by Enzo 19 Oct '15

19 Oct '15

Thanks to Jennie I understand that I can get the current schema with the query: select current_schema from sys.var(); While I get the “right” response, I get it as a series of duplicated lines (10 at the last count): For example, after setting a schema as set schema viewer; I get the following 10 lines from the query: Is it the right behaviour? And if yes, do these lines have a specific significance? Thanks Enzo enzo(a)smartinsightsfromdata.com

2 1

Re: users-list Digest, Vol 38, Issue 9
by Luciano Sasso 18 Oct '15

18 Oct '15

Jul 2015 is avaible for DEbian 7 ? At --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

3 2

How to install tachograph?
by Xu,Wenjian 18 Oct '15

18 Oct '15

Hi all, I have installed the latest Jul2015 release, and I would like to use the latest tools tachograph to determine the progress of query execution. But I do not know how to install it. My system is ubuntu 14.04. I have tried to use *sudo apt-get install monetdb-tools* but failed to locate the package *monetdb-tools*. Any idea would be helpful. Thanks. Best, XU Wenjian

3 2

DataCell Stream
by Luciano Sasso 18 Oct '15

18 Oct '15

DataCel stream discontinead in new versions MonetDB ? A Idea, substitute for Proxy Node.JS ? --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

3 3

Re: users-list Digest, Vol 38, Issue 9
by Luciano Sasso 18 Oct '15

18 Oct '15

Im Jul 2015, remote tables can sort in result query ? At --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 1

MonetDB scripting
by Doug Service 18 Oct '15

18 Oct '15

Hello Everyone, I need to become more conversant in monetdb scripting and have read the pages on functions and procedures on the website. However, more examples would be very helpful. Does anyone know of a good repository of extensive monetdb scripts that provide good models. Doug Service

2 1

Concurrent Transaction control in MonetDB
by Vijay Krishna 18 Oct '15

18 Oct '15

Hi, I read the following lines in a thesis on MonetDB titled - "Improving Transactional Stability in MonetDB" where in they had explained the concurrency control in MonetDB as "Concurrent updates (writers) are not anticipated and in case of N con􏰃icting transactions, only one of them (the one having the earliest time-stamp) is guaranteed to eventually commit its changes. Concurrent appends (on the same table) are detected as write-to-write conflicts and only the writer carrying the earliest time-stamp will end up committing successfully, the rest will be aborted." Why is that the transaction having the earliest timestamp is allowed to commit, in case of a conflict? Shouldn't it be the latest transaction that should commit on a data, since the latest transaction would be having the latest version of data? Or, what am I getting wrong here? Any help much appreciated. Thanks & Regards, Vijayakrishna.P. Mobile : (+91) 9500402305.

1 0

Plan for feature, external REMOTE table as a plugin (hadoop, jdbc, odbc, etc).
by Aris Setyawan 17 Oct '15

17 Oct '15

Hi, The key value of monetdb is it's parallel query. That many other opensource DBMS doesn't support it. But monetdb have it in the core engine. It is mean a mature feature. Having ability load (on the fly) any other DBMS data using external REMOTE table, and then query them using monetdb parallel query, will attract big community and contribution (as a plugin). The dbms, for example: jdbc, odbc, mysql, postgresql, hadoop, hive, or any commercial dbms. Any dbms which doesn't have parallel query feature, will benefit from this. Any plan for this feature? Regards, Aris

1 0

SQL join involving remote table.
by Aris Setyawan 17 Oct '15

17 Oct '15

Hi, According to https://www.monetdb.org/Documentation/Cookbooks/SQLrecipes/DistributedQuery… It is said that, "Queries involving remote tables are automatically split into subqueries by the master database and executed on remote databases.". I think this scenario: I have 3 server, one master server and two worker servers. I have 2 tables, A (big one, a fact table) and B (small one, a dimension table). A is a merge table of 2 remote tables. The remote table exist in two worker servers. B is a dimension table, that I'm not sure, on which server, I should place it on. And I will do queries, that join A and B. On which server, I should place table B to achieve distributed query processing? Is table B should be replicated on all remote table? Thanks, -Aris

2 2