April 2015 - users-list

Incorrect results on joining with same table
by Vijay Krishna 08 Apr '15

08 Apr '15

Hi, I am using MonetDB Jan2014 SP1, running on MacOS. I have a table like this. sql>select * from two; +------+---------------------------------------------------------------------------------------------- | id | name | istrue | joindate | jointime | count | +======+==================================================== | 1 | null | false | 2017-12-08 | 2014-06-30 14:05:31.000000 | 2 | | 2 | vijay | false | 2017-12-08 | 2014-06-30 14:05:59.000000 | 3 | | 3 | krish | true | 2017-12-08 | 2014-06-30 14:06:17.000000 | 5 | | 4 | bat | true | null | null | null | | 5 | gotham | false | null | null | null | | 6 | wayne | false | null | null | 3 | +------+------------------------------------------------------------------------------------------------- 6 tuples (3.504ms) I tried to do a join on this table with the same table with the following query and got this result. sql>select two.id, two.name, two.count, twoAlias.id as id2, twoAlias.name as name2 from two left join two twoAlias on two.count=twoAlias.id; +------+------------------------------------------- -------------------------------------------------------+ | id | name | count | id2 | name2 +=============================================================+ | 1 | null | 2 | 2 | vijay | | 2 | vijay | 3 | 3 | krish | | 3 | krish | 5 | 5 | gotham | | 4 | bat | null | 3 | krish | | 5 | gotham | null | null | null | | 6 | wayne | 3 | null | null | +------+-------------------------------- --------------------------------------------------------------------+ 6 tuples (5.605ms) As it could be seen clearly, *this join is clearly resulting in a wrong output* at the 4th row. *The join criterion two.count=twoAlias.id is satisfied in the first 3 rows, but are clearly violated in the 4th row*, where in the values in the join columns (count and id2 here) are clearly found to be different. Hence the join rows are not matching. I expected that the output would be +------+------------------------------------------- -------------------------------------------------------+ | id | name | count | id2 | name2 +=============================================================+ | 1 | null | 2 | 2 | vijay | | 2 | vijay | 3 | 3 | krish | | 3 | krish | 5 | 5 | gotham | | 4 | bat | null | null | null | | 5 | gotham | null | null | null | | 6 | wayne | 3 | null | null | +------+-------------------------------- --------------------------------------------------------------------+ 6 tuples (5.605ms) Is this really a bug?? Else, what would be the logic behind this? Thanks in advance. With Regards, Vijayakrishna.P. Mobile : (+91) 9500402305.

2 2

RE: MonetDB, data loss in restart server
by Luciano Sasso 08 Apr '15

08 Apr '15

Anyone have any idea about ? - OS is Debian 7 64-bit, in a VM in VMware virtualization System. - Hard disk 100G with 26% usage. - 5 cores. - 6G RAM. - Version MonetDB: MonetDB 5 server v11.15.17 "Feb2013-SP5" - Table: create table (id int, dt date, product varchar (50) .... etc, and another 30 columns between int and varchar. - Query: select dt, count (id) from table where produtct in (....) group by dt Message: 1 Date: Thu, 2 Apr 2015 23:16:39 +0200 From: Ying Zhang<Y.Zhang at cwi.nl <https://www.monetdb.org/mailman/listinfo/users-list>> To: "Communication channel for developers of the MonetDB suite." <developers-list at monetdb.org <https://www.monetdb.org/mailman/listinfo/users-list>> Cc:users-list at monetdb.org <https://www.monetdb.org/mailman/listinfo/users-list> Subject: Re: MonetDB, data loss in restart server Message-ID:<6C2903C0-4399-462D-9D3F-822351DE1979 at cwi.nl <https://www.monetdb.org/mailman/listinfo/users-list>> Content-Type: text/plain; charset=windows-1252 Hello Luciano, Thanks for using monetdb, and sorry for the inconvenience. Would you please give us some background information about your setting: - which OS? - hardware spec. of your system - which monetdb version? - what does your query do? - when and how did the database stop? If the monetdb server stopped, did it give any error message? - what's at the end of the merovingian log? With kind regards, Jennie -- Luciano Sasso Vieira Gestor - Inteligência de Negócios luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 9706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. http://www.avast.com

2 1

MonetDB for DW
by Luciano Sasso 08 Apr '15

08 Apr '15

Which of you with experience MonetDB production with large volume of data? You use some NoSQL base for storage of DW, and makes loads for MonetDB, for analysis, or use the monetdDB with dw too? Att, -- Luciano Sasso Vieira Gestor - Inteligência de Negócios luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 9706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. http://www.avast.com

1 0

Cluster, How work ?
by Luciano Sasso 08 Apr '15

08 Apr '15

On a cluster using MonetDB, the documentation is not clear how it works. Data is automatically replicated between cluster nodes? There is an automatic load balancing? There sharding? Att, -- Luciano Sasso Vieira Gestor - Inteligência de Negócios luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 9706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. http://www.avast.com

1 0

Sorting cluster's level queries
by José Raúl Pérez Rodríguez 06 Apr '15

06 Apr '15

Hi, I am new in monetdb. I was quering a multiplex funnel database and obviously (after read the description of multiplex funnel), the return values don't show up sorted. My question is: if using multiplex funnel databases queries can't be sorted, then how are sorted the queries at cluster level, i.e queries that retrieve data from 2 or more nodes? and how to perform that kind of quieries (not using a multiplex funnel). Thanks,

1 0

About "Zero-copy integration between MonetDB and R"
by Aris Setyawan 06 Apr '15

06 Apr '15

Hi all, First, thanks for implementing multi-core, parallel execution engine, ini MonetDB. This make MonetDB, the only opensource dbms, which have this feature. I'm sure, since MonetDB use mmap file, it is already use Zero-copy memory technique when loading data into memory for further processing. But, why the "Zero-copy integration between MonetDB and R" is not implemented in MonetDB release? -Aris

2 1

Building MonetDB from RPM on ROSA Desktop R4
by Brian Hood 05 Apr '15

05 Apr '15

Hi Guys, I know this isn't a support distro at all i'm just trying to get MonetDB to work on my ROSA Desktop R4 machine which is Linux / KDE with a Twist distro. http://pastebin.com/wiH6RPzQ Its all about this at the bottom. 1. cd . && /bin/sh ./config.status rpm.mk 2. config.status: creating rpm.mk 3. cd . && /bin/sh /home/brian/Downloads/rpmbuild/BUILD/MonetDB-11.19.7/buildtools/conf/missing automake-1.13 --foreign 4. configure.ac:372: error: required file 'buildtools/conf/compile' not found 5. configure.ac:372: 'automake --add-missing' can install 'compile' 6. Makefile:521: recipe for target 'Makefile.in' failed 7. make: *** [Makefile.in] Error 1 8. error: Bad exit status from /var/tmp/rpm-tmp.25756 (%build) 9. Automake the wrong version i'm not sure it seems to be upto date. Anybody any ideas on the off chance somebody has seen this before ? Regards, Brian Hood

2 2

Re: MonetDB, data loss in restart server
by Luciano Sasso 05 Apr '15

05 Apr '15

- OS is Debian 7 64-bit, in a VM in VMware virtualization System. - Hard disk 100G with 26% usage. - 5 cores. - 6G RAM. - Version MonetDB: MonetDB 5 server v11.15.17 "Feb2013-SP5" - Table: create table (id int, dt date, product varchar (50) .... etc, and another 30 columns between int and varchar. - Query: select dt, count (id) from table where produtct in (....) group by dt Message: 1 Date: Thu, 2 Apr 2015 23:16:39 +0200 From: Ying Zhang<Y.Zhang(a)cwi.nl> To: "Communication channel for developers of the MonetDB suite." <developers-list(a)monetdb.org> Cc:users-list@monetdb.org Subject: Re: MonetDB, data loss in restart server Message-ID:<6C2903C0-4399-462D-9D3F-822351DE1979(a)cwi.nl> Content-Type: text/plain; charset=windows-1252 Hello Luciano, Thanks for using monetdb, and sorry for the inconvenience. Would you please give us some background information about your setting: - which OS? - hardware spec. of your system - which monetdb version? - what does your query do? - when and how did the database stop? If the monetdb server stopped, did it give any error message? - what's at the end of the merovingian log? With kind regards, Jennie -- Luciano Sasso Vieira Gestor - Inteligência de Negócios luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 9706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. http://www.avast.com

1 0

Re: MonetDB, data loss in restart server
by Ying Zhang 02 Apr '15

02 Apr '15

Hello Luciano, Thanks for using monetdb, and sorry for the inconvenience. Would you please give us some background information about your setting: - which OS? - hardware spec. of your system - which monetdb version? - what does your query do? - when and how did the database stop? If the monetdb server stopped, did it give any error message? - what's at the end of the merovingian log? With kind regards, Jennie > On Apr 01, 2015, at 06:46, Luciano Sasso <luciano(a)gsgroup.com.br> wrote: > > Hello, > > I have used the MonetDB in production for some time, and I have nothing to complain about, > are tables with more than 30 columns and 30 million records, do analysis through cubes in Pentaho / Saiku. > Have restarted the server several times, and never had problems with loss of data.But today, > after performing a query that was consuming a lot of machine, stopped the database, and when I started, > data from some columns were blank. How can it, will the data were still uncommitted? > when performing a query the MonetDB changes the data or reorganized? which may have occurred, I am concerned. > > > -- > <Slice_01.png> <Slice_02.jpg> > Luciano Sasso Vieira > Gestor - Inteligência de Negócios > > luciano(a)gsgroup.com.br | tel: 17 3353-0833 | cel: 17 9706-9335 > <Slice_04.png> www.gsgroup.com.br > <Slice_06.png> > > > Este email foi escaneado pelo Avast antivírus. > www.avast.com > > > _______________________________________________ > developers-list mailing list > developers-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/developers-list

1 0

MonetDB in Production
by Luciano Sasso 02 Apr '15

02 Apr '15

Hi, I use MonetDB production together with Pentaho BI Server and Saiku, works very well and never had problems. I am currently about 30 million entries in a table of about 40 columns, occupying 9G disk. I'll use it now on other projects that this volume will increase a lot. On what basis of size and number of records you have experience and have arrived? Use in production? I was worried because a few days ago I had a corrupt basis, that is, some columns were blank after restarte the bank, do not know if is related to the data base or was disk failure, to join if I do not have evidence of failure disk, but I can not say. Att, -- Luciano Sasso Vieira Gestor - Inteligência de Negócios luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 9706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. http://www.avast.com

1 0