April 2010 - users-list

[MonetDB-users] monetdb/merovingian
by dariuszs 20 Apr '10

20 Apr '10

Hi, I've got this messages after rebooting the server and trying to start merovingian again: unable to open '/var/run/MonetDB/merovingian.pid' for writing: No such file or directory Software: Ubuntu 9.10 MonetDB server v5.18.3 (64-bit), based on kernel v1.36.3 (64-bit oids) Please help. Dariusz.

5 12

[MonetDB-users] Python Error
by Matthew Jones 20 Apr '10

20 Apr '10

Hey folks, I'm seeing an error in the Python API. When connecting to a remote Monet instance with the python client and setting the cursor's arraysize to something significant (100, as an example) then I get the following error: Traceback (most recent call last): File "afile.py", line 9, in <module> cur.execute("SELECT max(val), otherval" File "build/bdist.linux-x86_64/egg/monetdb/sql/cursors.py", line 203, in execute File "build/bdist.linux-x86_64/egg/monetdb/sql/cursors.py", line 445, in __store_result File "build/bdist.linux-x86_64/egg/monetdb/sql/cursors.py", line 529, in __parse_tuple File "build/bdist.linux-x86_64/egg/monetdb/sql/cursors.py", line 569, in __exception_handler monetdb.monetdb_exceptions.InterfaceError: length of row doesn't match header This doesn't happen when the client is used locally on the machine running the database. I will open a bug about this, also. It prevents the .arraysize cursor property from being used remotely. It's default value is 1, which causes the server to take a ridiculously long time to send back large data sets. 73, Matthew W. Jones (KI4ZIB) http://matburt.net

2 1

[MonetDB-users] Foreign key validation issue with "COPY INTO..." ?
by Matthieu Guamis 19 Apr '10

19 Apr '10

Hello, "COPY INTO" command fails with "FOREIGN KEY constraint 'xxx' violated" whereas "INSERT INTO" succeeded. Simple 3 tables example (it works with 2 tables, one referencing the other): CREATE TABLE a ( a1 VARCHAR(3) NOT NULL, CONSTRAINT pka PRIMARY KEY (a1) ); CREATE TABLE b ( b1 VARCHAR(3) NOT NULL, b2 VARCHAR(3) NOT NULL, CONSTRAINT pkb PRIMARY KEY (b1,b2), CONSTRAINT fk1 FOREIGN KEY (b2) REFERENCES a (a1) ); CREATE TABLE c ( c1 varchar(3) NOT NULL, c2 varchar(3) NOT NULL, c3 varchar(3), CONSTRAINT pkc PRIMARY KEY (c1,c2), CONSTRAINT fk2 FOREIGN KEY (c2) REFERENCES a (a1), CONSTRAINT fk3 FOREIGN KEY (c2,c3) REFERENCES b (b1,b2) ); Using INSERT INTO: sql>insert into a values ('aaa'); 1 affected row sql>insert into c values ('cc1','aaa',null); 1 affected row Using COPY INTO with one line input file "test.txt" containing : cc2|aaa| sql>COPY INTO c FROM '/home/mat/test.txt' USING DELIMITERS '|',' more>' NULL as ''; SQLException:assert:INSERT INTO: FOREIGN KEY constraint 'c.fk3' violated Bug or misunderstanding? Thanks a lot, Matthieu PS: mserver5 --version MonetDB server v5.18.3 (64-bit), based on kernel v1.36.3 (64-bit oids) Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2010 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Found 2.0GiB available memory, 2 available cpu cores Configured for prefix: /usr Libraries: libpcre: 7.8 2008-09-05 (compiled with 7.8) openssl: OpenSSL 0.9.8g 19 Oct 2007 (compiled with OpenSSL 0.9.8g 19 Oct 2007) libxml2: 2.7.5 (compiled with 2.7.5) Compiled by: root@ubuntu-karmic-64 (x86_64-pc-linux-gnu) Compilation: gcc -O2 -Wall -O2 -O6 -fomit-frame-pointer -finline-functions -falign-loops=4 -falign-jumps=4 -falign-functions=4 -fexpensive-optimizations -funroll-loops -frerun-cse-after-loop -frerun-loop-opt -ftree-vectorize Linking : ld -IPA -m elf_x86_64 -Wl,-Bsymbolic-functions

4 4

[MonetDB-users] XRPC queries do not behave like Mclient queries
by Ryad Ben-El-Kezadri 16 Apr '10

16 Apr '10

Hello, 1°)I am querying Monetdb through the XRPC java API. I have implemented a xquery in a function in a XRPC module and I call it from java. I noticed that my XRPC module is not loaded when the xquery compares an attribute to an integer value (for instance $n[@attr=1]) In this case, I get the following error message embedded in the XRPC reply: Error occurred during execution fatal error: function #pf:number is not supported. xquery_module_load: could not load module. Comparing an attribute to a string works fine however (ex $n[@attr="1"]) 2°)What is strange is that the same function (fct) works perfect when I call it from the Mclient (instead of java). Example import module namespace f="xrpc-extract-function" at " http://127.0.0.1:50001/export/extract.xq"; f:fct("file.xml", 0, 1000000) 3°)I don't know if this problem is general or specifically related to my configuration. Indeed I had to load the server modules myself (else the server crashes) with the following command in the bat server script: "%MONETDB%\bin\Mserver.exe" --dbinit="module(pf_support);module(logger);module(xrpc_client);module(xrpc_server);module(pf_standoff);module(mkey);module(pathfinder);module(mapi);" --set "prefix=%MONETDB%" --set "exec_prefix=%MONETDB%" %MONETDBFARM% %* Your help will be really helpful, because right now I can only do string comparisons on attributes (which slows the program a lot,....). My guess is that, when invoked from java, Monetdb looks (at load time) for pf:number instead of fn:number to convert the string value of the attribute, but that this function does not exist Warm regards Ryad ////////////////////////////////////////// Here is my java call, I guess it is exaclty the same signature that with the Mclient (so there is no problem with it) String call = XRPCMessageMine.XRPC_SEQ(XRPCMessageMine.XRPC_ATOM("string", file)) + XRPCMessageMine.XRPC_SEQ(XRPCMessageMine.XRPC_ATOM("double", Double.toString(timeInterval[0]))) + XRPCMessageMine.XRPC_SEQ(XRPCMessageMine.XRPC_ATOM("double", Double.toString(timeInterval[1])));

1 0

[MonetDB-users] monetdb sql - same query different results
by dariuszs 16 Apr '10

16 Apr '10

Hi, Same query produces different results: sql>select count(*) from plk100 WHERE 0=0 and c15 in (select zip from zip_list) and ( c102 in ('1','0')) and ( c28 in ('1','0')) and ( c66 in ('01')); +-------+ | L73 | +=======+ | 14945 | +-------+ 1 tuple Timer 69.446 msec 1 rows sql>select count(*) from plk100 WHERE 0=0 and c15 in (select zip from zip_list) and ( c102 in ('1','0')) and ( c28 in ('1','0')) and ( c66 in ('01')); +-------+ | L73 | +=======+ | 57257 | +-------+ 1 tuple Timer 146.666 msec 1 rows sql> Please help.

2 8

[MonetDB-users] monetdb python API, howto install
by Martin Körner 16 Apr '10

16 Apr '10

Hello Guys, i have installed the MonetDB 5 SQL client-server package from http://monetdb.cwi.nl/downloads/Windows/Feb2010-SP1/ The downloaded file was MonetDB5-SQL-Installer-i386-20100322.msi. So i use a Windows XP 32bit system. My installed Python version is now 2.6. Now i want to access MonetDB with Python. But i found no way to install the MonetDB Python API. I tried it like it is shown on http://monetdb.cwi.nl/SQL/Documentation/The-Python-Library.html But there is no file 'setup.py' to install. Is there any other way to install the API? Where i can download an install package for the API? With best greetings from Germany, Martin -- heidemann added insight GmbH In der Weidbach 2 63477 Maintal Telefon: +49 6181 9080739 Internet: www.added-insight.com USt-Id DE 2130 86 540 Registernummer: HRB 91533 (Amtsgericht Hanau) Geschäftsführer: Dr. Jeffrey Heidemann ********************************************************************* Diese E-Mail kann vertrauliche und/oder rechtlich geschuetzte Informationen enthalten. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtuemlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail ist nicht gestattet. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. **********************************************************************

1 1

[MonetDB-users] MonetDB/XQuey - how to ignore DTDs?
by Roberto Cornacchia 15 Apr '10

15 Apr '10

Hi all, I wonder is there is an option to make MonetDB/XQuery shredder ignore DTD files. What triggered this question is the need to shred about 20M files, each of them including *the same* online DTD. What happens is that, for each xml file, the DTD is downloaded and shredded/used(?). It is not even cached (I tried using xquery_cacherules, but apparently it has no effect on DTDs). This makes shredding speed drop down to more than 3 seconds per document, which is not an option of course, as it would take me roughly 700 days to shred the entire collection :) Removing DTD link from the original xml files is not an option either, the collection is simply too big to be replicated. How can the DTD be ignored? Roberto -- | M.Sc. Roberto Cornacchia | CWI (Centrum voor Wiskunde en Informatica) | Science Park 123, 1098XG Amsterdam, The Netherlands | tel: +31 20 592 4322 , http://www.cwi.nl/~roberto

4 4

[MonetDB-users] grouping sets
by Nafees Ur Rehman 15 Apr '10

15 Apr '10

Hi, Whats is the syntax of grouping sets in monetdb? I am trying Select has_nurs,form,health,class,count(*) from nursery group by GROUPING SETS ((has_nurs,class),(form,class),(health,class)) but it does not work Regards Nafees Ur Rehman

3 3

Re: [MonetDB-users] [Monetdb-developers] MonetDB memory management
by Stefan de Konink 15 Apr '10

15 Apr '10

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Op 15-04-10 11:00, Xiao Lei schreef: > Then how can i release the memory? By not posting to me directly but reply to the mailinglist ;) It will not directly solve your problem, but keep other people in the loop. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEAREKAAYFAkvG238ACgkQYH1+F2Rqwn1xdwCeOxnqWgALhsk4ue2vEv/D/ZsM IC0AnRyRAUabgy7Z2u2UZHGOXl4EJLYS =fsie -----END PGP SIGNATURE-----

2 1

[MonetDB-users] DBD::monetdb and database name
by Dave Howorth 14 Apr '10

14 Apr '10

I just started trying to use DBD::MonetDB and ran into a couple of issues. I'm not sure where you prefer to get reports so I thought I'd send it here first. First, although both the version on CPAN and the version on my machine, presumably from the MonetDB installation, both claim to be version 0.09, they are different. IMHO, this is a Bad Idea. Having the up-to-date version on CPAN is desirable since that's what Perl programmers expect. Having two versions with the same number is essential, since otherwise CPAN's and Perl's dependency mechanisms will fail and bug reporting becomes a real problem. Second, and what caused me to investigate more carefully, when I typed in the first example program for DBD::monetdb I saw: $ ./monetdb-test-1.pl DBI connect('','',...) failed: merovingian: no such database 'demo', please create it first That doesn't surprise me, because I didn't create a demo database. But I was surprised when I couldn't find any facility to name the database in the documentation or the code. Except when I actually read the installed code as opposed to the published version on CPAN I see that there is. So please add docs. I've suggested a patch below. Cheers, Dave PS The code will compile a little faster if you use __END__ --- /usr/lib/perl5/DBD/monetdb.pm 2010-03-22 16:22:51.000000000 +0000 +++ perl/DBD/monetdb.pm 2010-04-14 15:18:13.000000000 +0100 @@ -670,6 +670,8 @@ 1; +__END__ + =head1 NAME DBD::monetdb - MonetDB Driver for DBI @@ -783,6 +785,7 @@ $dsn = 'dbi:monetdb:'; $dsn = "dbi:monetdb:host=$host"; $dsn = "dbi:monetdb:host=$host;port=$port"; + $dsn = "dbi:monetdb:host=$host;database=$database"; $dbh = DBI->connect($dsn, $user, $password); @@ -794,7 +797,11 @@ =item port -The port where MonetDB daemon listens to. Default for MonetDB is 50000. +The port where MonetDB daemon listens. Default for MonetDB is 50000. + +=item database + +The name of the database to connect to. =back

2 1