Hi, I just tried your example, i.e., loading via copy into from file then dumping via copy select ... limit ... into file then restarting server and dumping again --- obviously not with your data, though, but with ~400000 rows of a 90+ column table, and that works fine with Feb2010, Feb2010-SP1 & Feb2010-SP2 preview on my 64-bit 4-core Fedora 12 desktop. In case you are familiar with C development and debugging, you might want to compile a debugging version of MonetDB (configured with --enable-debug), run mserver5 in a debugger, locate the actual location of and reason for the segfault, and report. Remotely, I cannot do more since I cannot reproduce the segfault. Stefan On Thu, Apr 22, 2010 at 10:53:44AM -0400, dariuszs wrote:
Hi, OK, simple query works and there is something new - when I import data and run the query in the same session - it works, when I restart the server It segfaults - file permissions? Take a look.
[root@monetdb masters]# mclient -lsql -d demo user(root):monetdb password: Welcome to mclient, the MonetDB/SQL interactive terminal Database: MonetDB v5.18.3, 'demo' Type \q to quit, \? for a list of available commands auto commit mode: on sql>\< /vol2/monetdb_data/masters/create_plk100.sql operation successful sql>copy 1000000 records into plk100 from '/vol2/monetdb_data/masters/PLK100.DAT' delimiters '|','\n',''; 1000000 affected rows sql>copy select * from tables limit 10 into '/tmp/output.txt'; 10 affected rows sql>copy select * from tables limit 10 into '/tmp/output.txt'; 10 affected rows sql>copy select * from plk100 limit 10 into '/tmp/output.txt'; 10 affected rows sql>copy select * from plk100 limit 10 into '/tmp/output.txt'; 10 affected rows sql>\q
[root@monetdb MonetDB]# mserver5 --dbinit="include sql;" # MonetDB server v5.18.3, based on kernel v1.36.3 # Serving database 'demo', using 16 threads # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Found 47.259 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2010 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.36.3 loaded
\q
[root@monetdb masters]# mclient -lsql -d demo user(root):monetdb password: Welcome to mclient, the MonetDB/SQL interactive terminal Database: MonetDB v5.18.3, 'demo' Type \q to quit, \? for a list of available commands auto commit mode: on sql>copy select * from tables limit 10 into '/tmp/output.txt'; 10 affected rows sql>copy select * from plk100 limit 10 into '/tmp/output.txt'; MAPI = monetdb@localhost:50000 ACTION= read_line QUERY = copy select * from plk100 limit 10 into '/tmp/output.txt'; ERROR = !Connection terminated [root@monetdb masters]#
[root@monetdb MonetDB]# mserver5 --dbinit="include sql;" # MonetDB server v5.18.3, based on kernel v1.36.3 # Serving database 'demo', using 16 threads # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # Found 47.259 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2010 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.36.3 loaded
Segmentation fault
Thanks. Dariusz.
Stefan Manegold wrote:
On Wed, Apr 21, 2010 at 08:23:06PM +0200, Fabian Groffen wrote:
On 21-04-2010 14:15:33 -0400, dariuszs wrote:
Single thread works, but what does it really mean? Thanks. Dariusz
It means you likely have the same problem as Hering Cheng, which seems related to parallelism.
You can try to unset (monetdb inherit nrthreads demo) the single threadedness once you have loaded the data.
Just to make sure, Dariusz' problem is not with loading data from .csv file into the database (copy into from file) but with dumping data from the database into a .csv file (copy select ... into file). Hence, is it not necessarily related to Hering Cheng's loading problem.
I just tried a (simplified) dump like
copy select * from tables limit 10 into '/tmp/output.txt';
on my 4-core Febdora 12 desktop with Feb2010, Feb2010-SP1 & Feb2010-SP2 preview, and all work fine.
Dariusz,
could you please test & report whether this simple version also works (in standard multi-threaded mode) also on your 16-core machine(s)?
Could you also check & report, wether the select part (without copy ... into file) works fine on your machine(s), i.e., select * from table1 limit 1000;
Thanks!
Stefan
------------------------------------------------------------------------------ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
------------------------------------------------------------------------------ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |