[Monetdb-developers] Segmentation Fault upon sql.start()
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 After loading in a bunch of data the monetdb server was Killed due to memory starvation. With swap MonetDB performed the huge amount of one insert in 10 seconds, so that wasn't an option too. I restarted it, and tried to 'load the data again'. Backtrace: gdb ./mserver5 GNU gdb 6.7 Copyright (C) 2007 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu"... Using host libthread_db library "/lib/libthread_db.so.1". (gdb) run Starting program: /opt/monetdb/bin/mserver5 warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff275fe000 [Thread debugging using libthread_db enabled] [New Thread 0x2afd85f0f2a0 (LWP 23929)] # MonetDB Server v5.0.0 # Copyright (c) 1993-2007 CWI, all rights reserved # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # dbname:osm # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /opt/monetdb/etc/monetdb5.conf) [New Thread 0x40800950 (LWP 23932)]
include sql; sql.start();
Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x2afd85f0f2a0 (LWP 23929)] 0x00002aaaaab40a8f in load_column () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so (gdb) bt #0 0x00002aaaaab40a8f in load_column () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #1 0x00002aaaaab41a71 in load_table () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #2 0x00002aaaaab433cc in load_trans () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #3 0x00002aaaaab46e15 in store_init () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #4 0x00002aaaaab1b95b in mvc_init () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #5 0x00002aaaaaad0b50 in SQLinit () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #6 0x00002afd8389f476 in initScenario () from /opt/monetdb/lib/libmal.so.0 #7 0x00002aaaaaad0ac8 in SQLsession () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #8 0x00002afd8387842d in runMALsequence () from /opt/monetdb/lib/libmal.so.0 #9 0x00002afd83879dfd in runMAL () from /opt/monetdb/lib/libmal.so.0 #10 0x00002afd83871dc8 in MALengine () from /opt/monetdb/lib/libmal.so.0 #11 0x00002afd8389f082 in runScenarioBody () from /opt/monetdb/lib/libmal.so.0 #12 0x00002afd8389f0d2 in runScenario () from /opt/monetdb/lib/libmal.so.0 #13 0x00002afd838719e0 in MSserveClient () from /opt/monetdb/lib/libmal.so.0 #14 0x0000000000402c14 in main () (gdb) It work doesn't anymore... I can conclude, inserting a lot of data start to become a huge waste of time. If required I can recompile with the -g option and a lower amount of optimization. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHHQTsYH1+F2Rqwn0RCjWKAJ9u/OEu8Sk6HTSY+v431bLjmylrCwCffsNN Rpf0Fs4XjrakYkdyEwkknWQ= =0UHS -----END PGP SIGNATURE-----
On Mon, Oct 22, 2007 at 10:15:40PM +0200, Stefan de Konink wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512
After loading in a bunch of data the monetdb server was Killed due to memory starvation. With swap MonetDB performed the huge amount of one insert in 10 seconds, so that wasn't an option too.
I restarted it, and tried to 'load the data again'. Backtrace:
gdb ./mserver5 GNU gdb 6.7 Copyright (C) 2007 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-pc-linux-gnu"... Using host libthread_db library "/lib/libthread_db.so.1". (gdb) run Starting program: /opt/monetdb/bin/mserver5 warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff275fe000 [Thread debugging using libthread_db enabled] [New Thread 0x2afd85f0f2a0 (LWP 23929)] # MonetDB Server v5.0.0 # Copyright (c) 1993-2007 CWI, all rights reserved # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # dbname:osm # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /opt/monetdb/etc/monetdb5.conf) [New Thread 0x40800950 (LWP 23932)]
include sql; sql.start();
Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x2afd85f0f2a0 (LWP 23929)] 0x00002aaaaab40a8f in load_column () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so (gdb) bt #0 0x00002aaaaab40a8f in load_column () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #1 0x00002aaaaab41a71 in load_table () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #2 0x00002aaaaab433cc in load_trans () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #3 0x00002aaaaab46e15 in store_init () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #4 0x00002aaaaab1b95b in mvc_init () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #5 0x00002aaaaaad0b50 in SQLinit () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #6 0x00002afd8389f476 in initScenario () from /opt/monetdb/lib/libmal.so.0 #7 0x00002aaaaaad0ac8 in SQLsession () from /opt/monetdb/lib/MonetDB5/lib/lib_sql.so #8 0x00002afd8387842d in runMALsequence () from /opt/monetdb/lib/libmal.so.0 #9 0x00002afd83879dfd in runMAL () from /opt/monetdb/lib/libmal.so.0 #10 0x00002afd83871dc8 in MALengine () from /opt/monetdb/lib/libmal.so.0 #11 0x00002afd8389f082 in runScenarioBody () from /opt/monetdb/lib/libmal.so.0 #12 0x00002afd8389f0d2 in runScenario () from /opt/monetdb/lib/libmal.so.0 #13 0x00002afd838719e0 in MSserveClient () from /opt/monetdb/lib/libmal.so.0 #14 0x0000000000402c14 in main () (gdb)
It work doesn't anymore... I can conclude, inserting a lot of data start to become a huge waste of time. If required I can recompile with the -g option and a lower amount of optimization.
Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org
iD8DBQFHHQTsYH1+F2Rqwn0RCjWKAJ9u/OEu8Sk6HTSY+v431bLjmylrCwCffsNN Rpf0Fs4XjrakYkdyEwkknWQ= =0UHS -----END PGP SIGNATURE-----
------------------------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Still grepping through log files to find problems? Stop. Now Search log events and configuration files using AJAX and a browser. Download your FREE copy of Splunk now >> http://get.splunk.com/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers
Stefan Can I repeat your experiment simply by using the planetosm-to-db.pl. Where could I down load the current osm data file? Niels -- Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Niels Nes schreef:
Can I repeat your experiment simply by using the planetosm-to-db.pl. Where could I down load the current osm data file?
http://mirror.openstreetmap.nl/planet/planet-latest.osm.bz2 Just extract it. (It can be ran with compression, but your memory will be exhausted even sooner.) Run `planetosm-to-db.pl --schema` create that schema, and then just run with databasetype monetdb. As I mentioned in a private mailing I'm running with my own version of it. But you could try it with batch support. Stefan -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.7 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFHHQ3EYH1+F2Rqwn0RCoBfAJ0R9WTLgPXITGoAV0LIanhNrK66nQCeOw+/ XivdlZq9H2CrdCsCVHsu0go= =YTFi -----END PGP SIGNATURE-----
participants (2)
-
Niels Nes -
Stefan de Konink