Failed to load 128GB CSV file using Oct2012

Hai all, I try to load a CVS file of ~128GB in the ssdb branch (based on Oct2012), but after quite sometime, it failed with: #GDKrealloc(19598973840) fails, try to free up space [memory in use=22695528216,virtual memory in use=138875848472] #GDKrealloc(19598973840) result [mem=22695528216,vm=138875848472] In the last Sep., I was able to execute the same query with the same data. But now it takes much longer and ends in a crash. For INS1-ers, the command to start the server: /export/scratch2/zhang/monet-install/ssdb/debug/bin/mserver5 --set gdk_dbfarm=/export/scratch2/zhang/dbfarm --dbname=ssdb --set mapi_usock=/export/scratch2/zhang/dbfarm/ssdb/.mapi.sock --set monet_vault_key=/export/scratch2/zhang/dbfarm/ssdb/.vaultkey --set gdk_nr_threads=8 --set max_clients=64 --set sql_optimizer=default_pipe --set mapi_port=60000 The command to start the query: cd /ufs/zhang/papers/ssdb/monetdb ./run.sh loadimg small output Does anyone have an idea? If anymore information is needed, please let me know. I'm re-running the query to get a GDB stack trace. Thanks! Jennie _______________________________________________ users-list mailing list users-list@monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list
participants (1)
-
Ying Zhang