De:
Stefan Manegold <Stefan.Manegold@cwi.nl>
Para: Communication channel for MonetDB users <monetdb-users@lists.sourceforge.net>
Enviadas: Sexta-feira, 25 de Junho de 2010 18:20:30
Assunto: Re: [MonetDB-users] Res: MonetDB aborts when importing over 10 million rows
Hi Luis,
on a 32-bit system, MonetDB is limited to database of at most 4 GB; on
Windows, the limit is usually at most 3 GB or even only 2 GB, as Windows
does not allow larger processes on a 32-bit system; see also
http://zone.ni.com/reference/en-XX/help/371361D-01/lvhowto/enable_lrg_ad_aware/In your case, with 8 files (years) of >300 MB you have >2.4 GB of raw data,
and I'm afraid
you will not be able to load this amount into MonetDB on a
32-bit Windows system; surely not in the dfault configuration that does not
allow processes to grow beyond 2 GB, but evenn if you configure it to allow
3 GB (cf.,
http://zone.ni.com/reference/en-XX/help/371361D-01/lvhowto/enable_lrg_ad_aware/)
it might not work.
To load all the data into MonetDB, you'd need to consider a 64-bit system
(and 64-bit MonetDB).
BTW, does the server actually crash, or does it "merely" report an error,
aborting the load, but the server keeps running?
Stefan
orge.net/lists/listinfo/monetdb-users