Dear Mobi, Thank you for your interest. The load you present is a real challenge to any DBMS. One normally performs it in smaller increments. The report of 0 in many columns has been reported internally as well, and we are investigating the situation. It is a hard one, because it only seems to appear in very large loads. And it is not easily reproducable. A first step i would take is to use an incremental version, with smaller increments. How much is optimal is probably trial and error. Your experiences, however, are helpful for many others that follow. regards, Martin mobigital1 wrote:
I am trying to load about 500M rows into a table with about 160 columns:
column types: 7 columns of type "int" 2 columns of type "varchar(20)" 6 columns of type "varchar(10)" 1 columns of type "varchar(15)" 144 columns of type "real"
on a system with 16 GB RAM , 64 bit windows server 2003 SP2.
it takes some 20 hours to load the 100M rows, but when I reach that boundary, the server seems to crash and database becomes corrupt so that about 95M rows have 0 in numeric columns, blanks in varchars. The remaining 5M rows have real data.
does anyone have any suggestions on what can be done to make it possible to load this data?