Richard Wesley wrote:
On 17 Oct 2008, at 13:46, Niels Nes wrote:
I see a failure after a COPY 19348821 OFFSET 58046463 RECORDS INTO ... query. Could it be that either the server or the client is using too much memory? It could be that the server uses too much memory and therefore complains, but by the time you try it again, the server has maybe consolidated some tables and can again cope with the next batch.
So one thing to check for is the memory footprint of the server.
Niels, what do you think? The table consists of 7 integers and 2 float(53) and the application inserts batches of nearly 20M rows.
Probably its indeed some form of out of memory which causes the problem.
I could cut the batch size in half (I do it based on the file size.)
Is the size limitation based on the input text or the built data?
The batch size should not be the problem. It is the final table size. Are you running on a 32bits machine?
________________________________________________________ Richard Wesley Senior Software Developer Tableau Software Visit: http://www.trytableau.com/now.html
------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users