Hi Andrey, On Fri, Nov 12, 2010 at 10:32:15AM +0300, Andrey Timofeyev wrote:
Hello, All,
We began to use MonetDB several weeks ago. As I can see people use monetdb several years and operate with millions of records.
Indeed. E.g., on a standard 8 GB Linux desktop, we can easily load an query a 100 GB TPC-H instance; the largest table has 600 M records, and is about 70 GB in size.
But we could not insert even several thousands records.
What do your records and/or table schema look like? How many columns, which types, how wide (bytes per record? How do you insert them? Bulkload via COPY INFO from CSV file or single insert statement per tuple? Which interface do you use? Plain mclient, ODBC, JDBC, ...? Can you successfully load less data / fewer records? If so, how many can you load successfully before the problems occur?
After several minutes monetdb eat all 7 Gb memory
That is to be expected is your data size is (that) large, i.e., MonetDB (efficiently & effectively) does exploit all available physical memory, if required --- what else does a DB server machine have memory for? ;-)
and crush without any message.
That is unexpected and strange. No message at all? On the server console or in the terminal window / shell that the server was started in? Not even a segfault? Also not on Linux? What is the errorlevel (Windows) or return code (Linux) of your mserver5 process after it stops (crashes)? On Linux, did you try to start the server via merovingian and the check the merovingian logs?
It seems that we use monetdb incorrectly. Do there exist any special options for start monetdb?
No, MonetDB should in general run "nob-less".
MonetDB version: MonetDB server v5.20.5 (64-bit), based on kernel v1.38.5 (32-bit oids) Release Jun2010-SP2 Copyright (c) 1993-July 2008 CWI Copyright (c) August 2008-2010 MonetDB B.V., all rights reserved Visit http://monetdb.cwi.nl/ for further information Found 7.9GiB available memory Configured for prefix: C:\Users\sjoerd\Documents\src\stable\vs64\NTv64 Libraries: libpcre: 7.9 2009-04-11 openssl: OpenSSL 1.0.0a 1 Jun 2010 libxml2: 2.7.7 Compiled by: sjoerd@ALGOL (i686-pc-win32) Compilation: cl -GF -W3 -WX -wd4273 -wd4102 -MD -nologo -Ox Linking : cl -GF -W3 -WX -wd4273 -wd4102 -MD -nologo -Ox
OS: Windows 7 x64 (Версия 6.1.7600 Сборка 7600) (We also try it on the ubuntu 10.4 - same effect)
-- Best regards, Andrey.
------------------------------------------------------------------------------ Centralized Desktop Delivery: Dell and VMware Reference Architecture Simplifying enterprise desktop deployment and management using Dell EqualLogic storage and VMware View: A highly scalable, end-to-end client virtualization framework. Read more! http://p.sf.net/sfu/dell-eql-dev2dev
_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |