On Fri, May 29, 2009 at 11:35:12AM +0100, Rob Wickert wrote:
How many tuples are in your 60GB dataset, i.e., your table "raw_data"? Of which datatype is attribute "keyword"? How many distinct values are there / do you expect in column "keyword"?
This depends on the amount and kind of data as well as the type of queries. While we manage to run 100GB TPC-H on a 8 GB machine, generally "the more the better" does apply...
There are aprox 28 million keywords (varchar(100)) out of 680 million row table. Yes I know 3GB is not ideal and I wasn't expecting blindingly fast queries until we bump up the memory, but I wasn't expecting the memory mapping issue. There's plenty of space on the disk - 151GB;
Rob, also for this one, could you please upgrade to the latest May2009 release (http://monetdb.cwi.nl/Development/Releases/May2009/), try again, preferably prefixinng your query in mclient with "TRACE " to produce a performance trace that will give us more hints, where the problem occurs, and report? Thanks, Stefan
------------------------------------------------------------------------------ Register Now for Creativity and Technology (CaT), June 3rd, NYC. CaT is a gathering of tech-side developers & brand creativity professionals. Meet the minds behind Google Creative Lab, Visual Complexity, Processing, & iPhoneDevCamp as they present alongside digital heavyweights like Barbarian Group, R/GA, & Big Spaceship. http://p.sf.net/sfu/creativitycat-com _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |