[MonetDB-users] tuning advice for TPC-H
I am trying to run some TPC-H queries to get a sense for how large of databases MonetDB can handle. I am currently trying a factor 20 database. I notice that on query 9, it is taking over two hours (still running). In "top" it claims that virtual memory for the process started at 27 GB or so, and is now down to 10 GB. What is noteworthy is that CPU usage is pretty small, at 2%. I previously observed 80-100% with a factor 1 database. I have 8 GB RAM, with 2 GB RAM swap. System swap is on a slower partition than the data drive, which is a relatively fast RAID 5 disk array. Might I be better off disabling system swap altogether when using MonetDB? Are there any other configuration changes I should make or MonetDB best practices I should follow? Thanks, Rahul = Mercedes Homes- San Antonio real estate Mercedes Homes builds homes and communities in the San Antonio area. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=9c24f83a902bfb70ef8d7bc6... -- Powered by Outblaze
On Mon, Jan 07, 2008 at 11:35:51PM +0800, Rahul Chopra wrote:
I am trying to run some TPC-H queries to get a sense for how large of databases MonetDB can handle. I am currently trying a factor 20 database.
I notice that on query 9, it is taking over two hours (still running). In "top" it claims that virtual memory for the process started at 27 GB or so, and is now down to 10 GB. What is noteworthy is that CPU usage is pretty small, at 2%. I previously observed 80-100% with a factor 1 database.
Does this mean you got the sf-20 loaded? What fixed your problem with loading? The low cpu usage indicates that MonetDB is waiting for IO. I'll later this week try to repeat your experiment on a similar system. Then I'll have more input on how to improve things. Your are still using the Stable (ie not the cvs head version)? Niels
I have 8 GB RAM, with 2 GB RAM swap. System swap is on a slower partition than the data drive, which is a relatively fast RAID 5 disk array. Might I be better off disabling system swap altogether when using MonetDB? Are there any other configuration changes I should make or MonetDB best practices I should follow?
Thanks,
Rahul
= Mercedes Homes- San Antonio real estate Mercedes Homes builds homes and communities in the San Antonio area. http://a8-asy.a8ww.net/a8-ads/adftrclick?redirectid=9c24f83a902bfb70ef8d7bc6...
-- Powered by Outblaze
------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes@cwi.nl
participants (2)
-
Niels Nes
-
Rahul Chopra