Thats true.

But isn't there a way we could figure out that OS is not gonna give us more RAM before being killed. That way it could deny further queries instead of dying out resulting in failure of all running queries. Just thinking out loud.
I stretched it further with 4GB Swap along with the 4G RAM. Firing 10 queries from 5 different machines. It ate up all the Swap and the RAM usage was at 95 % for a long time before being killed. Going ahead to set an 8G swap.

Thanks and Regards,
Tapomay.
From: Fabian Groffen <Fabian.Groffen@cwi.nl>
To: monetdb-users@lists.sourceforge.net
Sent: Monday, July 9, 2012 7:17 PM
Subject: Re: [MonetDB-users] mserver crash under load -16G data, 10 queries each from 2 remote clients

On 06-07-2012 06:12:34 -0700, Tapomay Dey wrote:
> Hehe, goofup on my side. Spoiler alert:Needed swap.
>
> But I think monet could do something smart about it.

What would you suggest?

> any pointers as to if and how do I optimise when the data bulges into swap.

buy more memory ;)

Seriously, not much you can do when you want to process more data than
your memory can hold.

You could try to put your swap on fast disks (e.g. raid-0 of SSDs), but
also your dbfarm data could benefit from that, as when your data doesn't
fit in memory, you'll be reading (and possibly writing) from disk
frequently.

Fabian

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and
threat landscape has changed and how IT managers can respond. Discussions
will include endpoint security, mobile security and the latest in malware
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
MonetDB-users mailing list
MonetDB-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/monetdb-users