how well does MonetDB scale to large servers (e.g. 4 CPU/64+ cores/2+TB RAM)?
[Sorry if this question was already asked and answered before - I'm new to this mailing list.] Recently servers with up to 6TB RAM became relatively affordable to be used with MonetDB (considering total cost of server hw + DB sw license) - but will MonetDB scale well to use all that hardware? I know it can be tried on the cloud using (for example) x1.32xlarge EC2 spot instances but before doing that I'd like to ask people with more knowledge/experience with MonetDB if it at least looks feasible, if there are any important tuning parameters for such hw etc. If you've tired similar hardware and/or know some relevant implementaton details maybe you can share your experience? Thanks. Igor
Hai, MonetDB loves powerful hardware, particularly, RAM. If your hardware forms a single (logical) entity, MonetDB will try to make use of all available hardware. I don’t have experience with single systems of more than 1TB RAM myself, but there are commercial hardware products with almost 20TB RAM and 1000+ cores with MonetDB pre-installed on them for heavy analytical workloads. The question is also do you have heavy enough workload (data set & queries) to keep the hardware constantly busy? Regards, Jennie
On 19 Oct 2016, at 17:24, Igor Mendelev
wrote: [Sorry if this question was already asked and answered before - I'm new to this mailing list.]
Recently servers with up to 6TB RAM became relatively affordable to be used with MonetDB (considering total cost of server hw + DB sw license) - but will MonetDB scale well to use all that hardware?
I know it can be tried on the cloud using (for example) x1.32xlarge EC2 spot instances but before doing that I'd like to ask people with more knowledge/experience with MonetDB if it at least looks feasible, if there are any important tuning parameters for such hw etc.
If you've tired similar hardware and/or know some relevant implementaton details maybe you can share your experience?
Thanks. Igor _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Igor Mendelev
-
Ying Zhang