Distributing databases/tables
Greetings! We have been testing MonetDB for use in AWS in the last couple of weeks and we are surprised with its overall performance, even when dealing with large tables and under-powered machines. Still, we were wondering if its possible in anyway to improve the performance by distributing the databases/tables through several machines. While looking at MonetDB documentation and the mailing list archives, I get some mixed answers about this topic and nothing very concrete. We noticed that it's possible to create a cluster of MonetDB instances, but it seems that it's main purpose is to ease the administration of several MonetDB instances and provide a single entrance point to several MonetDB instances. Still, we still have some questions about its use: Is it possible to partition a table across several MonetDB instances in order to improve the performance? Best regards, Pedro Salgueiro _______________________________________________ users-list mailing list users-list@monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list
Hi Pedro, On 21-11-2012 18:06:34 +0000, Pedro Salgueiro wrote:
We noticed that it's possible to create a cluster of MonetDB instances, but it seems that it's main purpose is to ease the administration of several MonetDB instances and provide a single entrance point to several MonetDB instances. Still, we still have some questions about its use:
Is it possible to partition a table across several MonetDB instances in order to improve the performance?
Currently MonetDB will not do anything for you to partition a table, and/or maintain the partitioning. However, if you partition the table yourself, and use a multiplex-funnel to query all shards of your table at once and return the union of the individual results. See the MULTIPLEX-FUNNELS section in the monetdbd(1) man-page[1]. Fabian [1] http://www.monetdb.org/Documentation/monetdbd-man-page _______________________________________________ users-list mailing list users-list@monetdb.org http://mail.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Fabian Groffen
-
Pedro Salgueiro