OG wrote:
Hi Fabian,
Is partitioning support on the roadmap for 2010 by any chance? I do see http://monetdb.cwi.nl/MonetDB/Documentation/SQL-Roadmap.html , but I'm not sure how up to date it is? (and it doesn't mention horizontal scaling)
Please ignore that roadmap. We are working on several distribution techniques, but none of them are ready for use, nor doing the classical fragmentation thing.
Are they described anywhere public, even very briefly? Some of techniques researched are described in the public available source, e.g. the Octopus optimizer. But, as said before, we seek complete new ways to deal with scalability beyond the TB barrier.
If we know more specifically what your needs are we might be able to advise/help you in some way or another.
I'm investigating and evaluating several DBs that seem to be in a similar space - LucidDB, MonetDB, InfiniDB... without knowing my *exact* needs, but I know I'll need to store and query large volumes of data. If I were to use a regular ROLAP, I'd use a star schema (with 100M+ fact rows) where time is a factor/dimension in pretty much all queries, and maybe I'd make use of Mondrian. Ideally, I'd be able to run most ad-hoc queries in sub-3 second time.
All three systems have overlapping areas where they perform good/worst. Moreover, they have different approaches to capitalize the hardware infrastructure (throwing hardware in an MPP setting gives you performance). Moreover, a real-life testcase could help to discriminate the systems. (See www.cwi.nl/~mk/ontimeReport for more info)
The "fear" is, what happens when I hit the limit of the server running (Monet)DB? MonetDB currently behaves not optimal when the individual columns (and their support structures) do not fit in memory. Then IO thrashing may occur. This issue is addressed in ongoing work with high priority.
Martin
Thanks, Otis
------------------------------------------------------------------------------ This SF.Net email is sponsored by the Verizon Developer Community Take advantage of Verizon's best-in-class app development support A streamlined, 14 day to market process makes app distribution fast and easy Join now and get one step closer to millions of Verizon customers http://p.sf.net/sfu/verizon-dev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users