Hi Jen,
I really like "ff", haven't used "bit" yet. I use ff, together with biglm
for large scale regression. I need a database to stored all my data, in the
billions of rows, so that I can keep analysis within R and data retrieval in
database.
You think "ff" is just as fast as MonetDB when it comes to dealing with
billions of rows, and from different "ff" files (the equivalent of tables)
Thanks.
2009/3/20 Jens Oehlschlägel
There is one other open source column based DB that might be worth looking at: Infobright Community Edition (http://www.infobright.org/) But if you want the moon on a stick, have a look at Esper, a realtime streaming database that supports the kinds of queries you mentioned in the UDF examples
If you want to look at this from a statistical point of view: the statistical interpreter R (www.r-project.org) has now on its package repository (cran.r-project.org) package 'ff', which allows fast memory-mapped access to binary vector and matrix files. Amongst the many time-series packages R has, one ('kza') started exploiting package 'ff' for large time-series. And when it comes to quickly combining filtering conditions on large vectors, package 'bit' might interest you.
Jens Oehlschlägel ( author of 'ff' and 'bit' :-)
------------------------------------------------------------------------------ Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are powering Web 2.0 with engaging, cross-platform capabilities. Quickly and easily build your RIAs with Flex Builder, the Eclipse(TM)based development software that enables intelligent coding and step-through debugging. Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users