[MonetDB-users] Table with 1 000 000 000 rows
Hi, is it possible to store 1 000 000 000 rows in one table or I need to use some partitioning algorithm? -- Thanks, Eugene Prokopiev
Hi Eugene, yes, in general, it is possible to store 1 000 000 000 rows in one table in MonetDB, provided your data and your system (hardware and operating system) meet the requirements as explained here: http://www.monetdb.org/Documentation/UserGuide/resources You do need 64-bit hardware, OS and MonetDB for such data volume. We have MonetDB running a ~2.5 TB database which contains (among others) one table with 20 000 000 000 rows. Stefan On Thu, Jul 14, 2011 at 10:01:45AM +0400, Eugene Prokopiev wrote:
Hi,
is it possible to store 1 000 000 000 rows in one table or I need to use some partitioning algorithm?
-- Thanks, Eugene Prokopiev
------------------------------------------------------------------------------ AppSumo Presents a FREE Video for the SourceForge Community by Eric Ries, the creator of the Lean Startup Methodology on "Lean Startup Secrets Revealed." This video shows you how to validate your ideas, optimize your ideas and identify your business strategy. http://p.sf.net/sfu/appsumosfdev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |
...
The largest table we have used in house was 6-column table of 20 000 000 000 rows on a 64GB dual quad core machine. ... We have MonetDB running a ~2.5 TB database which contains (among others) one table with 20 000 000 000 rows.
Thanks, it's suitable for me. Are your databases for append data only or you use some algorithm to remove old historical data?
On Sun, Jul 17, 2011 at 12:41:44PM +0400, Eugene Prokopiev wrote:
...
The largest table we have used in house was 6-column table of 20 000 000 000 rows on a 64GB dual quad core machine. ... We have MonetDB running a ~2.5 TB database which contains (among others) one table with 20 000 000 000 rows.
Thanks, it's suitable for me. Are your databases for append data only or you use some algorithm to remove old historical data?
In the above mentioned (and most other) cases, our scenarios are mostly append only. Stefan -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |
participants (3)
-
Eugene Prokopiev -
Martin Kersten -
Stefan Manegold