[MonetDB-users] Information about Loader
Hi, I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it? Thanks -- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084241.html Sent from the monetdb-users mailing list archive at Nabble.com.
Hi, I'm not if I understand your "MonetDB Loader" correctly. I guess you want to load data into monet. To populate your database with a small amount of data, you can just use the INSERT statement. For fast loading of a large amount of data, monet provides commands for bulk I/O. Please have a look at this page: http://www.monetdb.org/Documentation/Manuals/SQLreference/CopyInto Regards, Jennie On Mon, Jul 18, 2011 at 08:47:52AM -0700, Lowterm wrote:
Hi,
I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it?
Thanks -- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084241.html Sent from the monetdb-users mailing list archive at Nabble.com.
------------------------------------------------------------------------------ AppSumo Presents a FREE Video for the SourceForge Community by Eric Ries, the creator of the Lean Startup Methodology on "Lean Startup Secrets Revealed." This video shows you how to validate your ideas, optimize your ideas and identify your business strategy. http://p.sf.net/sfu/appsumosfdev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Hi, thanks for your reply. I need some general information about how it works. Thanks -- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32084868.html Sent from the monetdb-users mailing list archive at Nabble.com.
On 7/18/11 7:13 PM, Lowterm wrote:
Hi,
thanks for your reply. I need some general information about how it works.
See for the use cases. http://www.monetdb.org/Documentation/Manuals/SQLreference/CopyInto http://www.monetdb.org/Documentation/Cookbooks/SQLrecipies/Attach Implementation wise it exploits multi-core loading. The source code gives all the glory details ;) regards, Martin
Thanks
Hi, thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into. Thanks Lowterm wrote:
Hi,
I need some information about MonetDB Loader. Where can I find it? Is there any documentation about it?
Thanks
-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32089117.html Sent from the monetdb-users mailing list archive at Nabble.com.
In general, bulk loading is considerably (much) faster than insert statements. The details depend on many parameters, among others the hardware (CPU type, number of CPU cores, amount of memory, bandwidth and latency of I/O subsystem, etc.), the operating system, and the data characteristics (data types, number of columns, number of records, data volume, etc.). Experimental assessment is required to reveal specific dateils. Stefan On Tue, Jul 19, 2011 at 01:15:41AM -0700, Lowterm wrote:
Hi,
thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into.
Thanks
-- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |
Hi Stefan, thanks. That is clear. However, this applies for all other loader from other databases. But what MongoDB loader different from the others. Why should I just opt for this loader. What distinguishes the MonetDB-loader? Thanks Stefan Manegold wrote:
In general, bulk loading is considerably (much) faster than insert statements.
The details depend on many parameters, among others the hardware (CPU type, number of CPU cores, amount of memory, bandwidth and latency of I/O subsystem, etc.), the operating system, and the data characteristics (data types, number of columns, number of records, data volume, etc.).
Experimental assessment is required to reveal specific dateils.
Stefan
On Tue, Jul 19, 2011 at 01:15:41AM -0700, Lowterm wrote:
Hi,
thanks. But I need another information for example: How fast is the MonetDB-Bulk-Loader and How fast is the MonetDB-Bulk-Loader in comparison to an insert statement. Is there another or faster commands/way except copy into.
Thanks
-- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |
------------------------------------------------------------------------------ Magic Quadrant for Content-Aware Data Loss Prevention Research study explores the data loss prevention market. Includes in-depth analysis on the changes within the DLP market, and the criteria used to evaluate the strengths and weaknesses of these DLP solutions. http://www.accelacomm.com/jaw/sfnl/114/51385063/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- View this message in context: http://old.nabble.com/Information-about-Loader-tp32084241p32089531.html Sent from the monetdb-users mailing list archive at Nabble.com.
participants (4)
-
Lowterm -
Martin Kersten -
Stefan Manegold -
Ying Zhang