On Tue, Jun 09, 2009 at 02:01:51PM +0200, John van Schie (DT) wrote:
Hi,
Today I tried to shred a XML document of 1.6 giga bytes using mclient and it took more than 3 hours (~150 kb/s) on a quite fast machine. I was a bit suprised. because for smaller documents shredding is quite fast. Are these numbers expected?
Hello John, Have you maybe had a look at the system load during this time? Are there any other processes that were heavily using resources like disk, CPU? Kind regards, Jennie
I know that it can be hard to say something about this case without the document itself. So I'm currently working to anonymize the document, but what is the prefered way to get the document to the CWI?
System information: - Fedora Core 10, x86_64, 32 GB RAM (24G cached/free), 5.5 GB disk free (after import) - MonetDB4 / XQuery v4.28.4, 64bit OIDs (RPM version)
Commands: $ time mclient -p 50000 -l xq -s"pf:add-doc('/tmp/structure.xml', 'structure3.xml')"
real 198m49.543s user 0m0.002s sys 0m0.003s [user@host tmp]$ ls -lah /tmp/structure.xml -rw-r--r-- 1 user user 1.6G 2009-06-08 16:26 /tmp/structure.xml
Regards,
John van Schie
------------------------------------------------------------------------------ Crystal Reports - New Free Runtime and 30 Day Trial Check out the new simplified licensing option that enables unlimited royalty-free distribution of the report engine for externally facing server and web deployment. http://p.sf.net/sfu/businessobjects _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users