Re: [MonetDB-users] loading RDF data in MonetDB

Since you are loading triples in ID integer form, a billion triples should be no problem in a 16gig memory machine. Could you please give more information on what commands/queries you use to load the data, and the exact full error message. Which OS are you running in the machine and which version of monet you installed? (stable or current?) regards, lefteris On Fri, Oct 16, 2009 at 7:20 PM, Medha Atre wrote:

Hi,

Thanks all for the valuable inputs. I could compile and successfully run MonetDB on one m/c, but I am facing issues in loading data into it on another m/c. The other m/c is actually much higher end m/c with 16G memory (server architecture) as opposed the first one in which I loaded the same data. Every time I try to load the data (RDF data in integer ID form), it keeps giving "connection timeout" error. Note: the data is really large (>1 billion triples). I am running "mclient" on the same m/c where monetdb server is running.

I tried it couple of times until now, but the issue persists.

Can someone throw some light on what might be going wrong?

Medha

On Thu, Oct 8, 2009 at 3:23 AM, Stefan Manegold wrote:

...

On Thu, Oct 08, 2009 at 08:56:35AM +0200, Sjoerd Mullender wrote:

...

On 2009-10-08 08:05, Niels Nes wrote:

...

On Wed, Oct 07, 2009 at 10:48:33PM -0400, Medha Atre wrote:

...

Thanks Fabian. This worked.

I just have small another question -- is there a way to store the output of a "select" query run on "mclient" into a file? I would like to compare the results with the ones generated by some other tool.

see http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/Data-Manipulation.h... section about copy into file

If you're working interactively with mclient, you can also use \> file select ... \> The first line redirects subsequent output to the file, the last line directs it back to the terminal.

Check out the \? command.

You can also simply use your shell's features:

       mclient -lsql -s'select ...' > output-file        echo 'select ...' | mclient -lsql > output-file        mclient -lsql < query-file > output-file        mclient -lsql query-file > output-file

Stefan

...

...

Niels

...

Thanks. Medha

On Wed, Oct 7, 2009 at 2:26 PM, Fabian Groffen  wrote:

...

On 07-10-2009 14:17:47 -0400, Medha Atre wrote: [snip installation of all packages in a separate prefix] > And then I ran the other commands I already mentioned below (e.g. > merovingian etc). > There were no error messages in the "make install" of any of the 4 > packages I have listed above. > > Could you please help me understand what might be going wrong?

any reason you choose not to use   monetdb-install.sh --enable-sql --prefix=/path/to/MonetDB ?  If you don't have it, download the latest version of this script from http://monetdb.cwi.nl/projects/monetdb/Assets/monetdb-install.sh

Alternatively, just download a Super Source Tarball, which has this script included.

That basically solves all your problems.  If you want to have all components installed in their own prefix, you'll have to do some post-fixing to get the modules installed where mserver expects them to be.

------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

-- Sjoerd Mullender

------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

-- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI,  P.O.Box 94079 | http://www.cwi.nl/~manegold/  | | 1090 GB Amsterdam   | Tel.: +31 (20) 592-4212       | | The Netherlands     | Fax : +31 (20) 592-4312       |

------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users