- developers-list - monetdb.org

Re: [Monetdb-developers] [Fwd: Question: MonetDB static compile]
by Stefan Manegold 29 Sep '08

29 Sep '08

Lefteris, Hans, ======== $ monetdb-install.sh --help -------- usage: /export/scratch0/manegold/Monet/Testing/Current/source/monetweb/Assets/monetdb-install.sh < OPTS ... > where OPTS are: --prefix=path install into location path, defaults to /ufs/manegold/MonetDB --build=path use path as (temporary) build directory, defaults to /var/tmp/MonetDB-XXXXXXXXX --enable-sql build the MonetDB/SQL server --enable-xquery build the MonetDB/XQuery server --enable-geom build geom extension for MonetDB/SQL, this option implies --enable-sql --enable-template build template module for MonetDB extensions, this option requires nightly or cvs sources. --nightly=target download and install a nightly snapshot of the stable or current branch, target must be 'stable' or 'current' --cvs checkout a CVS snapshot of the current branch --enable-debug compile with debugging support via e.g. gdb --enable-optimise compile with high optimisation flags, enabling this option increases compilation time considerably but often yields in a faster MonetDB server --enable-optimize alias for --enable-optimise --quiet suppress output going to stdout --help this message --devhelp special help for developers ^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^ --version show revision number and quit ======== $ monetdb-install.sh --devhelp -------- There are a few hooks in this script that may be interesting to developers or experienced users. If you know what you're doing, by setting EXTRA_ECONF in the environment ^^^^^^^^^^^ you can pass extra arguments to configure invocations. Use with care. The variable MAKEOPTS is passed onto each make invocation, and can be used to e.g. set "-j2" to speed up compilation times. By setting MAKE, a make with a special name or location can be used. Two targets exist which control what the script is doing: unpack and install. They can be given as argument to the script. unpack only runs the fetch and unpacking phase, while install skips the fetching/unpacking of the sources, and starts configure/make/make install. By using --build=/path/to with the install target it is possible to resume/retry a (failed) compilation. ======== $ configure --help -------- [...] --enable-static[=PKGS] build static libraries [default=no] --enable-shared[=PKGS] build shared libraries [default=yes] [...] (Note that the "[=PKGS]" is some bug in the docu and should be ignored.) ======== Hence, export EXTRA_ECONF='--disable-shared --enable-static' monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB will (should) give you a statically linked MonetDB/XQUery Mserver in that sense, that all required MonetDB modules are statically linked into the Mserver (as opposed to loading them as shared libraries at runtime). What this does not do, though, is statically linking system libraries and other external libraries (like libxml2 or libpcre) into the Mserver --- we do not have any support for that. Stefan ps: I felt free to Cc: our (prefered) public communication channel to also let others benefit from your question and my answer to it. On Mon, Sep 29, 2008 at 04:46:56PM +0200, Lefteris Sidirourgos wrote: > Is there a compile time option for what NFI asks? > > ---------------------------- Original Message ---------------------------- > Subject: Question: MonetDB static compile > From: "Hans van Rijswijk (DT)" <hans(a)holmes.nl> > Date: Mon, September 29, 2008 4:02 pm > To: "Lefteris Sidirourgos" <E.Sidirourgos(a)cwi.nl> > -------------------------------------------------------------------------- > > > Hi Lefteris, > > I would like to create a static compilation/link of MonetDB (XQuery). The > purpose is to make the installation easier (No compilation while > installing, No shared library dependencies). > Given the MonetDB-Aug2008-SuperBall, what am I supposed to do, to create a > version for an Ubuntu Linux x86-64 platform. > I know the command: > monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB > does the compilation for dynamic libraries. > > Hope to hear from you. Thanks in advance. > > Regards, > Hans van Rijswijk > NFI. > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] latest pathfinder CVS sources require latest buildtools
by Stefan Manegold 25 Sep '08

25 Sep '08

Dear all, since SF currently experiences (severe) problems with checkin mails, I distribute the following info via this channel: =================================================================== 2008/09/25 - stmane: buildtools/conf/rules.mk,1.7 to avoid the necessity of using a single fixed name for [f]lex output files (`flex -olex.yy.c`) --- and hence the name clash in case of parallel makes, we now also handle the default output "lex.X.c" of `flex X.l` correctly. =================================================================== 2008/09/25 - stmane: pathfinder/compiler/parser/Makefile.ag,1.18 pathfinder/modules/pftijah/Makefile.ag,1.27 Avoid using option "-olex.yy.c" with [f]lex, which created a name clash in case of parallel makes. Note: Updating you pathfinder CVS sources to this version also requires an update of the buildtools to the latest CVS version! =================================================================== Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] Just a test; please ignore
by Lefteris 23 Sep '08

23 Sep '08

It didnt work in my last night checkins for pathfinder either. On Tue, Sep 23, 2008 at 2:52 PM, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: > > does mailing to monetdb-checkins(a)lists.sourceforge.net work? > > Stefan > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

[Monetdb-developers] MonetDB/XQuery & MonetDB/SQL : how can i find the two jar-archives MonetDB JDBC driver (i couldn't find them after intallation)
by Clarisse Kagoyire 22 Sep '08

22 Sep '08

Hello, I installed MonetDB/SQL and I would like to use the JDBC Driver but i could not find none of the two jar-archives (monetdb-X.Y-jdbc.jar and jdbcclient.jar) in the directory share/MonetDB/lib. Please can you tell me where i can get them? (actually I was only using MonetDB/Xquery, but as i wanted to run some porgramme written in java, i also installed monetdb/SQL to get the MonetDB JDBC Driver. ) Thank you. Clarisse

3 2

[Monetdb-developers] profile in SQL...
by Romulo Goncalves 17 Sep '08

17 Sep '08

There is this information online: http://monetdb.cwi.nl/SQL/Documentation/PROFILE-Statement.html and when I do: sql>set profile = true; !Variable profile unknown 0 tuples sql>select * from profile; !SELECT: no such table 'profile' 0 tuples sql> Hummmm... Is the information wrong or SQL is broken? Romulo

2 1

[Monetdb-developers] Re : [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6
by sylver_b 16 Sep '08

16 Sep '08

Hi Is it Ok to use the perl module ? Is it available on the SVN ? Let me know Thanks ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Vendredi, 12 Septembre 2008, 18h41mn 14s Objet : Re: [Monetdb-developers] [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6 On 12-09-2008 13:18:32 +0200, Sjoerd Mullender wrote: > sed -i '/Xexport/s/putblock/$self->putblock/' src/perl/Mapi.pm (pegasus:clients/src/perl) fabian% sed -i '/Xexport/s/putblock/$self->putblock/' Mapi.pm (pegasus:clients/src/perl) fabian% ./mclient.pl !please specify a database (pegasus:clients/src/perl) fabian% ./mclient.pl sdss > select * from tables; [ 978, "schemas", 977, NULL, 0, true, 0, 0 ] ... [ 7525, "spt_datatype_info", 977, NULL, 0, false, 0, 0 ] > > > > \q No more error/warning. I'll commit it. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng > to allow the load of billions of records in a single copy command. [...] > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; ^^^ ^ > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; ^^^ ^ shouldn't these be "l_val", now? ^ > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); ^^^ > + assert(!nr_offset || nr_offset->h->next->type == type_lng); ^^^ > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng ^^^ shouldn't that be aligned with the BATcount, i.e., type BUN (if possible) or at least type wrd? Stefan > to allow the load of billions of records in a single copy command. > > > > U sql_parser.mx > Index: sql_parser.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_parser.mx,v > retrieving revision 1.291 > retrieving revision 1.292 > diff -u -d -r1.291 -r1.292 > --- sql_parser.mx 9 Sep 2008 13:28:49 -0000 1.291 > +++ sql_parser.mx 16 Sep 2008 14:55:41 -0000 1.292 > @@ -583,6 +583,8 @@ > > %type <l_val> > opt_start > + lngval > + poslng > opt_increment > opt_min > opt_max > @@ -2462,8 +2464,8 @@ > > opt_nr: > /* empty */ { $$ = NULL; } > - | posint RECORDS { $$ = append_int(append_int(L(), $1), 0); } > - | posint OFFSET posint RECORDS { $$ = append_int(append_int(L(), $1), $3); } > + | poslng RECORDS { $$ = append_lng(append_lng(L(), $1), 0); } > + | poslng OFFSET poslng RECORDS { $$ = append_lng(append_lng(L(), $1), $3); } > ; > > opt_null_string: > @@ -4118,6 +4120,17 @@ > } > ; > > + > +poslng: > + lngval { $$ = $1; > + if ($$ < 0) { > + $$ = -1; > + yyerror("Positive value expected"); > + YYABORT; > + } > + } > + ; > + > posint: > intval { $$ = $1; > if ($$ < 0) { > @@ -4394,6 +4407,10 @@ > { $$ = append_string($1, $3); } > ; > > +lngval: > + sqlINT { $$ = strtoll($1,NULL,10); } > +; > + > intval: > sqlINT { $$ = strtol($1,NULL,10); } > | IDENT { mvc *m = (mvc*)parm; > > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); > + assert(!nr_offset || nr_offset->h->next->type == type_lng); > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime ll_upwards.mx, , 1.29, 1.30 vx_index.mx, , 1.1, 1.2
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 09:19:52AM +0000, Lefteris Sidirourgos wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv29372 > > Modified Files: > ll_upwards.mx vx_index.mx > Log Message: > Trying to fix some compilation errors arised in SunOS and Federa 9 (?). In my > Fedora 9 everything compiled correct. as opposed to (e.g.) gcc 4.1.2 on Fedora 8, gcc 4.3.0 on Fedora 9 (recall, out desktops still run Fedora 8 with gcc 4.1.2), gcc 4.3.1 on Gentoo 1.12.11.1, and Sun Studio 12 compiler on (Open)Solaris 11 seem to adhere to and implement the C99 standard of INLINE declarations. Please see (e.g.) http://www.greenend.org.uk/rjk/2003/03/inline.html and compare "GNU C inline rules" to "C99 inline rules". The latter says (a.o.) " A function where all the declarations (including the definition) mention "inline" and never "extern". There must be a definition in the same translation unit. No stand-alone object code is emitted. You can (must?) have a separate (not inline) definition in another translation unit, and the compiler might choose either that or the inline definition. " Maybe this helps ... Stefan > > > U vx_index.mx > Index: vx_index.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/vx_index.mx,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- vx_index.mx 15 Sep 2008 10:30:29 -0000 1.1 > +++ vx_index.mx 16 Sep 2008 09:19:50 -0000 1.2 > @@ -32,6 +32,8 @@ > @c > #include "pf_config.h" > #include <gdk.h> > +#include "shredder.h" /* for XML_DEPTH_MAX */ > +#include "ll_upwards.h" /* skipholes, speculate_skip, PF_SIBLING_PROBES */ > > #define XQH_UNSGN(v) ((unsigned int) v) > #define XQH_MASK5(c) ((c) & 31) > @@ -190,11 +192,7 @@ > > > @c > -#include "shredder.h" /* for XML_DEPTH_MAX */ > -#include "ll_upwards.h" /* skipholes, speculate_skip, PF_SIBLING_PROBES */ > - > -static > -int > +static int > vx_index_create( /* OUTPUT: */ > unsigned int* pre_hsh, /* - pre_hsh column */ > /* DOCUMENT: */ > > U ll_upwards.mx > Index: ll_upwards.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/ll_upwards.mx,v > retrieving revision 1.29 > retrieving revision 1.30 > diff -u -d -r1.29 -r1.30 > --- ll_upwards.mx 15 Sep 2008 10:26:44 -0000 1.29 > +++ ll_upwards.mx 16 Sep 2008 09:19:50 -0000 1.30 > @@ -90,11 +90,13 @@ > pathfinder runtime. > > @h > +#ifndef LL_UPWARDS_H > +#define LL_UPWARDS_H > #define PF_SIBLING_PROBES 64 > > INLINE oid skipholes(oid, unsigned int *); > oid speculate_skip(oid, oid, oid, int, unsigned int*, unsigned char*); > - > +#endif /* LL_UPWARDS_H */ > > @c > #include "pf_config.h" > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, XQuery_0-24, 1.416.2.12, 1.416.2.13
by Ying Zhang 16 Sep '08

16 Sep '08

On Sep 15, 2008, at 13:33 , Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv13268 > > Modified Files: > Tag: XQuery_0-24 > pathfinder.mx > Log Message: > backported (JanR's) bugfix from HEAD: Jan, as I could understand that this bug is not an important item in your agenda, I felt free to backport your fix, so that this bug could be closed. I hope this is OK. Regards, Jennie > > > <original log message> > -- Try to fix bug 2015219 by changing the mark offset. > > identical checkin, expecting no conflicts during propagation > > > > U pathfinder.mx > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.416.2.12 > retrieving revision 1.416.2.13 > diff -u -d -r1.416.2.12 -r1.416.2.13 > --- pathfinder.mx 28 Jun 2008 10:19:09 -0000 1.416.2.12 > +++ pathfinder.mx 15 Sep 2008 11:33:45 -0000 1.416.2.13 > @@ -3226,7 +3226,7 @@ > var attrid := new(void,oid, > 2 > *count > (attr1 > )).seqbase > (0(a)0).append(attr1.project(oid_nil)).append(attr1.project(oid_nil)) > attrid.replace(reverse([oid]([lng] > (reverse(attr_constr(attr1.project(at1qn),attr1,ws).fetch(1))).[*] > (2LL)))); > attrid.replace(reverse([oid]([lng] > (reverse(attr_constr(attr1.project(at2qn),attr2,ws).fetch(1))).[*] > (2LL).[+](1LL)))); > - return elem_constr(attr1.mark(1(a)0),attr1.project(eltqn), > attrid.mirror().[lng]().[/](2LL).[oid](), > + return elem_constr(attr1.mark(0(a)0),attr1.project(eltqn), > attrid.mirror().[lng]().[/](2LL).[oid](), > > attrid.project(oid_nil), attrid.project(oid_nil), > attrid, > attrid.project(WS), ws).fetch(1); > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's > challenge > Build the coolest Linux based applications with Moblin SDK & win > great prizes > Grand prize is a trip for two to an Open Source event anywhere in > the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

2 1