- developers-list - monetdb.org

[Monetdb-developers] Data integrity bug
by Carl Nobile 07 Oct '08

07 Oct '08

I think I have found a data integrity bug. After working with the DB for a while I notice that the equals (=) operator no longer works, however, the LIKE operator will still retrieve data. The only way I have found to solve this issue is to rebuild the DB and import all the data. This is obviously not a very good solution. There is an application sitting on top of the DB that has been the cause of this, but as you can see below mclient also gives the wrong results. Bouncing the server does not fix it. You should know the only odd thing the application does is dynamically add and drop columns to one of the tables--the reason we are using MonetDB. This allows us to have an essential flat 2nd normal form table with 4th normal form capabilities. sql>SELECT "USERNAME","LAST_UPDT_CID","CREATE_DT" from "BUSINESS_USER_PROFILE" WHERE "USERNAME"='Carl'; sql>SELECT "USERNAME","LAST_UPDT_CID","CREATE_DT" from "BUSINESS_USER_PROFILE" WHERE "USERNAME" like 'Carl'; +-----------------+-------------------------+---------------------------------------+ | USERNAME |LAST_UPDT_CID |CREATE_DT | +==========+==============+======================+ | Carl |GVE |2008-10-04 20:47:54.275000 | +----------------- +------------------------+---------------------------------------+ We are still in development of this project, but need to release our code in a month or so. Any ideas what is going on here? ------------------------------------------------------------------------------- Carl J. Nobile (Software Engineer) carl.nobile(a)gmail.com -------------------------------------------------------------------------------

4 10

[Monetdb-developers] [Fwd: SourceForge.net CVS Migration and Downtime Announcement]
by Sjoerd Mullender 29 Sep '08

29 Sep '08

Be aware that the CVS repository will be off line tomorrow (Tuesday) evening. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Fwd: Question: MonetDB static compile]
by Stefan Manegold 29 Sep '08

29 Sep '08

Lefteris, Hans, ======== $ monetdb-install.sh --help -------- usage: /export/scratch0/manegold/Monet/Testing/Current/source/monetweb/Assets/monetdb-install.sh < OPTS ... > where OPTS are: --prefix=path install into location path, defaults to /ufs/manegold/MonetDB --build=path use path as (temporary) build directory, defaults to /var/tmp/MonetDB-XXXXXXXXX --enable-sql build the MonetDB/SQL server --enable-xquery build the MonetDB/XQuery server --enable-geom build geom extension for MonetDB/SQL, this option implies --enable-sql --enable-template build template module for MonetDB extensions, this option requires nightly or cvs sources. --nightly=target download and install a nightly snapshot of the stable or current branch, target must be 'stable' or 'current' --cvs checkout a CVS snapshot of the current branch --enable-debug compile with debugging support via e.g. gdb --enable-optimise compile with high optimisation flags, enabling this option increases compilation time considerably but often yields in a faster MonetDB server --enable-optimize alias for --enable-optimise --quiet suppress output going to stdout --help this message --devhelp special help for developers ^^^^^^^^^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^ --version show revision number and quit ======== $ monetdb-install.sh --devhelp -------- There are a few hooks in this script that may be interesting to developers or experienced users. If you know what you're doing, by setting EXTRA_ECONF in the environment ^^^^^^^^^^^ you can pass extra arguments to configure invocations. Use with care. The variable MAKEOPTS is passed onto each make invocation, and can be used to e.g. set "-j2" to speed up compilation times. By setting MAKE, a make with a special name or location can be used. Two targets exist which control what the script is doing: unpack and install. They can be given as argument to the script. unpack only runs the fetch and unpacking phase, while install skips the fetching/unpacking of the sources, and starts configure/make/make install. By using --build=/path/to with the install target it is possible to resume/retry a (failed) compilation. ======== $ configure --help -------- [...] --enable-static[=PKGS] build static libraries [default=no] --enable-shared[=PKGS] build shared libraries [default=yes] [...] (Note that the "[=PKGS]" is some bug in the docu and should be ignored.) ======== Hence, export EXTRA_ECONF='--disable-shared --enable-static' monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB will (should) give you a statically linked MonetDB/XQUery Mserver in that sense, that all required MonetDB modules are statically linked into the Mserver (as opposed to loading them as shared libraries at runtime). What this does not do, though, is statically linking system libraries and other external libraries (like libxml2 or libpcre) into the Mserver --- we do not have any support for that. Stefan ps: I felt free to Cc: our (prefered) public communication channel to also let others benefit from your question and my answer to it. On Mon, Sep 29, 2008 at 04:46:56PM +0200, Lefteris Sidirourgos wrote: > Is there a compile time option for what NFI asks? > > ---------------------------- Original Message ---------------------------- > Subject: Question: MonetDB static compile > From: "Hans van Rijswijk (DT)" <hans(a)holmes.nl> > Date: Mon, September 29, 2008 4:02 pm > To: "Lefteris Sidirourgos" <E.Sidirourgos(a)cwi.nl> > -------------------------------------------------------------------------- > > > Hi Lefteris, > > I would like to create a static compilation/link of MonetDB (XQuery). The > purpose is to make the installation easier (No compilation while > installing, No shared library dependencies). > Given the MonetDB-Aug2008-SuperBall, what am I supposed to do, to create a > version for an Ubuntu Linux x86-64 platform. > I know the command: > monetdb-install.sh --enable-xquery --prefix=/opt/MonetDB > does the compilation for dynamic libraries. > > Hope to hear from you. Thanks in advance. > > Regards, > Hans van Rijswijk > NFI. > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] latest pathfinder CVS sources require latest buildtools
by Stefan Manegold 25 Sep '08

25 Sep '08

Dear all, since SF currently experiences (severe) problems with checkin mails, I distribute the following info via this channel: =================================================================== 2008/09/25 - stmane: buildtools/conf/rules.mk,1.7 to avoid the necessity of using a single fixed name for [f]lex output files (`flex -olex.yy.c`) --- and hence the name clash in case of parallel makes, we now also handle the default output "lex.X.c" of `flex X.l` correctly. =================================================================== 2008/09/25 - stmane: pathfinder/compiler/parser/Makefile.ag,1.18 pathfinder/modules/pftijah/Makefile.ag,1.27 Avoid using option "-olex.yy.c" with [f]lex, which created a name clash in case of parallel makes. Note: Updating you pathfinder CVS sources to this version also requires an update of the buildtools to the latest CVS version! =================================================================== Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] Just a test; please ignore
by Lefteris 23 Sep '08

23 Sep '08

It didnt work in my last night checkins for pathfinder either. On Tue, Sep 23, 2008 at 2:52 PM, Stefan Manegold <Stefan.Manegold(a)cwi.nl> wrote: > > does mailing to monetdb-checkins(a)lists.sourceforge.net work? > > Stefan > > -- > | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | > | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | > | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | > | The Netherlands | Fax : +31 (20) 592-4312 | > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins >

1 0

[Monetdb-developers] MonetDB/XQuery & MonetDB/SQL : how can i find the two jar-archives MonetDB JDBC driver (i couldn't find them after intallation)
by Clarisse Kagoyire 22 Sep '08

22 Sep '08

Hello, I installed MonetDB/SQL and I would like to use the JDBC Driver but i could not find none of the two jar-archives (monetdb-X.Y-jdbc.jar and jdbcclient.jar) in the directory share/MonetDB/lib. Please can you tell me where i can get them? (actually I was only using MonetDB/Xquery, but as i wanted to run some porgramme written in java, i also installed monetdb/SQL to get the MonetDB JDBC Driver. ) Thank you. Clarisse

3 2

[Monetdb-developers] profile in SQL...
by Romulo Goncalves 17 Sep '08

17 Sep '08

There is this information online: http://monetdb.cwi.nl/SQL/Documentation/PROFILE-Statement.html and when I do: sql>set profile = true; !Variable profile unknown 0 tuples sql>select * from profile; !SELECT: no such table 'profile' 0 tuples sql> Hummmm... Is the information wrong or SQL is broken? Romulo

2 1

[Monetdb-developers] Re : [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6
by sylver_b 16 Sep '08

16 Sep '08

Hi Is it Ok to use the perl module ? Is it available on the SVN ? Let me know Thanks ----- Message d'origine ---- De : Fabian Groffen <Fabian.Groffen(a)cwi.nl> À : monetdb-developers(a)lists.sourceforge.net Envoyé le : Vendredi, 12 Septembre 2008, 18h41mn 14s Objet : Re: [Monetdb-developers] [Monetdb-checkins] clients/src/perl Mapi.pm, , 1.5, 1.6 On 12-09-2008 13:18:32 +0200, Sjoerd Mullender wrote: > sed -i '/Xexport/s/putblock/$self->putblock/' src/perl/Mapi.pm (pegasus:clients/src/perl) fabian% sed -i '/Xexport/s/putblock/$self->putblock/' Mapi.pm (pegasus:clients/src/perl) fabian% ./mclient.pl !please specify a database (pegasus:clients/src/perl) fabian% ./mclient.pl sdss > select * from tables; [ 978, "schemas", 977, NULL, 0, true, 0, 0 ] ... [ 7525, "spt_datatype_info", 977, NULL, 0, false, 0, 0 ] > > > > \q No more error/warning. I'll commit it. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ Monetdb-developers mailing list Monetdb-developers(a)lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-developers

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng > to allow the load of billions of records in a single copy command. [...] > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; ^^^ ^ > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; ^^^ ^ shouldn't these be "l_val", now? ^ > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); ^^^ > + assert(!nr_offset || nr_offset->h->next->type == type_lng); ^^^ > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_parser.mx, , 1.291, 1.292 sql_updates.mx, , 1.145, 1.146
by Stefan Manegold 16 Sep '08

16 Sep '08

On Tue, Sep 16, 2008 at 02:55:45PM +0000, Romulo Goncalves wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv12591 > > Modified Files: > sql_parser.mx sql_updates.mx > Log Message: > The number of records should be type lng ^^^ shouldn't that be aligned with the BATcount, i.e., type BUN (if possible) or at least type wrd? Stefan > to allow the load of billions of records in a single copy command. > > > > U sql_parser.mx > Index: sql_parser.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_parser.mx,v > retrieving revision 1.291 > retrieving revision 1.292 > diff -u -d -r1.291 -r1.292 > --- sql_parser.mx 9 Sep 2008 13:28:49 -0000 1.291 > +++ sql_parser.mx 16 Sep 2008 14:55:41 -0000 1.292 > @@ -583,6 +583,8 @@ > > %type <l_val> > opt_start > + lngval > + poslng > opt_increment > opt_min > opt_max > @@ -2462,8 +2464,8 @@ > > opt_nr: > /* empty */ { $$ = NULL; } > - | posint RECORDS { $$ = append_int(append_int(L(), $1), 0); } > - | posint OFFSET posint RECORDS { $$ = append_int(append_int(L(), $1), $3); } > + | poslng RECORDS { $$ = append_lng(append_lng(L(), $1), 0); } > + | poslng OFFSET poslng RECORDS { $$ = append_lng(append_lng(L(), $1), $3); } > ; > > opt_null_string: > @@ -4118,6 +4120,17 @@ > } > ; > > + > +poslng: > + lngval { $$ = $1; > + if ($$ < 0) { > + $$ = -1; > + yyerror("Positive value expected"); > + YYABORT; > + } > + } > + ; > + > posint: > intval { $$ = $1; > if ($$ < 0) { > @@ -4394,6 +4407,10 @@ > { $$ = append_string($1, $3); } > ; > > +lngval: > + sqlINT { $$ = strtoll($1,NULL,10); } > +; > + > intval: > sqlINT { $$ = strtol($1,NULL,10); } > | IDENT { mvc *m = (mvc*)parm; > > U sql_updates.mx > Index: sql_updates.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_updates.mx,v > retrieving revision 1.145 > retrieving revision 1.146 > diff -u -d -r1.145 -r1.146 > --- sql_updates.mx 7 Sep 2008 14:28:00 -0000 1.145 > +++ sql_updates.mx 16 Sep 2008 14:55:42 -0000 1.146 > @@ -1411,11 +1411,11 @@ > char *ssep = (seps->h->next->next)?seps->h->next->next->data.sval:"\""; > char *ns = (null_string)?null_string:"null"; > list *slist; > - int nr = (nr_offset)?nr_offset->h->data.i_val:-1; > - int offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > + lng nr = (nr_offset)?nr_offset->h->data.i_val:-1; > + lng offset = (nr_offset)?nr_offset->h->next->data.i_val:0; > > - assert(!nr_offset || nr_offset->h->type == type_int); > - assert(!nr_offset || nr_offset->h->next->type == type_int); > + assert(!nr_offset || nr_offset->h->type == type_lng); > + assert(!nr_offset || nr_offset->h->next->type == type_lng); > if (sname && !(s=mvc_bind_schema(sql, sname))) { > (void) sql_error(sql, 02, "COPY INTO: no such schema '%s'", sname); > return NULL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1