- developers-list - monetdb.org

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server sql_env.mx, Nov2008, 1.74, 1.74.2.1
by Martin Kersten 05 Nov '08

05 Nov '08

It will change again ;) see in my local dir Niels Nes wrote: > Update of /cvsroot/monetdb/sql/src/server > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17857/src/server > > Modified Files: > Tag: Nov2008 > sql_env.mx > Log Message: > keepCall now has 12 arguments > > > U sql_env.mx > Index: sql_env.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/sql_env.mx,v > retrieving revision 1.74 > retrieving revision 1.74.2.1 > diff -u -d -r1.74 -r1.74.2.1 > --- sql_env.mx 4 Nov 2008 11:38:16 -0000 1.74 > +++ sql_env.mx 5 Nov 2008 21:16:00 -0000 1.74.2.1 > @@ -114,7 +114,7 @@ > sgn = stack_get_number(m, "history"); > assert((lng) GDK_int_min <= sgn && sgn <= (lng) GDK_int_max); > if (!sql_find_func(sys, "keepquery", 4) || > - !sql_find_func(sys, "keepcall", 6)) > + !sql_find_func(sys, "keepcall", 12)) > return sql_message( "Cannot activate history because the keepQuery and keepCall procedures are not available\n" ); > m->history = (int) (sgn)?1:0; > } > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins >

1 0

[Monetdb-developers] Release schedule
by Sjoerd Mullender 04 Nov '08

04 Nov '08

Today we decided that we want to try to do releases more often and more regularly. I have been appointed release manager for all upcoming releases. I propose that we keep to the following schedule: - Do a major (feature) release once every 4 months. - Do a minor (bug fix) release once every month inbetween the major releases. This should solve the problem that we get bug reports for problems in the release for bugs that were already fixed months ago but not yet released. In the worst case the submitter has to wait a month for the fix, but usually of course much less than that. It also solves the problem that developers always want to add just one more feature to the next release and thereby forcing the release to be postponed. If a feature doesn't make it in a release, it will be released in four months time. If users (and developers) had to wait years for this feature, they can wait a little longer. I also propose to create a new stable branch right after releasing the last of the bug fix releases in a cycle. This gives us one month to stabilize and test a new release. This plan is effective as of now. -- Sjoerd Mullender

4 7

[Monetdb-developers] New stable branch created
by Sjoerd Mullender 04 Nov '08

04 Nov '08

I have created new stable branches for the upcoming release. From now on *all* bug fixes and *only* bug fixes *must* go to this new stable branch. I reserve the right to undo any changes that do not comply with this rule. Unlike previous stable branches, this time all packages use the same name for the branch: Nov2008. So in each of your stable checkout directories you can do cvs update -rNov2008 to update to the new branch. I have created branches for the following packages: MonetDB MonetDB4 MonetDB5 TestTools buildtools clients geom pathfinder sql template. Note that java and datacell are missing from this list. Java has its own release schedule, and datacell is not yet released and will not be released in this round. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/backends/monet5 sql_gencode.mx, , 1.291, 1.292
by Stefan Manegold 04 Nov '08

04 Nov '08

What about solving the actual problem and fixing the code properly instead of just curing/patching symptoms? In MonetDB type long is not supposed to be used at all as it is not portable. What is wrong with using the standard MonetDB type system? E.g., ======== $ cvs diff MonetDB5/src/mal/mal_builder.mx sql/src/backends/monet5/sql_gencode.mx Index: MonetDB5/src/mal/mal_builder.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_builder.mx,v retrieving revision 1.36 diff -u -r1.36 mal_builder.mx --- MonetDB5/src/mal/mal_builder.mx 30 Oct 2008 07:28:42 -0000 1.36 +++ MonetDB5/src/mal/mal_builder.mx 4 Nov 2008 07:33:47 -0000 @@ -47,7 +47,7 @@ mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, char val); mal_export InstrPtr pushOid(MalBlkPtr mb, InstrPtr q, oid val); mal_export InstrPtr pushVoid(MalBlkPtr mb, InstrPtr q); -mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, long val); +mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, lng val); mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, double val); mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, float val); mal_export InstrPtr pushStr(MalBlkPtr mb, InstrPtr q, const char *val); @@ -232,7 +232,7 @@ } InstrPtr -pushLng(MalBlkPtr mb, InstrPtr q, long val) +pushLng(MalBlkPtr mb, InstrPtr q, lng val) { int _t; ValRecord cst; Index: sql/src/backends/monet5/sql_gencode.mx =================================================================== RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v retrieving revision 1.292 diff -u -r1.292 sql_gencode.mx --- sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 +++ sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 07:33:47 -0000 @@ -1929,8 +1929,8 @@ q = newStmt(mb,sqlRef,"keepquery"); q= pushInt(mb,q,c->history); q= pushStr(mb,q,t); - q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); - q= pushLng(mb,q, (long) GDKusec()); + q= pushLng(mb,q, GDKusec() - be->mvc->Tparse); + q= pushLng(mb,q, GDKusec()); c->Tparse = 0; } ======== or even better ======== $ cvs diff MonetDB5/src/mal/mal_builder.mx sql/src/backends/monet5/sql_gencode.mx Index: MonetDB5/src/mal/mal_builder.mx =================================================================== RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_builder.mx,v retrieving revision 1.36 diff -u -r1.36 mal_builder.mx --- MonetDB5/src/mal/mal_builder.mx 30 Oct 2008 07:28:42 -0000 1.36 +++ MonetDB5/src/mal/mal_builder.mx 4 Nov 2008 07:35:53 -0000 @@ -44,14 +44,14 @@ mal_export InstrPtr pushInt(MalBlkPtr mb, InstrPtr q, int val); mal_export InstrPtr pushWrd(MalBlkPtr mb, InstrPtr q, wrd val); mal_export InstrPtr pushBte(MalBlkPtr mb, InstrPtr q, bte val); -mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, char val); +mal_export InstrPtr pushChr(MalBlkPtr mb, InstrPtr q, chr val); mal_export InstrPtr pushOid(MalBlkPtr mb, InstrPtr q, oid val); mal_export InstrPtr pushVoid(MalBlkPtr mb, InstrPtr q); -mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, long val); -mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, double val); -mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, float val); +mal_export InstrPtr pushLng(MalBlkPtr mb, InstrPtr q, lng val); +mal_export InstrPtr pushDbl(MalBlkPtr mb, InstrPtr q, dbl val); +mal_export InstrPtr pushFlt(MalBlkPtr mb, InstrPtr q, flt val); mal_export InstrPtr pushStr(MalBlkPtr mb, InstrPtr q, const char *val); -mal_export InstrPtr pushBit(MalBlkPtr mb, InstrPtr q, int val); +mal_export InstrPtr pushBit(MalBlkPtr mb, InstrPtr q, bit val); mal_export InstrPtr pushNil(MalBlkPtr mb, InstrPtr q, int tpe); mal_export InstrPtr pushNilType(MalBlkPtr mb, InstrPtr q, char *tpe); mal_export InstrPtr pushZero(MalBlkPtr mb, InstrPtr q, int tpe); @@ -193,7 +193,7 @@ } InstrPtr -pushChr(MalBlkPtr mb, InstrPtr q, char val) +pushChr(MalBlkPtr mb, InstrPtr q, chr val) { int _t; ValRecord cst; @@ -232,7 +232,7 @@ } InstrPtr -pushLng(MalBlkPtr mb, InstrPtr q, long val) +pushLng(MalBlkPtr mb, InstrPtr q, lng val) { int _t; ValRecord cst; @@ -244,7 +244,7 @@ } InstrPtr -pushDbl(MalBlkPtr mb, InstrPtr q, double val) +pushDbl(MalBlkPtr mb, InstrPtr q, dbl val) { int _t; ValRecord cst; @@ -256,7 +256,7 @@ } InstrPtr -pushFlt(MalBlkPtr mb, InstrPtr q, float val) +pushFlt(MalBlkPtr mb, InstrPtr q, flt val) { ValRecord cst; @@ -281,7 +281,7 @@ } InstrPtr -pushBit(MalBlkPtr mb, InstrPtr q, int val) +pushBit(MalBlkPtr mb, InstrPtr q, bit val) { int _t; ValRecord cst; Index: sql/src/backends/monet5/sql_gencode.mx =================================================================== RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v retrieving revision 1.292 diff -u -r1.292 sql_gencode.mx --- sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 +++ sql/src/backends/monet5/sql_gencode.mx 4 Nov 2008 07:35:53 -0000 @@ -1929,8 +1929,8 @@ q = newStmt(mb,sqlRef,"keepquery"); q= pushInt(mb,q,c->history); q= pushStr(mb,q,t); - q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); - q= pushLng(mb,q, (long) GDKusec()); + q= pushLng(mb,q, GDKusec() - be->mvc->Tparse); + q= pushLng(mb,q, GDKusec()); c->Tparse = 0; } ======== Stefan On Tue, Nov 04, 2008 at 06:55:26AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/sql/src/backends/monet5 > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13501 > > Modified Files: > sql_gencode.mx > Log Message: > Silence compiler > > > U sql_gencode.mx > Index: sql_gencode.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/backends/monet5/sql_gencode.mx,v > retrieving revision 1.291 > retrieving revision 1.292 > diff -u -d -r1.291 -r1.292 > --- sql_gencode.mx 3 Nov 2008 15:32:04 -0000 1.291 > +++ sql_gencode.mx 4 Nov 2008 06:55:24 -0000 1.292 > @@ -1929,8 +1929,8 @@ > q = newStmt(mb,sqlRef,"keepquery"); > q= pushInt(mb,q,c->history); > q= pushStr(mb,q,t); > - q= pushLng(mb,q,GDKusec() - be->mvc->Tparse); > - q= pushLng(mb,q, GDKusec()); > + q= pushLng(mb,q, (long) (GDKusec() - be->mvc->Tparse) ); > + q= pushLng(mb,q, (long) GDKusec()); > c->Tparse = 0; > } > > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/contrib malalgebra.mx, MonetDB_4-24, 1.8.2.2, 1.8.2.3
by Sjoerd Mullender 03 Nov '08

03 Nov '08

Did you see what I had done on the head branch for this problem? On 2008-11-03 22:51, Stefan Manegold wrote: > Update of /cvsroot/monetdb/MonetDB4/src/modules/contrib > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv6583/MonetDB4/src/modules/contrib > > Modified Files: > Tag: MonetDB_4-24 > malalgebra.mx > Log Message: > > attempt to fix bug in Peter's new {band,left}mergejoin_limit() functions > that was reported by Riham: > > While {band,left}mergejoin_limit() internally use a limit of type size_t, > the MIL level uses type lng; hence, we need to properly convert the types > back and forth (and check for potential under-/overflows). > > (For now, I did not dare to change the MIL interface to use the more suitable > type wrd that (unlike lng) grows with system word size just like size_t.) > > Riham, > > could you please check, whether this fixes your problem? > Thanks! > > > > U malalgebra.mx > Index: malalgebra.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB4/src/modules/contrib/malalgebra.mx,v > retrieving revision 1.8.2.2 > retrieving revision 1.8.2.3 > diff -u -d -r1.8.2.2 -r1.8.2.3 > --- malalgebra.mx 28 Oct 2008 17:49:34 -0000 1.8.2.2 > +++ malalgebra.mx 3 Nov 2008 21:51:09 -0000 1.8.2.3 > @@ -263,28 +263,50 @@ > } > > int > -CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* limit) > +CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* _limit) > { > - size_t cutoff = *limit; > + lng limit = *_limit; > + size_t cutoff = (size_t) limit; > + assert(limit >= 0); > +#if SIZEOF_SIZE_T == SIZEOF_INT > + assert(limit <= GDK_int_max); > +#endif > *result = BATbandmergejoin_limit(left, right, minus, plus, *li, *hi, &cutoff); > if (*result) { > bat bid = (*result)->batCacheid; > *result = BATnew(TYPE_lng, TYPE_bat, 1); > - if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + if (*result) { > +#if SIZEOF_SIZE_T == SIZEOF_LNG > + assert(cutoff <= (size_t) GDK_lng_max); > +#endif > + limit = (lng) cutoff; > + BUNins(*result, &limit, &bid, FALSE); > + } > BBPunfix(bid); > } > return (*result)?GDK_SUCCEED:GDK_FAIL; > } > > int > -CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* limit) > +CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* _limit) > { > - size_t cutoff = *limit; > + lng limit = *_limit; > + size_t cutoff = (size_t) limit; > + assert(limit >= 0); > +#if SIZEOF_SIZE_T == SIZEOF_INT > + assert(limit <= GDK_int_max); > +#endif > *result = BATleftmergejoin_limit(left, right, cutoff, &cutoff); > if (*result) { > bat bid = (*result)->batCacheid; > *result = BATnew(TYPE_lng, TYPE_bat, 1); > - if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + if (*result) { > +#if SIZEOF_SIZE_T == SIZEOF_LNG > + assert(cutoff <= (size_t) GDK_lng_max); > +#endif > + limit = (lng) cutoff; > + BUNins(*result, &limit, &bid, FALSE); > + } > BBPunfix(bid); > } > return (*result)?GDK_SUCCEED:GDK_FAIL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_history.mx, , 1.1, 1.2
by Romulo Goncalves 03 Nov '08

03 Nov '08

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv32362 > > Modified Files: > opt_history.mx > Log Message: > Added the missing information. > > > U opt_history.mx > Index: opt_history.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/optimizer/opt_history.mx,v > retrieving revision 1.1 > retrieving revision 1.2 > diff -u -d -r1.1 -r1.2 > --- opt_history.mx 3 Nov 2008 06:35:34 -0000 1.1 > +++ opt_history.mx 3 Nov 2008 12:36:44 -0000 1.2 > @@ -32,7 +32,7 @@ > time you use the history without initialization. > The keepcall can be used to check for initialization of the cache. > @mal > -module user; > +module sql; > function keepquery{unsafe}(qid:int,qry:str,parse:lng,optimize:lng):void; > raise SQLexception:= "SQL history script should be run first"; > end keepquery; > @@ -44,6 +44,10 @@ > function queryId{unsafe}(qid:int):void; > end queryId; > > +pattern forgetPrevious():void > +address OPTforgetPrevious > +comment "invalidate the previous instruction from future execution"; > + > pattern optimizer.history():str > address OPThistory; > pattern optimizer.history(mod:str, fcn:str):str > @@ -61,6 +65,7 @@ > #include "mal_instruction.h" > #include "mal_function.h" > > +opt_export str OPTforgetPrevious(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci); > /* #define _DEBUG_OPT_QUERYHISTORY_ trace its behavior */ > > @- > @@ -79,12 +84,23 @@ > @c > #include "opt_history.h" > > +str > +OPTforgetPrevious(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci){ > + int pc; > + (void) cntxt; > + (void) stk; > + pc= getPC(mb,pci); > + assert ( pc > 0 && pc < mb->stop); > + mb->stmt[pc-1]->token = REMsymbol; > + return MAL_SUCCEED; > +} > + > static int > OPThistoryImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > { > int i, limit,slimit; > InstrPtr p=0, *old= mb->stmt, q,r; > - int qid, argc, elaps, inblock, oublock, arg, ctime; > + int qid=0, argc, elaps, inblock, oublock, arg, ctime; > int returnseen=0; > > > @@ -97,6 +113,17 @@ > #else > (void) cntxt; > #endif > + if ( findSymbol(userRef,"keepQuery") == 0){ > + /* initialization script has not been ran */ > + return 0; > + } > + /* gather information and recast the call handel*/ > + for (i = 1; i < limit; i++) { Using limit here and... > + p= getInstrPtr(mb,i); > + if ( getModuleId(p)== sqlRef && idcmp(getFunctionId(p),"queryId")==0){ > + qid= getArg(p,1); > + } > + } > > limit= mb->stop; You initialize it here :S Romulo > slimit= mb->ssize; > @@ -109,6 +136,11 @@ > for (i = 1; i < limit; i++) { > p= old[i]; > > + if ( getModuleId(p)== sqlRef && idcmp(getFunctionId(p),"keepQuery")==0){ > + getModuleId(p) = userRef; > + pushInstruction(mb,p); > + q= newStmt(mb,sqlRef,"forgetPrevious"); > + } > if ( p->token== ENDsymbol || p->barrier == RETURNsymbol || p->barrier == YIELDsymbol){ > if (returnseen && p->token == ENDsymbol) { > pushInstruction(mb,p); > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

[Monetdb-developers] mserver5 does not terminated
by Romulo Goncalves 03 Nov '08

03 Nov '08

If I start a mserver5 with a corrupted (old) dbfarm I get: # MonetDB server v5.7.0, based on kernel v1.25.0 # Serving database 'rdf_current', using 4 threads # Compiled for x86_64-unknown-linux-gnu/64bit with 64bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008- MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /scratch/romulo/build/MonetDB/current/optimized/MonetDB5//etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/SQL module v2.25.0 loaded >!ERROR: Incompatible database version 040000, this server supports version 050000 !ERROR: Please move away /scratch/romulo/var/dblogs/rdf_current/sql/ and its corresponding dbfarm. !mvc_init: unable to create system tables > >\q Which is correct. However, I am only able to close (I should more say kill it) with kill -9 <mserver5_pid> I could open a bug, but it is not easy to create a test for this problem... Romulo

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_history.mx, , NONE, 1.1 Makefile.ag, , 1.62, 1.63 opt_prelude.mx, , 1.49, 1.50
by Romulo Goncalves 03 Nov '08

03 Nov '08

Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB5/src/optimizer > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv21452 > > Modified Files: > Makefile.ag opt_prelude.mx > Added Files: > opt_history.mx > Log Message: > include the SQL history code optimizer > > > U opt_prelude.mx > --- NEW FILE: opt_history.mx --- ............... > > static int > OPThistoryImplementation(Client cntxt, MalBlkPtr mb, MalStkPtr stk, InstrPtr pci) > { > int i, limit,slimit; > InstrPtr p=0, *old= mb->stmt, q,r; > int qid, argc, elaps, inblock, oublock, arg, ctime; You need to initialize it before you use it.... qid = 0 ? Regards, Romulo > int returnseen=0; > > > (void) pci; > (void) stk; /* to fool compilers */ > > #ifdef _DEBUG_OPT_QUERYHISTORY_ > stream_printf(cntxt->fdout,"ENTERING TRACE CODE \n"); > printFunction(cntxt->fdout,mb,0,LIST_MAL_ALL); > #else > (void) cntxt; > #endif > > limit= mb->stop; > slimit= mb->ssize; > newMalBlkStmt(mb, mb->ssize+20); /* a new statement stack */ > > pushInstruction(mb, old[0]); > /* collect the statistics */ > @:initCounters@ > > for (i = 1; i < limit; i++) { > p= old[i]; > > if ( p->token== ENDsymbol || p->barrier == RETURNsymbol || p->barrier == YIELDsymbol){ > if (returnseen && p->token == ENDsymbol) { > pushInstruction(mb,p); > continue; > } > returnseen++; > q = newStmt(mb,"alarm","usec"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, elaps); > elaps= getArg(r,0); > > q = newStmt(mb,"bbp","getDiskReads"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, inblock); > inblock= getArg(r,0); > > q = newStmt(mb,"bbp","getDiskWrites"); > setVarType(mb,getArg(q,0), TYPE_lng); > r = newStmt(mb,"calc","-"); > r = pushArgument(mb,r, getArg(q,0)); > r = pushArgument(mb,r, oublock); > oublock= getArg(r,0); > > /* prepare the call to the history manager */ > q = newStmt(mb,"sql","argRecord"); > setVarType(mb,getArg(q,0), TYPE_str); > for ( argc=0; argc < old[0]->argc; argc++) > q = pushArgument(mb, q, getArg(old[0],argc)); > > arg= getArg(q,0); > > q = newStmt(mb,"user","keepcall"); > q = pushInt(mb, q, qid); /* query identifier */ > q = pushArgument(mb, q, ctime); /* arguments */ > q = pushArgument(mb, q, arg); /* arguments */ > q = pushArgument(mb, q, elaps); /* elaps */ > q = pushArgument(mb, q, inblock);/* inblock */ > q = pushArgument(mb, q, oublock);/* oublock */ > } > > pushInstruction(mb,p); > if (p->barrier == YIELDsymbol){ > /* the factory yield may return */ > @:initCounters@ > } > } > > #ifdef _DEBUG_OPT_QUERYHISTORY_ > stream_printf(cntxt->fdout,"LEAVING QUERYHISTORY CODE INJECTION\n"); > printFunction(cntxt->fdout,mb,LIST_MAL_ALL); > #endif > for( ; i<slimit; i++) > if(old[i]) > freeInstruction(old[i]); > GDKfree(old); > return 1; > } > @include optimizerWrapper.mx > @h > @:exportOptimizer(history)@ > #endif > @c > #include "opt_statistics.h" > @:wrapOptimizer(history,OPT_CHECK_ALL)@ > @} > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins

1 0

[Monetdb-developers] communication problem between Mserver and mclient on OS X
by Jan Rittinger 31 Oct '08

31 Oct '08

Hi all, can you tell me what I need to change to make Mserver communicate with mclient on OS X. All I get is silence... $ Mserver --dbinit='module(pathfinder); mil_start();' # MonetDB Server v4.25.0 # based on GDK v1.25.0 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-, MonetDB B.V.. All rights reserved. # Compiled for i686-apple-darwin9.5.0/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah # MonetDB/XQuery module v0.25.0 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:50001/admin MonetDB> $ mclient -lx q01.xq ^C (after 2 minutes) $ mclient -lmil q01.mil ^C (after 2 minutes) Running the same query through Mserver directly completes in under a second. $ pf q01.xq > q01.mil $ Mserver q01.mil # MonetDB Server v4.25.0 # based on GDK v1.25.0 # Copyright (c) 1993-July 2008, CWI. All rights reserved. # Copyright (c) August 2008-, MonetDB B.V.. All rights reserved. # Compiled for i686-apple-darwin9.5.0/32bit with 32bit OIDs; dynamically linked. # Visit http://monetdb.cwi.nl/ for further information. # PF/Tijah module v0.9.0 loaded. http://dbappl.cs.utwente.nl/pftijah # MonetDB/XQuery module v0.25.0 loaded (default back-end is 'algebra') # XRPC administrative console at http://127.0.0.1:50001/admin <?xml version="1.0" encoding="utf-8"?> <XQueryResult>Ayonca Vijaykrishnan</XQueryResult> MonetDB> Thanks, Jan -- Jan Rittinger Lehrstuhl Datenbanken und Informationssysteme Wilhelm-Schickard-Institut für Informatik Eberhard-Karls-Universität Tübingen http://www-db.informatik.uni-tuebingen.de/team/rittinger

2 4

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB4/src/modules/contrib malalgebra.mx, MonetDB_4-24, 1.8.2.1, 1.8.2.2
by Sjoerd Mullender 29 Oct '08

29 Oct '08

This type of change is not allowed on a stable branch. Changes of API are *not* allowed. Since we're going to abandon this stable branch soon, I'll let it pass. On 2008-10-28 18:49, Peter Boncz wrote: > Update of /cvsroot/monetdb/MonetDB4/src/modules/contrib > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv901/src/modules/contrib > > Modified Files: > Tag: MonetDB_4-24 > malalgebra.mx > Log Message: > changes to minimize sampling overhead (mostly in XML text index) > > - introduce bandmergejoin(), and leftmergejoin()/bandmergejoin() with a cutoff > > > > U malalgebra.mx > Index: malalgebra.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB4/src/modules/contrib/malalgebra.mx,v > retrieving revision 1.8.2.1 > retrieving revision 1.8.2.2 > diff -u -d -r1.8.2.1 -r1.8.2.2 > --- malalgebra.mx 10 Oct 2008 08:42:22 -0000 1.8.2.1 > +++ malalgebra.mx 28 Oct 2008 17:49:34 -0000 1.8.2.2 > @@ -43,7 +43,6 @@ > @:leftjoin(fetch,\nCAUTION: positional matches are assumed not to be out-of-bounds!!)@ > @:leftjoin(merge)@ > @:leftjoin(hash)@ > - > .COMMAND leftthetajoin ( BAT[any::1,any::2] left, BAT[any::2,any::3] right, int mode) : > BAT[any::1,any::3] = CMDleftthetajoin; > "Hook directly into the 'leftthetajoin' implementation of the join. > @@ -58,6 +57,22 @@ > Also, for each left tuple, all matching right tuples will appear in their order > of appearrance in the right BAT. This property is handy for XQuery processing." > > + .COMMAND bandmergejoin ( BAT[any::1,any::2] outer, BAT[any::2,any::3] inner, > + any::2 minus, any::2 plus, bit l_in, bit h_in) : > + BAT[any::1,any::3] = CMDbandmergejoin; > + "The bandjoin algorithm, but forced to use (left) mergejoin rather than nested loop" > + > + .COMMAND bandmergejoin ( BAT[any::1,any::2] outer, BAT[any::2,any::3] inner, > + any::2 minus, any::2 plus, bit l_in, bit h_in, lng limit) : > + BAT[lng,BAT] = CMDbandmergejoin_limit; > + "A bandjoin that uses the merge algorithm and limits the result size. > + Result generation is cut off after this point and the > + result [lng,BAT] holds [estimated_full_resultsize,limited_result]" > + > + .COMMAND leftmergejoin ( BAT[any::1,any::2] left, BAT[any::2,any::3] right, lng limit) : > + BAT[lng,BAT] = CMDleftmergejoin_limit; > + "leftmergejoin, but limit the result (by cutting off result generation) > + return a BAT[lng,BAT] containing [full_result_estimate,limited_result]" > > @= select > .COMMAND ord_@1select ( BAT[any::1,any::2] b, any::2 low, any::2 high) : > @@ -119,6 +134,7 @@ > #ifndef __MALALGEBRA_H__ > #define __MALALGEBRA_H__ > #include "gdk.h" > +#include "gdk_rangejoin.h" > > /* nothing much */ > > @@ -240,6 +256,40 @@ > return (*result = BATnlthetajoin(l, r, *mode, (size_t) * estimate)) ? GDK_SUCCEED : GDK_FAIL; > } > > +int > +CMDbandmergejoin(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi) > +{ > + return (*result = BATbandmergejoin(left, right, minus, plus, *li, *hi)) ? GDK_SUCCEED : GDK_FAIL; > +} > + > +int > +CMDbandmergejoin_limit(BAT **result, BAT *left, BAT *right, ptr minus, ptr plus, bit *li, bit *hi, lng* limit) > +{ > + size_t cutoff = *limit; > + *result = BATbandmergejoin_limit(left, right, minus, plus, *li, *hi, &cutoff); > + if (*result) { > + bat bid = (*result)->batCacheid; > + *result = BATnew(TYPE_lng, TYPE_bat, 1); > + if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + BBPunfix(bid); > + } > + return (*result)?GDK_SUCCEED:GDK_FAIL; > +} > + > +int > +CMDleftmergejoin_limit(BAT **result, BAT *left, BAT *right, lng* limit) > +{ > + size_t cutoff = *limit; > + *result = BATleftmergejoin_limit(left, right, cutoff, &cutoff); > + if (*result) { > + bat bid = (*result)->batCacheid; > + *result = BATnew(TYPE_lng, TYPE_bat, 1); > + if (*result) BUNins(*result, &cutoff, &bid, FALSE); > + BBPunfix(bid); > + } > + return (*result)?GDK_SUCCEED:GDK_FAIL; > +} > + > @= selectcmd > int CMDord_@1select1(BAT **result, BAT* b, ptr value) { > return (*result = BAT_select_(b, value, 0, TRUE, TRUE, @2, FALSE, TRUE))?GDK_SUCCEED:GDK_FAIL; > > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- Sjoerd Mullender

4 11