March 2009 - developers-list

[Monetdb-developers] MAL Instructions and a New Client Development
by Mohamed Saber 30 Mar '09

30 Mar '09

Hi All, I am new to MonetDB. I want to create new MonetDB commands (like the SQL) in my research project. So, I want a good reference/tutorial on the MAL instructions. After that I will do a compiler to compile my new commands to the equivalent MAL instructions. I think that the MonetDB_Manual is insufficient. If you have any reference or recommendations to achieve what I need, please let me know. I want to master the MAL language. Any help will be appreciated. Thank you so much and have a great day, Kind Regards, Mohamed Saber _________________________________________________________________ More than messages–check out the rest of the Windows Live™. http://www.microsoft.com/windows/windowslive/

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah serialize_pftijah.mx, Feb2009, 1.68.2.1, 1.68.2.2
by Stefan Manegold 30 Mar '09

30 Mar '09

On Mon, Mar 30, 2009 at 04:04:10PM +0000, Wouter Alink wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16148 > > Modified Files: > Tag: Feb2009 > serialize_pftijah.mx > Log Message: > -- step 1 in crossing trhe oid32 boundary with PF/TIJAH: remove some casts to int. > This commit will (partially) fix bug "2722117 PF/TIJAH: dbat_finalize fails". Cetero senseo: never (down-)cast unless it is strictly required and you have strictly ensured/asserted that the actual value of the (larger) source type at all times fits into the range of the (smaller) target type. In fact, I made the experiences that avoiding casts as far as possible (e.g.) by consistently using the "proper" types, keeps the code much cleaner, more maintainable and less error prone, giving the compilers a chance to warn us about potential over/underflows in case we accidently assign/use non-matching types ... ;-) Stefan ps: Just sharing my experiences and lessons I learned, no "blame" at all! ;-) > The fix was suggested by Henning/JanF, and seems to at least partially fix the indexing of a 30GB XML document. A new bug "2722117 PF/TIJAH: dbat_finalize fails" has been filed with the next issue. Bug "2722117" can be closed. No test can be created as the data is simply too large. > > > > U serialize_pftijah.mx > Index: serialize_pftijah.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/serialize_pftijah.mx,v > retrieving revision 1.68.2.1 > retrieving revision 1.68.2.2 > diff -u -d -r1.68.2.1 -r1.68.2.2 > --- serialize_pftijah.mx 25 Mar 2009 13:17:56 -0000 1.68.2.1 > +++ serialize_pftijah.mx 30 Mar 2009 16:04:08 -0000 1.68.2.2 > @@ -982,7 +982,7 @@ > --tjctx->doc_height; > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah document size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > #else > (void) ctx; > #endif > @@ -1136,7 +1136,7 @@ > if ( DOEMIT(tjctx) ) { > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah element size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > }; > #ifdef TJ_TRACE > if ( TJ_TRACE ) stream_printf(GDKout,"C[%s]:empty_endElement: \"%s\"\n", tjctx->name,""); > @@ -1167,7 +1167,7 @@ > if ( DOEMIT(tjctx) ) { > oid start = tj_popTag(tjctx); /* oid of the first node of the element */ > int size = tjctx->tijahPre - start - 1; /* the Tijah element size */ > - dbat_set_int(&tjctx->dbat_collSize,(int)start,size); > + dbat_set_int(&tjctx->dbat_collSize,start,size); > #ifdef TJ_TRACE > if ( TJ_TRACE ) stream_printf(GDKout,"C[%s]:endElement: \"%s\"\n", tjctx->name,name); > #endif > > > ------------------------------------------------------------------------------ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/common monet_options.mx, , 1.32, 1.33
by Roberto Cornacchia 30 Mar '09

30 Mar '09

Oh thanks!! That is really handy! :) On Mon, 2009-03-30 at 14:51 +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/MonetDB/src/common > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv4062/src/common > > Modified Files: > monet_options.mx > Log Message: > If the logdir argument to logger_create is a relative path name, the > logdir will be located inside the dbfarm/dbname directory. If it is > an absolute path name, that path is used. > > The default log directory for both SQL and XQuery have been changed > accordingly. > > This change puts the complete database in one location. -- | M.Sc. Roberto Cornacchia | CWI (Centrum voor Wiskunde en Informatica) | Science Park 123, 1098XG Amsterdam, The Netherlands | tel: +31 20 592 4322 , http://www.cwi.nl/~roberto

1 0

[Monetdb-developers] Fix for enable-jdbc enable-xrpcwrapper arguments of MonetDB-java
by Yue Sheng 26 Mar '09

26 Mar '09

Hi, The configure script for MonetDB-java uses the macro AC_ARG_ENABLE for its commandline arguments, but uses $withval instead of $enableval within that macro. The attached patch should fix the issue. It applies to Feb2009-SP1 bug fix release of the MonetDB suite. Thanks.

2 1

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 26 Mar '09

26 Mar '09

The MonetDB team at CWI is pleased to announce the Feb2009-SP1 bug fix release of the MonetDB suite of programs. This is a bug fix release of last month's Feb2009 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Feb2009/#Feb200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

[Monetdb-developers] do_not_use_posix_fadvise
by Stefan de Konink 23 Mar '09

23 Mar '09

Hi, What is the rationale to enable or disable fadvise explicitly? do_not_use_posix_fadvise = uname(&ubuf) == 0 && strcmp(ubuf.sysname, "Linux") == 0 && strncmp(ubuf.release, "2.4", 3) <= 0; Answers as "it doesn't work" will not satisfy my hunger to this answer; because I do see a completely different performance upon manual changing this variable. Stefan

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra algopt.c, Feb2009, 1.46.2.4, 1.46.2.5
by Stefan Manegold 20 Mar '09

20 Mar '09

On Fri, Mar 20, 2009 at 09:58:04AM +0000, Bastian Brodbeck wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13909/compiler/algebra > > Modified Files: > Tag: Feb2009 ^^^^^^^ > algopt.c > Log Message: > adding new optimization -Y ^^^^^^^^^^^^^^^^^^^^^^^^^^ is this a bug fix or a new feature? If the latter (as I suspect), please undo this checking on the Feb2009 branch and redo it on the development trunk (HEAD), using only CVS commands, as, e.g., discribed on page 15 of http://homepages.cwi.nl/~manegold/Presentations/MonetDBdevTTT.pdf (pages 8 - 16 might be interesting) Thanks! Stefan > this optimization pushes projection up in the tree to minimize them. > the goal is to simplify the tree for other optimizations > > > U algopt.c > Index: algopt.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/algopt.c,v > retrieving revision 1.46.2.4 > retrieving revision 1.46.2.5 > diff -u -d -r1.46.2.4 -r1.46.2.5 > --- algopt.c 6 Feb 2009 14:48:45 -0000 1.46.2.4 > +++ algopt.c 20 Mar 2009 09:58:02 -0000 1.46.2.5 > @@ -179,6 +179,19 @@ > PFlog (" MonetDB specific optimizations: %s", > PFtimer_str (tm)); > break; > + > + case 'Y': > + /*REMOVE_PROXIES("MonetDB specific optimization")*/ > + > + tm = PFtimer_start (); > + > + root = PFalgopt_projection (root); > + > + tm = PFtimer_stop (tm); > + if (timing) > + PFlog (" project optimizations: %s", > + PFtimer_str (tm)); > + break; > > case 'E': > MAP_UNQ_NAMES("common subexpression elimination") > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra/opt Makefile.ag, Feb2009, 1.19.2.2, 1.19.2.3
by Sjoerd Mullender 20 Mar '09

20 Mar '09

This sounds like a new feature which is not allowed in the Stable branch. Bastian Brodbeck wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra/opt > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv13909/compiler/algebra/opt > > Modified Files: > Tag: Feb2009 > Makefile.ag > Log Message: > adding new optimization -Y > this optimization pushes projection up in the tree to minimize them. > the goal is to simplify the tree for other optimizations > > > U Makefile.ag > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/opt/Makefile.ag,v > retrieving revision 1.19.2.2 > retrieving revision 1.19.2.3 > diff -u -d -r1.19.2.2 -r1.19.2.3 > --- Makefile.ag 6 Feb 2009 14:47:47 -0000 1.19.2.2 > +++ Makefile.ag 20 Mar 2009 09:58:02 -0000 1.19.2.3 > @@ -47,6 +47,7 @@ > opt_key.c \ > opt_monetxq.c \ > opt_mvd.c \ > + opt_projection.c \ > opt_req_node.c \ > opt_reqval.c \ > opt_rank.c \ > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/mil milprint.c, , 1.93, 1.94
by Stefan Manegold 13 Mar '09

13 Mar '09

Jan F (and Jan R), or should my fix (below) rather have looked like this: Index: pathfinder/compiler/mil/milprint.c =================================================================== RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milprint.c,v retrieving revision 1.93 diff -u -r1.93 milprint.c --- pathfinder/compiler/mil/milprint.c 10 Mar 2009 12:20:44 -0000 1.93 +++ pathfinder/compiler/mil/milprint.c 13 Mar 2009 08:39:16 -0000 @@ -429,7 +429,7 @@ , [m_egsum] = "{sum}" , [m_prod] = "prod" , [m_gprod] = "{prod}" - , [m_gprod] = "{prod}" + , [m_egprod] = "{prod}" , [m_bat] = "bat" , [m_catch] = "CATCH" , [m_error] = "ERROR" ? Thanks! Stefan On Fri, Mar 13, 2009 at 08:37:07AM +0000, Stefan Manegold wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/mil > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv12904/pathfinder/compiler/mil > > Modified Files: > milprint.c > Log Message: > > fixing compilation error > > .../pathfinder/compiler/mil/milprint.c:433: error: initialized field overwritten > .../pathfinder/compiler/mil/milprint.c:433: error: (near initialization for ‘ID[111]’) > > there is no need to initialize the same field twice with the same value > > > U milprint.c > Index: milprint.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/mil/milprint.c,v > retrieving revision 1.93 > retrieving revision 1.94 > diff -u -d -r1.93 -r1.94 > --- milprint.c 10 Mar 2009 12:20:44 -0000 1.93 > +++ milprint.c 13 Mar 2009 08:37:05 -0000 1.94 > @@ -429,7 +429,6 @@ > , [m_egsum] = "{sum}" > , [m_prod] = "prod" > , [m_gprod] = "{prod}" > - , [m_gprod] = "{prod}" > , [m_bat] = "bat" > , [m_catch] = "CATCH" > , [m_error] = "ERROR" > > > ------------------------------------------------------------------------------ > Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are > powering Web 2.0 with engaging, cross-platform capabilities. Quickly and > easily build your RIAs with Flex Builder, the Eclipse(TM)based development > software that enables intelligent coding and step-through debugging. > Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 1

[Monetdb-developers] SourceForge unplanned downtime
by Sjoerd Mullender 11 Mar '09

11 Mar '09

We can't use CVS at the moment. According to the SourceForge site status page: "2009-03-10: Service CVS unplanned downtime March 10th, 2009 CVS repositories that begin with the letters (a e h i m o r w z) are experiencing unplanned downtime since 2009-03-10 18:00 UTC. SourceForge.net staff are actively working to resolve the issue and anticipate having the service returned sometime in the next 2 days." -- Sjoerd Mullender

1 0