- developers-list - monetdb.org

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, 1.269.2.7, 1.269.2.8
by Stefan Manegold 10 Nov '06

10 Nov '06

Peter are the *.print() below debugging output that should not be in and hence be removed again? Thanks! Stefan On Thu, Nov 09, 2006 at 11:35:05PM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs7.sourceforge.net:/tmp/cvs-serv29555 > > Modified Files: > Tag: XQuery_0-14 > pathfinder.mx > Log Message: > - newnids(): prevent error in slice > > > > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.269.2.7 > retrieving revision 1.269.2.8 > diff -u -d -r1.269.2.7 -r1.269.2.8 > --- pathfinder.mx 9 Nov 2006 18:17:58 -0000 1.269.2.7 > +++ pathfinder.mx 9 Nov 2006 23:35:02 -0000 1.269.2.8 > @@ -1488,10 +1488,10 @@ > { > var free_nids := runtime.fetch(RT_NID_FREELIST); > var i := count(free_nids); > - > +free_nids.col_name("free_nids").print(); > # re-use a page from the list; or -if empty- append a new page > if (i > 0) { > - var ret := free_nids.slice(i - cnt, i - 1).copy(); > + var ret := free_nids.slice(max(0, i - cnt), i - 1).copy(); > free_nids.delete(ret); > return ret; > } > @@ -1797,6 +1797,7 @@ > lock_set(coll_lock); > var newnids := empty_bat, err := CATCH(newnids := __runtime_newnids(runtime, cnt)); > lock_unset(coll_lock); > +newnids.col_name("newnids").print(); > > if (isnil(err) and bit(cnt :-= count(newnids))) { > # not enough free nids page: we must physically extend the nid_rid table > @@ -1834,6 +1835,7 @@ > var delta := reverse(nid_rid.slice(nid_off,nid_cnt - 1)); > # put nids in reverse order in the freelist, so they are given out in order > delta := delta.copy().access(BAT_WRITE).revert(); > +delta.col_name("delta").print(); > > # add extra created NIDs to the freelist > lock_set(coll_lock); > > > ------------------------------------------------------------------------- > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

[Monetdb-developers] Branches, Checkins & Propagation
by Stefan Manegold 10 Nov '06

10 Nov '06

Esteemed fellow developers, having two tightly related branches --- the release branch and the development trunk --- give us the opportunity to clearly and conveniently isolate new "progressive" developments on the development trunk from "conservative" code consolidation and bug fixing on the release branch. Unfortunately, also this medal has a second side: to make the development trunk benefit from the code consolidation and bug fixes on the release branch either (1) *each* of the respective changes has to be checked in twice (by *each* developer), or (2) the checkins to the branch are *in bulk* (aka. "automa[tgn]ically") propagated from the release branch to the development trunk on an (ir?)regular basis or on need/request. (1) has the advantage that all bug fixes are "instantly" available in the development trunk, too, but comes at the cost of double checkins and bears the risk of "forgetting" one. (2) keep all developers from extra work and -responsibility, but has the disadvantage that the availability of bug fixes in the development trunk is delayed. Both strategies bear the risk of conflicts in case development has modified code before a bug fix is applied. That's obviously unavoidable and such conflicts need to be resolved "by hand". Provided only one of the two strategies is strictly applied these should be the only conflicts. Mixing the two strategies, however, is IMHO no option, as it will/does/did introduce extra conflicts: Say developer A applies a bug fix X to both the release branch and the development trunk. Later developer B applies once bug fix Y that (partly) changes the code that was also modified by bug fix X. Finally, when developer C tries to perform the bulk propagation of bug fixes since the last propagation (i.e., X & Y) from branch to the trunk, a conflict occurs since X had already been applied on the trunk. Hence, mixing both strategies forces us to spend even more of our precious time and energy on fixing these *avoidable* conflicts by hand. I guess, I can assume that you all agree that this is not desirable. Since we started with the first release branch a couple of years ago, we have been using strategy (2), summarized as * all bug-fixes (and only these) must go to the new release branches (and only there) * all new features must go to the development trunks (and only there) However, since the above (and similar) situation of mixing the strategies with all its consequences has just occurred, I'm wondering whether you're all still "satisfied" with strategy (2), or whether you'd prefer to switch (completely!) to strategy (1). I'm in favor of sticking to (2), but I'm perfectly fine if we agree on *consequently* switching to (1). Hence, please hit your keyboard, comment, and vote for either strategy. Looking forward to hearing your verdict! Good night, Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 6, Issue 14
by Romulo Goncalves 09 Nov '06

09 Nov '06

monetdb-developers-request(a)lists.sourceforge.net wrote: > Send Monetdb-developers mailing list submissions to > monetdb-developers(a)lists.sourceforge.net > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > or, via email, send a message with subject or body 'help' to > monetdb-developers-request(a)lists.sourceforge.net > > You can reach the person managing the list at > monetdb-developers-owner(a)lists.sourceforge.net > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Monetdb-developers digest..." > > > Today's Topics: > > 1. Mserver including SQL module.... (Romulo Goncalves) > 2. Re: Mserver including SQL module.... (Fabian Groffen) > 3. Re: Mserver including SQL module.... (Romulo Goncalves) > 4. Re: Mserver including SQL module.... (Fabian) > 5. Re: Mserver including SQL module.... (Romulo Goncalves) > 6. Re: Mserver including SQL module.... (Fabian) > 7. sql.start() is not reconized anymore..... (Romulo Goncalves) > 8. Re: sql.start() is not reconized anymore..... (Martin Kersten) > 9. Re: sql.start() is not reconized anymore..... (Fabian Groffen) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 09 Nov 2006 10:16:28 +0100 > From: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Subject: [Monetdb-developers] Mserver including SQL module.... > To: monetdb-developers(a)lists.sourceforge.net > Message-ID: <4552F1EC.5050701(a)cwi.nl> > Content-Type: text/plain; charset=UTF-8; format=flowed > > Dear developers. > > I checked out the last SQL version. > > I start a mserver including the SQL module with the following alias: > >> gdb --args ~/scratch/MonetDB/monetdb5/bin/mserver5 --dbname=demo --set mapi_port=50000 --dbinit="module(sql_server); clients.setTrace(true);" > > and I got this error: > >> [Thread debugging using libthread_db enabled] >> [New Thread 46912510627904 (LWP 13853)] >> !WARNING: GDKlockHome: created directory /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ >> !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. >> !WARNING: BBPdir: initializing BBP. >> [New Thread 1082132832 (LWP 13856)] >> # MonetDB Server v4.99.19 >> # Copyright (c) 1993-2006 CWI, all rights reserved >> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked >> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >> # dbname:demo >> # Visit http://monetdb.cwi.nl/ for further information >> [New Thread 1090525536 (LWP 13857)] >> !ERROR: module(sql_server); clients.setTrace(true); >> ! ^<module path> expected > > > There is something wrong with my alias? > > I used the example in the file HowToStart-SQL. > > Regards, > Romulo > > > > > > > ------------------------------ > > Message: 2 > Date: Thu, 9 Nov 2006 10:58:22 +0100 > From: Fabian Groffen <Fabian.Groffen(a)cwi.nl> > Subject: Re: [Monetdb-developers] Mserver including SQL module.... > To: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Cc: monetdb-developers(a)lists.sourceforge.net > Message-ID: <20061109095822.GG30793(a)cwi.nl> > Content-Type: text/plain; charset=utf-8 > > On 09-11-2006 10:16:28 +0100, Romulo Goncalves wrote: >>> # MonetDB Server v4.99.19 >>> # Copyright (c) 1993-2006 CWI, all rights reserved >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked >>> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >>> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >>> # dbname:demo >>> # Visit http://monetdb.cwi.nl/ for further information >>> [New Thread 1090525536 (LWP 13857)] >>> !ERROR: module(sql_server); clients.setTrace(true); >>> ! ^<module path> expected > > include sql; > > > > ------------------------------ > > Message: 3 > Date: Thu, 09 Nov 2006 14:37:17 +0100 > From: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Subject: Re: [Monetdb-developers] Mserver including SQL module.... > To: Fabian <Fabian.Groffen(a)cwi.nl>, > monetdb-developers(a)lists.sourceforge.net > Message-ID: <45532F0D.4030403(a)cwi.nl> > Content-Type: text/plain; charset=UTF-8; format=flowed > > Fabian Groffen wrote: >> On 09-11-2006 10:16:28 +0100, Romulo Goncalves wrote: >>>> # MonetDB Server v4.99.19 >>>> # Copyright (c) 1993-2006 CWI, all rights reserved >>>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked >>>> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >>>> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >>>> # dbname:demo >>>> # Visit http://monetdb.cwi.nl/ for further information >>>> [New Thread 1090525536 (LWP 13857)] >>>> !ERROR: module(sql_server); clients.setTrace(true); >>>> ! ^<module path> expected >> include sql; > Sorry, but in the file HowtoStart and example shows that include sql; is > not needed. > > Mserver --set > monet_mod_path=<monetdb-prefix>/lib(64)/MonetDB:<sql-prefix>/lib(64)/MonetDB > --dbinit="module(sql_server); sql_server_start();" > > This sentence is in my HowToStart (development SQL trunk) > > I just followed my HowToStart, so someone should fix it. > > Regards, > Romulo > > > > ------------------------------ > > Message: 4 > Date: Thu, 9 Nov 2006 14:38:23 +0100 > From: Fabian <Fabian.Groffen(a)cwi.nl> > Subject: Re: [Monetdb-developers] Mserver including SQL module.... > To: monetdb-developers(a)lists.sourceforge.net > Message-ID: <20061109133823.GQ30793(a)cwi.nl> > Content-Type: text/plain; charset=utf-8 > > On 09-11-2006 14:37:17 +0100, Romulo Goncalves wrote: >> This sentence is in my HowToStart (development SQL trunk) >> >> I just followed my HowToStart, so someone should fix it. > > "someone"? > > YOU! > > > > ------------------------------ > > Message: 5 > Date: Thu, 09 Nov 2006 14:46:13 +0100 > From: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Subject: Re: [Monetdb-developers] Mserver including SQL module.... > To: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Cc: Fabian <Fabian.Groffen(a)cwi.nl>, > monetdb-developers(a)lists.sourceforge.net > Message-ID: <45533125.6010600(a)cwi.nl> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Romulo Goncalves wrote: >> Fabian Groffen wrote: >>> On 09-11-2006 10:16:28 +0100, Romulo Goncalves wrote: >>>>> # MonetDB Server v4.99.19 >>>>> # Copyright (c) 1993-2006 CWI, all rights reserved >>>>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs >>>>> dynamically linked >>>>> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >>>>> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >>>>> # dbname:demo >>>>> # Visit http://monetdb.cwi.nl/ for further information >>>>> [New Thread 1090525536 (LWP 13857)] >>>>> !ERROR: module(sql_server); clients.setTrace(true); >>>>> ! ^<module path> expected >>> include sql; >> Sorry, but in the file HowtoStart and example shows that include sql; is >> not needed. >> >> Mserver --set >> monet_mod_path=<monetdb-prefix>/lib(64)/MonetDB:<sql-prefix>/lib(64)/MonetDB >> --dbinit="module(sql_server); sql_server_start();" >> >> This sentence is in my HowToStart (development SQL trunk) >> >> I just followed my HowToStart, so someone should fix it. >> >> Regards, >> Romulo >> > Well, I just realized that the HowToStart is created only for MonetDB4 > and not MonetDB5. > > Sorry for the inconvenience. > > Regards, > Romulo > > > > ------------------------------ > > Message: 6 > Date: Thu, 9 Nov 2006 14:48:59 +0100 > From: Fabian <Fabian.Groffen(a)cwi.nl> > Subject: Re: [Monetdb-developers] Mserver including SQL module.... > To: monetdb-developers(a)lists.sourceforge.net > Message-ID: <20061109134859.GS30793(a)cwi.nl> > Content-Type: text/plain; charset=utf-8 > > On 09-11-2006 14:46:13 +0100, Romulo Goncalves wrote: >>> This sentence is in my HowToStart (development SQL trunk) >>> >>> I just followed my HowToStart, so someone should fix it. >>> >>> Regards, >>> Romulo >>> >> Well, I just realized that the HowToStart is created only for MonetDB4 >> and not MonetDB5. >> >> Sorry for the inconvenience. > > :) > > Maybe it's time to make a section in the file for M5? > > > > ------------------------------ > > Message: 7 > Date: Thu, 09 Nov 2006 20:25:05 +0100 > From: Romulo Goncalves <R.A.Goncalves(a)cwi.nl> > Subject: [Monetdb-developers] sql.start() is not reconized > anymore..... > To: monetdb-developers(a)lists.sourceforge.net, Martin Kersten > <Martin.Kersten(a)cwi.nl> > Message-ID: <45538091.40809(a)cwi.nl> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Dear monetdb developers. > > After the last update in M5 from Martin I start to have the following > problem: > > > Starting program: > /net/amelia/export/scratch1/goncalve/MonetDB/monetdb5/bin/mserver5 > --dbname=demo --set mapi_port=50000 --dbinit=include\ sql\;\ > clients.setTrace\(true\)\;\ sql.start\(\)\; > [Thread debugging using libthread_db enabled] > [New Thread 46912510627904 (LWP 3435)] > !WARNING: GDKlockHome: created directory > /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ > !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. > !WARNING: BBPdir: initializing BBP. > [New Thread 1082132832 (LWP 3438)] > # MonetDB Server v4.99.19 > # Copyright (c) 1993-2006 CWI, all rights reserved > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically > linked > # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf > # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm > # dbname:demo > # Visit http://monetdb.cwi.nl/ for further information > [New Thread 1090525536 (LWP 3439)] > #MALexception:malInclude:could not open file: sql > > !ERROR: 'sql.start' undefined in user.main[2] _3:any := sql.start() > > > > I am using M5 development trunk and the same for SQL. This changes > related to sql.start() are to be applied in M4 and not in M5, right? > > Regards, > Romulo > > > > ------------------------------ > > Message: 8 > Date: Thu, 09 Nov 2006 20:52:18 +0100 > From: Martin Kersten <Martin.Kersten(a)cwi.nl> > Subject: Re: [Monetdb-developers] sql.start() is not reconized > anymore..... > Cc: monetdb-developers(a)lists.sourceforge.net > Message-ID: <455386F2.2060200(a)cwi.nl> > Content-Type: text/plain; charset=ISO-8859-1; format=flowed > > Romulo Goncalves wrote: >> Dear monetdb developers. >> >> After the last update in M5 from Martin I start to have the following >> problem: > This problem is not (yet) confirmed. > mserver5 --dbinit="include sql;sql.start();" > seem to work in my setting. > An independent confirmation is needed. >> >> Starting program: >> /net/amelia/export/scratch1/goncalve/MonetDB/monetdb5/bin/mserver5 >> --dbname=demo --set mapi_port=50000 --dbinit=include\ sql\;\ >> clients.setTrace\(true\)\;\ sql.start\(\)\; >> [Thread debugging using libthread_db enabled] >> [New Thread 46912510627904 (LWP 3435)] >> !WARNING: GDKlockHome: created directory >> /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ >> !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. >> !WARNING: BBPdir: initializing BBP. >> [New Thread 1082132832 (LWP 3438)] >> # MonetDB Server v4.99.19 >> # Copyright (c) 1993-2006 CWI, all rights reserved >> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically >> linked >> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >> # dbname:demo >> # Visit http://monetdb.cwi.nl/ for further information >> [New Thread 1090525536 (LWP 3439)] >> #MALexception:malInclude:could not open file: sql >> >> !ERROR: 'sql.start' undefined in user.main[2] _3:any := sql.start() >> > >> >> I am using M5 development trunk and the same for SQL. This changes >> related to sql.start() are to be applied in M4 and not in M5, right? >> >> Regards, >> Romulo > > > > > ------------------------------ > > Message: 9 > Date: Thu, 9 Nov 2006 21:03:53 +0100 > From: Fabian Groffen <Fabian.Groffen(a)cwi.nl> > Subject: Re: [Monetdb-developers] sql.start() is not reconized > anymore..... > To: monetdb-developers(a)lists.sourceforge.net > Message-ID: <20061109200353.GB16767(a)cwi.nl> > Content-Type: text/plain; charset=utf-8 > > On 09-11-2006 20:52:18 +0100, Martin Kersten wrote: >> Romulo Goncalves wrote: >>> Dear monetdb developers. >>> >>> After the last update in M5 from Martin I start to have the following >>> problem: >> This problem is not (yet) confirmed. >> mserver5 --dbinit="include sql;sql.start();" >> seem to work in my setting. >> An independent confirmation is needed. >>> >>> Starting program: >>> /net/amelia/export/scratch1/goncalve/MonetDB/monetdb5/bin/mserver5 >>> --dbname=demo --set mapi_port=50000 --dbinit=include\ sql\;\ >>> clients.setTrace\(true\)\;\ sql.start\(\)\; >>> [Thread debugging using libthread_db enabled] >>> [New Thread 46912510627904 (LWP 3435)] >>> !WARNING: GDKlockHome: created directory >>> /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ >>> !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. >>> !WARNING: BBPdir: initializing BBP. >>> [New Thread 1082132832 (LWP 3438)] >>> # MonetDB Server v4.99.19 >>> # Copyright (c) 1993-2006 CWI, all rights reserved >>> # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically >>> linked >>> # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf >>> # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm >>> # dbname:demo >>> # Visit http://monetdb.cwi.nl/ for further information >>> [New Thread 1090525536 (LWP 3439)] >>> #MALexception:malInclude:could not open file: sql > > This indicates something is wrong unrelated to sql.start(): "sql" can't > be included at all. Are you sure SQL was installed properly and all > (mod?) paths point into the right directions? I saw some changes > recently related to monet_mod_path... I update all my sources and now I do not have problems. I will tomorrow update the HowToStart. It should also include M5. ;) If someone does not agree please let me know. Thanks for the help. Regards, Romulo > > > > > ------------------------------ > > ------------------------------------------------------------------------- > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > > ------------------------------ > > _______________________________________________ > Monetdb-developers mailing list > Monetdb-developers(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-developers > > > End of Monetdb-developers Digest, Vol 6, Issue 14 > *************************************************

1 0

[Monetdb-developers] sql.start() is not reconized anymore.....
by Romulo Goncalves 09 Nov '06

09 Nov '06

Dear monetdb developers. After the last update in M5 from Martin I start to have the following problem: Starting program: /net/amelia/export/scratch1/goncalve/MonetDB/monetdb5/bin/mserver5 --dbname=demo --set mapi_port=50000 --dbinit=include\ sql\;\ clients.setTrace\(true\)\;\ sql.start\(\)\; [Thread debugging using libthread_db enabled] [New Thread 46912510627904 (LWP 3435)] !WARNING: GDKlockHome: created directory /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. !WARNING: BBPdir: initializing BBP. [New Thread 1082132832 (LWP 3438)] # MonetDB Server v4.99.19 # Copyright (c) 1993-2006 CWI, all rights reserved # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm # dbname:demo # Visit http://monetdb.cwi.nl/ for further information [New Thread 1090525536 (LWP 3439)] #MALexception:malInclude:could not open file: sql !ERROR: 'sql.start' undefined in user.main[2] _3:any := sql.start() > I am using M5 development trunk and the same for SQL. This changes related to sql.start() are to be applied in M4 and not in M5, right? Regards, Romulo

3 2

[Monetdb-developers] Mserver including SQL module....
by Romulo Goncalves 09 Nov '06

09 Nov '06

Dear developers. I checked out the last SQL version. I start a mserver including the SQL module with the following alias: > gdb --args ~/scratch/MonetDB/monetdb5/bin/mserver5 --dbname=demo --set mapi_port=50000 --dbinit="module(sql_server); clients.setTrace(true);" and I got this error: > [Thread debugging using libthread_db enabled] > [New Thread 46912510627904 (LWP 13853)] > !WARNING: GDKlockHome: created directory /ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm/demo/ > !WARNING: GDKlockHome: ignoring empty or invalid .gdk_lock. > !WARNING: BBPdir: initializing BBP. > [New Thread 1082132832 (LWP 13856)] > # MonetDB Server v4.99.19 > # Copyright (c) 1993-2006 CWI, all rights reserved > # Compiled for x86_64-redhat-linux-gnu/64bit with 64bit OIDs dynamically linked > # config:/ufs/goncalve/scratch/MonetDB/monetdb5/etc/MonetDB5.conf > # dbfarm:/ufs/goncalve/scratch/MonetDB/monetdb5/var/MonetDB5/dbfarm > # dbname:demo > # Visit http://monetdb.cwi.nl/ for further information > [New Thread 1090525536 (LWP 13857)] > !ERROR: module(sql_server); clients.setTrace(true); > ! ^<module path> expected >> There is something wrong with my alias? I used the example in the file HowToStart-SQL. Regards, Romulo

3 5

[Monetdb-developers] *start() functions
by Niels Nes 08 Nov '06

08 Nov '06

MonetDB developers As the pfstart() is now depricated, it might be a good moment to say goodbye to all these *start functions. We could simply start mapi by default in the mapi module (local or remote connections should be controlled by an monetdb env var then). Any objects to push this cleanup through the release branch? Niels -- Niels Nes, Centre for Mathematics and Computer Science (CWI) Kruislaan 413, 1098 SJ Amsterdam, The Netherlands room C0.02, phone ++31 20 592-4098, fax ++31 20 592-4312 url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl

3 3

Re: [Monetdb-developers] Monetdb-developers Digest, Vol 6, Issue 12
by Peter Boncz 08 Nov '06

08 Nov '06

Hi Torsten, Because Jens pointed put possible amiguities in the lighter variant (in the general case of any destination expression), we had decided to let it as it was. It turns out that the braces actually complicate parsing in the light variant (with respect to no braces at all, which is unambiguous, for which I provided a 'tidy' patch, but to which Jens also objects to for reasons I still do not understand -- but frankly I have given up on arguing for). Personally, I find it confusing to allow leaving out braces sometimes but requiring them in other cases. So I had accepted the current situation, and (sorry to say) agree with Jennie that your change is no improvement. Notwithstanding the fact that I do appreciate your effort to help out. Peter

1 0

[Monetdb-developers] Compilation problems MonetDB <-> Pathfinder
by Jens Teubner 08 Nov '06

08 Nov '06

Hi all, after a fresh checkout and install of buildtools and MonetDB, I'm getting the following compilation error in the Pathfinder runtime module: /opt/buildtools/bin/mel -I. -I/opt/MonetDB/include/MonetDB -I/opt/MonetDB/include/MonetDB/common -I/opt/MonetDB/include/MonetDB/gdk -I/opt/MonetDB/include/MonetDB/monet -I/opt/MonetDB/include/MonetDB/plain -I/opt/MonetDB/include/MonetDB/contrib -I/opt/MonetDB/include/MonetDB/mapi -I/opt/MonetDB/include/MonetDB/C -I/usr/include/libxml2 -I../compiler/include -I./../compiler/include -proto /opt/MonetDB/include/MonetDB/plain/constant.m > /opt/MonetDB/include/MonetDB/plain/constant.proto.h /bin/sh: /opt/MonetDB/include/MonetDB/plain/constant.proto.h: Permission denied make[3]: *** [/opt/MonetDB/include/MonetDB/plain/constant.proto.h] Error 1 make[3]: Leaving directory `/home/teubner/pf/cvs-head/runtime' make[2]: *** [all] Error 2 make[2]: Leaving directory `/home/teubner/pf/cvs-head/runtime' make[1]: *** [all-recursive] Error 1 make[1]: Leaving directory `/home/teubner/pf/cvs-head' make: *** [all] Error 2 teubner@notekemper14:~/pf/cvs-head> man test It turns out that constant.m in the installation directory of MonetDB is (slightly) newer than constant.proto.h. (Touching the latter solved the problem here.) Two questions arise: (1) Why is constant.m newer than constant.proto.h anyway, given that the latter apparently depends on the former? (Note: I did *not* do any dirty tricks here, such as parallel builds or so.) (2) Why is there a dependency in the Pathfinder Makefiles that try to rebuild files outside the Pathfinder module? If I'm compiling code, I'm not expecting to pollute anything outside the respective build directories. Note that I had installed MonetDB under the superuser account and, hence, wasn't able to overwrite constant.proto.h. Otherwise, the file silently would have been overwritten. The problem certainly won't be easy to reproduce, as it depends on exact timestamps here. But there's something wrong in our build setup that allows such situations to occur at all. Jens -- Jens Teubner Technische Universitaet Muenchen, Department of Informatics D-85748 Garching, Germany Tel: +49 89 289-17259 Fax: +49 89 289-17263 Computers are like air conditioners: They stop working properly if you open windows.

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime serialize_dflt.mx, 1.19, 1.20 serialize_sax.mx, 1.8, 1.9
by Stefan Manegold 08 Nov '06

08 Nov '06

Jan, this as well as you previous checkin went to the development trunk, hence they will NOT be in the release! Stefan On Wed, Nov 08, 2006 at 09:48:26AM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs7.sourceforge.net:/tmp/cvs-serv20415/runtime > > Modified Files: > serialize_dflt.mx serialize_sax.mx > Log Message: > here comes the cleaning woman :) > > > Index: serialize_sax.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/serialize_sax.mx,v > retrieving revision 1.8 > retrieving revision 1.9 > diff -u -d -r1.8 -r1.9 > --- serialize_sax.mx 7 Nov 2006 17:02:35 -0000 1.8 > +++ serialize_sax.mx 8 Nov 2006 09:48:23 -0000 1.9 > @@ -166,7 +166,6 @@ > static bool > sax_init (XqueryCtx* ctx, char* args, char *restag) > { > - (void) ctx; > (void) args; > ctx->driverWs = (void *) restag; /* store result tag */ > sax_init_isspecial(); > @@ -180,8 +179,6 @@ > static bool > sax_handle_startDocument (XqueryCtx* ctx) > { > - (void)ctx; > - > if ( SAXOPHONE ) > return emit_SAX_header(ctx); > else > @@ -197,7 +194,6 @@ > static bool > sax_handle_endDocument (XqueryCtx* ctx) > { > - > if ( SAXOPHONE ) > return emit_SAX_footer(); > else > @@ -239,7 +235,6 @@ > static bool > sax_handle_endElement (XqueryCtx* ctx, str prefix, str name) > { > - > if ( SAXOPHONE ) { > if ( !emit_SAX_event(ctx, "endElement",NULL,0) ) > return PROBLEM; > > Index: serialize_dflt.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/serialize_dflt.mx,v > retrieving revision 1.19 > retrieving revision 1.20 > diff -u -d -r1.19 -r1.20 > --- serialize_dflt.mx 7 Nov 2006 17:02:35 -0000 1.19 > +++ serialize_dflt.mx 8 Nov 2006 09:48:23 -0000 1.20 > @@ -683,8 +683,6 @@ > static bool > xml_seqItemSeparator (XqueryCtx* ctx, int kind_before, int kind_after) > { > - (void)ctx; > - > if ((XTRACT_KIND(kind_before) < ATOMIC) && > (XTRACT_KIND(kind_after) < ATOMIC)) > stream_write (ctx->out, &s_, 1, 1); /* ' ' */ > @@ -747,7 +745,6 @@ > typed_xml_seqItemStart (XqueryCtx* ctx, int kind) > { > char *item_start = 0; > - (void)ctx; > > switch (XTRACT_KIND(kind)) { > case BOOL: > @@ -813,7 +810,6 @@ > typed_xml_seqItemEnd (XqueryCtx* ctx, int kind) > { > char *item_end = 0; > - (void)ctx; > > switch (XTRACT_KIND(kind)) { > case BOOL: > @@ -908,7 +904,6 @@ > soap_xml_seqItemEnd (XqueryCtx* ctx, int kind) > { > char *item_end = 0; > - (void)ctx; > > switch (XTRACT_KIND(kind)) { > case BOOL: > @@ -977,7 +972,6 @@ > static bool > seq_seqItemStart (XqueryCtx* ctx, int kind) > { > - (void)ctx; > (void)kind; > > /* SQL-ish mode: write start of tuple and open string */ > > > ------------------------------------------------------------------------- > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, 1.270, 1.271
by Stefan Manegold 08 Nov '06

08 Nov '06

FYI: Here's the status of `Mtest_pathfinder -r runtime/ testing/` of the CVS head at three timestamps: Tuesday, Nov 07 2006, 17:59 CET (tag information-functions_and_checkpointing-thread_before in pathfinder) 90 out of 665 tests produced SIGNIFICANTLY different output Tuesday, Nov 07 2006 23:59 CET (tag XQuery_0-14_root in pathfinder; identical with initial XQuery_0-14 release branch and tag information-functions_and_checkpointing-thread_after) 570 out of 665 tests produced SIGNIFICANTLY different output Wednesday, Nov 08 2006 9:00 CET (CVS head still/again idential with release branch) 417 out of 665 tests produced SIGNIFICANTLY different output Stefan On Wed, Nov 08, 2006 at 01:29:34AM +0000, Peter Boncz wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sc8-pr-cvs7.sourceforge.net:/tmp/cvs-serv5740 > > Modified Files: > pathfinder.mx > Log Message: > - fn:doc works sgain and that should clear up quite some tests in the testweb > > > > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.270 > retrieving revision 1.271 > diff -u -d -r1.270 -r1.271 > --- pathfinder.mx 8 Nov 2006 01:00:29 -0000 1.270 > +++ pathfinder.mx 8 Nov 2006 01:29:32 -0000 1.271 > @@ -63,7 +63,6 @@ > .END pathfinder; > @mil > if (clientid() != 0) { > - drop("_pathfinder"); > ERROR("pathfinder module must be loaded in Mserver console first."); > } > module(mapi); # remote client access > @@ -464,8 +463,30 @@ > .append("_qn_prefix_uri_loc") > .append("_qn_histogram"); > > +PROC pf_checkpoint(BAT[void,str] commitBAT) : bit > +{ > + if (count(commitBAT) = 0) return false; > + commitBAT := commitBAT.access(BAT_WRITE); > + commitBAT.append("xquery_catalog"); > + commitBAT.append("xquery_seqs"); > + commitBAT.append("xquery_snapshots"); > + commitBAT.append("collection_name"); > + commitBAT.append("collection_size"); > + commitBAT.append("doc_name"); > + commitBAT.append("doc_location"); > + commitBAT.append("doc_collection"); > + commitBAT.append("doc_timestamp"); > + commitBAT.append("uri_lifetime"); > + var ok := false; > + lock_set(pf_wal); > + CATCH(ok := subcommit(commitBAT)); > + lock_unset(pf_wal); > + if (not(ok)) ERROR("XQDY0062: checkpoint failed, query aborted.\n"); > + return true; > +} > + > # the logger background thread > -PROC xquery_logmanager() : void { > +PROC pf_logmanager() : void { > var cnt := 0; > while(true) { > if ((logger_changes(pf_logger) > 100000) and ((cnt :+= 1) <= 10)) { > @@ -478,7 +499,7 @@ > sleep(90); > } > } > -fork(xquery_logmanager()); > +fork(pf_logmanager()); > > # the set of document collections (may only be accessed holding pf_short) > var collection_name; # bat[oid,str] collection name > @@ -513,9 +534,8 @@ > doc_location := new(oid,str).persists(true).rename("doc_location"); > doc_timestamp := new(oid,timestamp).persists(true).rename("doc_timestamp"); > uri_lifetime := new(str,lng).persists(true).rename("uri_lifetime"); > -} > -if (not(doc_collection.exist(TEMP_DOC))) { > doc_collection.insert(TEMP_DOC, DOCID_MIN); # hack: store next oid as in invalid TEMP_DOC tuple > + pf_checkpoint(bat(void,str).append("uri_lifetime")); > } > > # runtime collection acccess control (TRANSIENT) > @@ -1819,39 +1839,6 @@ > } > > > -@- commit stuff > - > -Update queries use the WAL for committing their changes rapidly in a single bulk I/O. > -They leave the modified master BATs dirty. > - > -A checkpointing mechanism flushes the BATs to disk periodically (or forced when under > -memory pressure -- but performance-wise it is better to do it pro-actively). > - > -The shredding of new documents uses checkpointing (i.e. direct flush and no WAL) > -directly. This is a reason why update-queries may not contain fn:add_doc() or fn:del_doc() > -statements; such queries would need two different kinds of commits, making them non-atomic. > -@mil > -PROC pf_checkpoint(BAT[void,str] commitBAT) : bit > -{ > - if (count(commitBAT) = 0) return false; > - commitBAT := commitBAT.access(BAT_WRITE); > - commitBAT.append("xquery_catalog"); > - commitBAT.append("xquery_seqs"); > - commitBAT.append("xquery_snapshots"); > - commitBAT.append("collection_name"); > - commitBAT.append("collection_size"); > - commitBAT.append("doc_name"); > - commitBAT.append("doc_location"); > - commitBAT.append("doc_collection"); > - commitBAT.append("doc_timestamp"); > - commitBAT.append("uri_lifetime"); > - var ok := false; > - lock_set(pf_wal); > - CATCH(ok := subcommit(commitBAT)); > - lock_unset(pf_wal); > - if (not(ok)) ERROR("XQDY0062: checkpoint failed, query aborted.\n"); > - return true; > -} > > > @- adding documents > @@ -2147,9 +2134,9 @@ > oid coll_oid, > BAT[lock,bat] runtime, > oid docid_base, > - bit doCommit, > lng pageFree, > timestamp ts, > + bit doCommit, > Stream s, > lng wsid) : oid > { > @@ -2266,7 +2253,7 @@ > shred_into_docBAT(docBAT, > idx.leftfetchjoin(idx_locations), > idx.leftfetchjoin(idx_names), > - colname, coll_oid, runtime, oid_nil, true, percentage, timestamp_nil, s, wsid); > + colname, coll_oid, runtime, oid_nil, percentage, timestamp_nil, true, s, wsid); > > if (isnil(coll_oid)) { > # register new bats with the logger > > > ------------------------------------------------------------------------- > Using Tomcat but need to do more? Need to support web services, security? > Get stuff done quickly with pre-integrated technology to make your job easier > Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo > http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0