- developers-list - monetdb.org

[Monetdb-developers] Build MonetDB on Linux
by zhangyuan 06 Feb '10

06 Feb '10

I'm trying to build MonetDB default branch(HEAD) on Linux, and I have built buildtools, but when I go on with MonetDB, I met some trouble. When run the ./bootstrap under /MonetDB directory, it produces the following errors: [root@node1 MonetDB]# ./bootstrap automake 1.5 is 1.5 or newer. OK, unless you want to compile with Intel's icc (on Linux), which requires automake 1.7 or newer. autoconf 2.60 is 2.57 or newer. Good. libtool 1.5 is 1.4 or newer. Good. Python 2.5.1 is 2.0.0 or newer. Good. /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src /root/monetDB/MonetDB/MonetDB/src /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src/common /root/monetDB/MonetDB/MonetDB/src/common /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/src/gdk /root/monetDB/MonetDB/MonetDB/src/gdk /root/monetDB/MonetDB/MonetDB /root/monetDB/MonetDB/MonetDB/conf /root/monetDB/MonetDB/MonetDB/conf /root/monetDB/MonetDB/MonetDB You should add the contents of `/usr/local/share/aclocal/libtool.m4' to `aclocal.m4'. Putting files in AC_CONFIG_AUX_DIR, `conf'. aclocal: configure.in: 63: macro `AM_MONETDB_XQ_VARS_1' not found in library aclocal: configure.in: 66: macro `AM_MONETDB_DEFAULTS' not found in library aclocal: configure.in: 69: macro `AM_MONETDB_COMPILER' not found in library aclocal: configure.in: 70: macro `AM_MONETDB_TOOLS' not found in library aclocal: configure.in: 71: macro `AM_MONETDB_OPTIONS' not found in library aclocal: configure.in: 72: macro `AM_MONETDB_UTILS' not found in library aclocal: configure.in: 85: macro `AM_MONETDB_LIBS' not found in library aclocal: configure.in: 119: macro `AM_MONETDB_XQ_VARS_2' not found in library [root@node1 MonetDB]# I must be doing something wrong, but I can't figure out the problem. Any help would be appreciated. 2010-02-06 zhangyuan

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/server rel_schema.mx, Feb2010, 1.2, 1.2.2.1
by Wouter Alink 05 Feb '10

05 Feb '10

fantastisch! 2010/2/5 Niels Nes <nielsnes(a)users.sourceforge.net>: > Update of /cvsroot/monetdb/sql/src/server > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv25790/src/server > > Modified Files: > Tag: Feb2010 > rel_schema.mx > Log Message: > fixed bug in handeling topn in create table as select with data. > > > > Index: rel_schema.mx > =================================================================== > RCS file: /cvsroot/monetdb/sql/src/server/rel_schema.mx,v > retrieving revision 1.2 > retrieving revision 1.2.2.1 > diff -u -d -r1.2 -r1.2.2.1 > --- rel_schema.mx 11 Jan 2010 10:29:17 -0000 1.2 > +++ rel_schema.mx 5 Feb 2010 10:18:16 -0000 1.2.2.1 > @@ -127,9 +127,14 @@ > static char * > as_subquery( mvc *sql, sql_table *t, sql_rel *sq, dlist *column_spec ) > { > + sql_rel *r = sq; > + > + if (is_topn(r->op)) > + r = sq->l; > + > if (column_spec) { > dnode *n = column_spec->h; > - node *m = sq->exps->h; > + node *m = r->exps->h; > > for (; n; n = n->next, m = m->next) { > char *cname = n->data.sval; > @@ -143,7 +148,7 @@ > } else { > node *m; > > - for (m = sq->exps->h; m; m = m->next) { > + for (m = r->exps->h; m; m = m->next) { > sql_exp *e = m->data; > char *cname = exp_name(e); > sql_subtype *tp = exp_subtype(e); > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-sql-checkins mailing list > Monetdb-sql-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-sql-checkins > >

2 1

[Monetdb-developers] How to know the database size and use indexes?
by Mo Zhou 04 Feb '10

04 Feb '10

Hi, I wonder if there is a way to get the size of a database (SQL/XQuery)? And I wonder if I can ask MonetDB (SQL/XQuery) to use a specific index explicitly? -- Thanks, Mo

2 3

[Monetdb-developers] build MonetDB on linux
by zhangyuan 03 Feb '10

03 Feb '10

Dear Sir/Madam, I want to compile and install from CVS source on Linux,but when I build buildtools with "./bootstrap" have an error as "can't find the file or directory".I have set up the shell environment. look forward to your feedbacds and suggestios soon! Thank you! 2010-02-03 zhangyuan

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests fbterms.xq, , NONE, 1.1 All, , 1.14, 1.15 procs.stable.out, , 1.62, 1.63
by Stefan Manegold 03 Feb '10

03 Feb '10

Henning, could you please also provide / approved the expected/correct stable output for your new test? Thanks! Stefan On Wed, Jan 06, 2010 at 01:59:11PM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv7682/Tests > > Modified Files: > All procs.stable.out > Added Files: > fbterms.xq > Log Message: > added implementation for tijah:fb-terms() > > the current implementation follows the divergation minimization approach of > zhai and lafferty to find the best feeback terms. > > used parameters: returnNumber and collection-lambda. > > > > Index: All > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/All,v > retrieving revision 1.14 > retrieving revision 1.15 > diff -u -d -r1.14 -r1.15 > --- All 22 Dec 2009 11:47:23 -0000 1.14 > +++ All 6 Jan 2010 13:59:09 -0000 1.15 > @@ -43,4 +43,5 @@ > tf2 > tfall > terms_tf > +fbterms > cleanup > > Index: procs.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/modules/pftijah/Tests/procs.stable.out,v > retrieving revision 1.62 > retrieving revision 1.63 > diff -u -d -r1.62 -r1.63 > --- procs.stable.out 22 Dec 2009 11:47:23 -0000 1.62 > +++ procs.stable.out 6 Jan 2010 13:59:09 -0000 1.63 > @@ -738,6 +738,7 @@ > [ "tj_dump_collection(str) : void" ] > [ "tj_ent2tid(BAT[str,dbl]) : BAT[oid,dbl]" ] > [ "tj_extend_collection(str, BAT[void,str]) : void" ] > +[ "tj_fb_terms(str, BAT[int,BAT], int, dbl) : BAT[void,str]" ] > [ "tj_get_collection_lock(str) : lock" ] > [ "tj_get_ft_index(BAT[str,str], bit) : str" ] > [ "tj_global_delete() : void" ] > > --- NEW FILE: fbterms.xq --- > let $d := pf:collection("thesis.xml") > let $opt1 := <TijahOptions ft-index="porter" returnNumber="4"/> > let $opt2 := <TijahOptions ft-index="snowball" returnNumber="4"/> > let $opt3 := <TijahOptions ft-index="nostem" returnNumber="4"/> > let $opts := ($opt1, $opt2, $opt3) > return <res> > { > for $opt in $opts > for $e in $d//section > return <bubble stemming="{$opt/@ft-index}"> { tijah:fb-terms($e, $opt) } > </bubble> > } > </res> > > > ------------------------------------------------------------------------------ > This SF.Net email is sponsored by the Verizon Developer Community > Take advantage of Verizon's best-in-class app development support > A streamlined, 14 day to market process makes app distribution fast and easy > Join now and get one step closer to millions of Verizon customers > http://p.sf.net/sfu/verizon-dev2dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/modules/pftijah/Tests options_test.xq.in, , NONE, 1.1 terms2.xq, , NONE, 1.1 terms3.xq, , NONE, 1.1 terms4.xq, , NONE, 1.1 terms_tf.xq, , NONE, 1.1 tf1.xq, , NONE, 1.1 tf2.xq, , NONE, 1.1 tfall.xq, , NONE, 1.1
by Stefan Manegold 03 Feb '10

03 Feb '10

Henning, could you please also provide / approved the expected/correct stable output for your new tests? Thanks! Stefan On Tue, Dec 22, 2009 at 11:49:07AM +0000, Henning Rode wrote: > Update of /cvsroot/monetdb/pathfinder/modules/pftijah/Tests > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv29234 > > Added Files: > options_test.xq.in terms2.xq terms3.xq terms4.xq terms_tf.xq > tf1.xq tf2.xq tfall.xq > Log Message: > adding test cases for new functions > > > > --- NEW FILE: tfall.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $e := $d//thesis > for $s in ("XML","Tijah","Pathfinder") > return (tijah:tf-all($s, $opt), tijah:tf($e, $s, $opt)) > > --- NEW FILE: terms4.xq --- > let $d := pf:collection("thesis.xml") > let $opt1 := <TijahOptions ft-index="porter"/> > let $opt2 := <TijahOptions ft-index="snowball"/> > let $opt3 := <TijahOptions ft-index="nostem"/> > let $opts := ($opt1, $opt2, $opt3) > return <res> > { > for $opt in $opts > for $e in $d//section > return <section stemming="{$opt/@ft-index}"> { tijah:terms($e, $opt) } > </section> > } > </res> > > --- NEW FILE: tf1.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $e := $d//section > for $s in ("XML","Tijah") > return tijah:tf($e, $s, $opt) > > --- NEW FILE: tf2.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > let $s := "XML" > for $e in $d//section > return tijah:tf($e, $s, $opt) > > --- NEW FILE: terms_tf.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions stemmedterms="true" ft-index="snowball"/> > return <terms> > { > for $e at $r in $d//section > return <section num="{$r}"> > { > for $t in tijah:terms($e, $opt) > return <term name="{$t}"> {tijah:tf($e, $t, $opt)} </term> > } > </section> > } > </terms> > > --- NEW FILE: options_test.xq.in --- > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="porter" > tokenizer="fast" > stemmer="porter-english" > /> > ) > <> > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="snowball" > stemmer="snowball-english" > /> > ) > <> > tijah:create-ft-index( > ("thesis.xml"), > <TijahOptions > ft-index="nostem" > /> > ) > > > --- NEW FILE: terms3.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > return <res> > { > for $e in $d//section > return <section> { tijah:terms($e, $opt) } > </section> > } > </res> > > --- NEW FILE: terms2.xq --- > let $d := pf:collection("thesis.xml") > let $opt := <TijahOptions ft-index="snowball"/> > return tijah:terms($d//section, $opt) > > > ------------------------------------------------------------------------------ > This SF.Net email is sponsored by the Verizon Developer Community > Take advantage of Verizon's best-in-class app development support > A streamlined, 14 day to market process makes app distribution fast and easy > Join now and get one step closer to millions of Verizon customers > http://p.sf.net/sfu/verizon-dev2dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

[Monetdb-developers] problems in windows intallation
by zhangyuan 01 Feb '10

01 Feb '10

Dear Sir/Madam, I want to build MonetDB on Windows.I have download "MonetDB-Nov2009-SuperBall-SP2.tar.bz2" and have carefully checked the FAQ and installation guide. I do as the follow website said: http://monetdb.cwi.nl/SQL/Documentation/Windows-Installation.html, but failed to installed; otherwise,I couldt't find the folder "buildtools"and the file "configure.gy" etc. look forward to your feedbacds and suggestios soon! Thank you! Sincerely, yuan zhang zhangyuan(a)dameng.com

3 2

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_storage.mx, Feb2010, 1.149.2.6, 1.149.2.7
by Stefan Manegold 01 Feb '10

01 Feb '10

On Mon, Feb 01, 2010 at 08:03:42AM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv3139 > > Modified Files: > Tag: Feb2010 > gdk_storage.mx > Log Message: > Difference between free and size often too high to justify pre-read. ;-) > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.6 > retrieving revision 1.149.2.7 > diff -u -d -r1.149.2.6 -r1.149.2.7 > --- gdk_storage.mx 31 Jan 2010 16:43:27 -0000 1.149.2.6 > +++ gdk_storage.mx 1 Feb 2010 08:02:57 -0000 1.149.2.7 > @@ -709,25 +709,25 @@ > > if ( b->T->vheap && b->T->vheap->base && pages){ > IODEBUG THRprintf(GDKout,"#BATpreloaded(%s): T->vheap\n", BATgetId(b)); > - limit = (size_t *) (b->T->vheap->base + b->T->vheap->size); > + limit = (size_t *) (b->T->vheap->base + b->T->vheap->free); > for ( i = (size_t *) b->T->vheap->base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > if ( b->T->heap.base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->heap\n", BATgetId(b)); > - limit = (size_t *) (b->T->heap.base + b->T->heap.size); > + limit = (size_t *) (b->T->heap.base + b->T->heap.free); > for ( i = (size_t *) b->T->heap.base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > if ( b->H->heap.base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->heap\n", BATgetId(b)); > - limit = (size_t *) (b->H->heap.base + b->H->heap.size); > + limit = (size_t *) (b->H->heap.base + b->H->heap.free); > for ( i = (size_t *) b->H->heap.base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > if ( b->H->vheap && b->H->vheap->base && pages ){ > IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > - limit = (size_t *) (b->H->vheap->base + b->H->vheap->size); > + limit = (size_t *) (b->H->vheap->base + b->H->vheap->free); > for ( i = (size_t *) b->H->vheap->base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB/src/gdk gdk_storage.mx, Feb2010, 1.149.2.5, 1.149.2.6
by Stefan Manegold 31 Jan '10

31 Jan '10

On Sun, Jan 31, 2010 at 04:43:29PM +0000, Martin Kersten wrote: > Update of /cvsroot/monetdb/MonetDB/src/gdk > In directory sfp-cvsdas-1.v30.ch3.sourceforge.com:/tmp/cvs-serv28035 > > Modified Files: > Tag: Feb2010 > gdk_storage.mx > Log Message: > A pity that the first code was not properly checked, because it did not > even tried to force the preload by memory touching properly. > As per request (though admittedly belated ...): Wouldn't it be sufficient (and faster and less memory consuming) to preload only that part of the heaps that is indeed used (i.e., holds useful/relevant data) instead of preloading the whole (possibly consciously over-allocated) heaps? I.e., replacing ...heap->size by ...heap->free (as it was in the original code, only that the original code incorrecly assumed ...heap->free to be an absolute address instead of a relative byte offset ...) Stefan > > Index: gdk_storage.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB/src/gdk/gdk_storage.mx,v > retrieving revision 1.149.2.5 > retrieving revision 1.149.2.6 > diff -u -d -r1.149.2.5 -r1.149.2.6 > --- gdk_storage.mx 31 Jan 2010 15:50:19 -0000 1.149.2.5 > +++ gdk_storage.mx 31 Jan 2010 16:43:27 -0000 1.149.2.6 > @@ -703,28 +703,32 @@ > @c > size_t > BATpreload_(BAT *b) { > - size_t dummy = 0, *i; > + size_t dummy = 0, *i, *limit; > size_t step = MT_pagesize()/sizeof(size_t); > size_t pages = (size_t) (0.8 * MT_npages()); > > - if ( b->T->vheap && b->T->vheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->vheap\n", BATgetId(b)); > - for ( i = (size_t *) b->T->vheap->base; i < (size_t *) b->T->vheap->free && pages > 0; i+= step, pages--) > + if ( b->T->vheap && b->T->vheap->base && pages){ > + IODEBUG THRprintf(GDKout,"#BATpreloaded(%s): T->vheap\n", BATgetId(b)); > + limit = (size_t *) (b->T->vheap->base + b->T->vheap->size); > + for ( i = (size_t *) b->T->vheap->base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > - if ( b->H->vheap && b->H->vheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > - for ( i = (size_t *) b->H->vheap->base; i < (size_t *) b->H->vheap->free && pages > 0 ; i+= step, pages--) > + if ( b->T->heap.base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): T->heap\n", BATgetId(b)); > + limit = (size_t *) (b->T->heap.base + b->T->heap.size); > + for ( i = (size_t *) b->T->heap.base; i < limit && pages > 0; i+= step, pages--) > dummy += *i; > } > - if ( b->hheap && b->hheap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): hheap\n", BATgetId(b)); > - for ( i = (size_t *) b->hheap->base; i < (size_t *)b->hheap->free && pages > 0 ; i+= step, pages--) > + if ( b->H->heap.base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->heap\n", BATgetId(b)); > + limit = (size_t *) (b->H->heap.base + b->H->heap.size); > + for ( i = (size_t *) b->H->heap.base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > - if ( b->theap && b->theap->base ){ > - IODEBUG THRprintf(GDKout,"#BATpreload(%s): theap\n", BATgetId(b)); > - for ( i = (size_t *) b->theap->base; i < (size_t *) b->theap->free && pages > 0; i+= step, pages--) > + if ( b->H->vheap && b->H->vheap->base && pages ){ > + IODEBUG THRprintf(GDKout,"#BATpreload(%s): H->vheap\n", BATgetId(b)); > + limit = (size_t *) (b->H->vheap->base + b->H->vheap->size); > + for ( i = (size_t *) b->H->vheap->base; i < limit && pages > 0 ; i+= step, pages--) > dummy += *i; > } > return dummy; > > > ------------------------------------------------------------------------------ > The Planet: dedicated and managed hosting, cloud storage, colocation > Stay online with enterprise data centers and the best network in the business > Choose flexible plans and management services without long-term contracts > Personal 24x7 support from experience hosting pros just a phone call away. > http://p.sf.net/sfu/theplanet-com > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

[Monetdb-developers] How to not print on screen?
by Mo Zhou 29 Jan '10

29 Jan '10

Hi, I wonder if there is a way to not print query results on screen? -- Thanks, Mo

4 5