- developers-list - monetdb.org

[Monetdb-developers] Does Monetdb support Chinese?
by ding_guangfu＠topsec.com.cn 07 Nov '07

07 Nov '07

As Title. Thanks.

2 1

[Monetdb-developers] MAPI wire protocol?
by Tim Gebhardt 07 Nov '07

07 Nov '07

Hello, I'm working on a C#/.NET client library to connect to a MonetDB server. I've mapped most of the libMapi.dll api calls so that I can call the C library from .NET but this presents a few problems: 1. There's a performance penalty to interface native code libraries to .NET 2. There's a lot of overhead of marshaling UTF8 strings between .NET and the C library, and potential problems with NULL parameters. 3. There's a portability problem with using the native libraries (trouble deploying to the Mono runtime) I think the client library would be better off implementing the MAPI wire protocol rather than interfacing with the C library, but I cannot find any documents that detail the protocol. Is there somewhere this is published, or did I just not Google the right stuff? Also if anyone is interested in giving me a hand you can find the Google Code workspace of the aforementioned project at this link: http://code.google.com/p/monetdb-net/ -Tim Gebhardt tim(a)gebhardtcomputing.com

3 2

Re: [Monetdb-developers] [Monetdb-checkins] clients/src/php/Cimpl Makefile.ag, Clients_1-20, 1.4.4.1, 1.4.4.2
by Fabian Groffen 06 Nov '07

06 Nov '07

On 06-11-2007 11:55:48 +0000, Stefan Manegold wrote: > since compilation with strict compiler settings have (once again) > proved to be bery useful to locate bugs in the code, > we nolonger simply disable all of the strict "X_CFLAGS" > in directories that (also) contain swig-code, > but rather selectively disable only those extra warnings/errors > that do indeed occur in code that is beyond our control. > > (This affects only compilation with --enable-strict.) ... > +CFLAGS = $(GCC_SWIG_CFLAGS) $(ICC_SWIG_CFLAGS) -DCOMPILE_DL_MONETDB=1 -D_GNU_SOURCE Unless I misunderstood the code in the .m4, this looks like the user specified CFLAGS are overriden here, which is an undesirable effect.

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/src/tools/java build.properties, XQuery_0-20, 1.1.2.3, 1.1.2.4
by Fabian Groffen 01 Nov '07

01 Nov '07

On 01-11-2007 10:48:18 +0000, Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/src/tools/java > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv5671 > > Modified Files: > Tag: XQuery_0-20 > build.properties > Log Message: > Corrected value of the "compiler" attribute of <javac> [snip] > # which Java compiler to use, default: javac > -build_compiler=javac > +build_compiler=javac1.5 While the comment doesn't reflect a valid state here, this isn't too flexible. Why don't you just drop the whole build_compiler variable you introduced, and use the completely transparent and well supported and usually expected build.compiler variable only once you really want to control what compiler is being used, as I suggested to you earlier?

4 6

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/src/tools/java build.properties, XQuery_0-20, 1.1.2.4, 1.1.2.5 build.xml, XQuery_0-20, 1.1.2.4, 1.1.2.5
by Sjoerd Mullender 01 Nov '07

01 Nov '07

Ying Zhang wrote: > diff -u -d -r1.1.2.4 -r1.1.2.5 > --- build.properties 1 Nov 2007 10:48:16 -0000 1.1.2.4 > +++ build.properties 1 Nov 2007 12:49:25 -0000 1.1.2.5 > @@ -14,4 +14,5 @@ > javac_version=1.5 > > # which Java compiler to use, default: javac > -build_compiler=javac1.5 > +build.compiler=javac1.5 > + > Do we really need this property? Isn't the default good enough? Won't still this require Sun Java (since you mentioned you tried it with value gcj to compile using gcj)? If so, then that isn't good enough. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/src/tools/java build.properties, XQuery_0-20, 1.1.2.2, 1.1.2.3 build.xml, XQuery_0-20, 1.1.2.3, 1.1.2.4
by Fabian Groffen 31 Oct '07

31 Oct '07

On 30-10-2007 22:33:56 +0000, Ying Zhang wrote: > Added a new variable in build.properties (build_compiler) to make > compiler switching easier. http://ant.apache.org/manual/CoreTasks/javac.html <quote> It is possible to use different compilers. This can be specified by either setting the global build.compiler property, which will affect all <javac> tasks throughout the build, or by setting the compiler attribute, specific to the current <javac> task. Valid values for either the build.compiler property or the compiler attribute are: </quote> In other words, don't do what you just did. Just rely on standard behaviour, and set build.compiler in your build.properties to gcj if you want to build with gcj.

2 2

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra intro_rec_border.c, XQuery_0-20, 1.5, 1.5.4.1
by Stefan Manegold 30 Oct '07

30 Oct '07

On Mon, Oct 29, 2007 at 10:00:19AM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv15130/algebra > > Modified Files: > Tag: XQuery_0-20 > intro_rec_border.c > Log Message: > -- Fix a bug for recursive queries detected by Maurice. which one? and should it (the bug, resp. its fix) be tested? Stefan > Index: intro_rec_border.c > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/algebra/intro_rec_border.c,v > retrieving revision 1.5 > retrieving revision 1.5.4.1 > diff -u -d -r1.5 -r1.5.4.1 > --- intro_rec_border.c 27 Jun 2007 13:46:26 -0000 1.5 > +++ intro_rec_border.c 29 Oct 2007 10:00:16 -0000 1.5.4.1 > @@ -95,6 +95,13 @@ > } > break; > > + case pa_fcns: > + /* this also skips the introduction of a rec_border > + operator for the content of an empty elements: > + elem (fcns (nil, nil)). */ > + if (R(n)->kind == pa_nil) > + break; > + /* else fall through */ > default: > /* follow the children until a base or a leaf is reached */ > for (unsigned int i = 0; i < PFPA_OP_MAXCHILD && n->child[i]; i++) > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > > > > > > > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/mal mal_builder.mx, MonetDB_5-2, 1.26, 1.26.2.1
by Stefan Manegold 29 Oct '07

29 Oct '07

On Mon, Oct 29, 2007 at 07:09:42AM +0000, Niels Nes wrote: > Update of /cvsroot/monetdb/MonetDB5/src/mal > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv18604/src/mal > > Modified Files: > Tag: MonetDB_5-2 > mal_builder.mx > Log Message: > pushStr shouldn't do a GDKstrdup, as it may return an equal string from > the constant cache, ie only if the returned variable holds the given string > (poniters are equal) we do a string dup. This solves another memory leak. > > > Index: mal_builder.mx > =================================================================== > RCS file: /cvsroot/monetdb/MonetDB5/src/mal/mal_builder.mx,v > retrieving revision 1.26 > retrieving revision 1.26.2.1 > diff -u -d -r1.26 -r1.26.2.1 > --- mal_builder.mx 28 Aug 2007 19:56:41 -0000 1.26 > +++ mal_builder.mx 29 Oct 2007 07:09:40 -0000 1.26.2.1 > @@ -260,10 +260,12 @@ > ValRecord cst; > > cst.vtype= TYPE_str; > - cst.val.sval= GDKstrdup(val); > + cst.val.sval= val; gcc -DHAVE_CONFIG_H -I. -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal -I../.. -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal -I../optimizer -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal/../optimizer -I../scheduler -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal/../scheduler -I../modules/kernel -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal/../modules/kernel -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/prefix.--enable-strict_--disable-optimize_--enable-debug_--enable-assert/include/MonetDB -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/prefix.--enable-strict_--disable-optimize_--enable-debug_--enable-assert/include/MonetDB/common -I/ufs/manegold/_/scratch0/Monet/Testing/Stable/prefix.--enable-strict_--disable-optimize_--enable-debug_--enable-assert/include/MonetDB/gdk -DLIBMAL -Wall -Wextra -std=c99 -g -Werror-implicit-function-declaration -Werror -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wp,-D_FORTIFY_SOURCE=2 -D_REENTRANT -c mal_builder.c -fPIC -DPIC -o .libs/libmal_la-mal_builder.o cc1: warnings being treated as errors /ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal/mal_builder.mx: In function 'pushStr': /ufs/manegold/_/scratch0/Monet/Testing/Stable/source/MonetDB5/src/mal/mal_builder.mx:263: warning: assignment discards qualifiers from pointer target type make[5]: *** [libmal_la-mal_builder.lo] Error 1 Stefan > cst.len= strlen(cst.val.sval); > _t = defConstant(mb,TYPE_str,&cst); > > + if (getConstant(mb,_t).val.sval == val) > + getConstant(mb,_t).val.sval = GDKstrdup(val); > return pushArgument(mb, q, _t); > } > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by: Splunk Inc. > Still grepping through log files to find problems? Stop. > Now Search log events and configuration files using AJAX and a browser. > Download your FREE copy of Splunk now >> http://get.splunk.com/ > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

3 4

[Monetdb-developers] MonetDB(5) and modules
by Fabian Groffen 26 Oct '07

26 Oct '07

I noticed that MonetDB5 uses modules, but compiles them as shared libraries. Maybe other targets do the same here. autogen appears to have (had) some partial support for modules, and the attached patch fixes/re-enables that support. In short it passes -module to libtool during link phase, such that the object is generated as loadable module. Why did I look at this? Mainly because on Darwin there is a difference between those objects that are loaded by dlopen(3) (loadable modules) and those that are used by the link editor ld(1) (shared libraries). The latter have type DYLIB whereas the former have type MH_BUNDLE. A so-called "bundle" doesn't have an install_name, as it can't be used by the link editor. Now initially all went well during compilation until I hit this error: /Library/Gentoo/usr/bin/ld: ../atoms/.libs/lib_color.so is input for the dynamic link editor, is not relocatable by the static link editor again This message is correct on Darwin, as batcolor.mx links against lib_color.so. libtool already detected this case: *** Warning: Linking the shared library lib_batcolor.la against the loadable module *** lib_color.so is not portable! ** Warning, lib lib_color.so is a module, not a shared library ** And there doesn't seem to be a static archive available ** The link will probably fail, sorry I don't recall ever seeing problems with these loads (apart from on Panther which didn't grok it at all) on my (as of today out-of-date) OSX 10.4, so I'm not sure how relevant it is to actually fix this. It looks like support to load shared libraries via dlopen actually was added, so we need not to worry about it at all. Actually, the man-page says it all: "dlopen() can load dynamic libraries and bundles." "In Mac OS X 10.4, dlopen was rewritten to be a native part of dyld." So far for sharing my experiences in this area. As far as I know, 10.3 support for MonetDB was shot already long ago (as it should), so maybe we should remove the remaining bits that could/can trigger -module libtool invocation, as it *will* cause trouble.

1 0

[Monetdb-developers] problems with XQuery aggregation
by Henning Rode 25 Oct '07

25 Oct '07

hej monetdb developers, i tried to write a simple aggregation query: let $cands := doc("x.xml")//c for $eid in distinct-values($cands/@id) return <candidate id="{$eid}" count="{count($cands[@id eq $eid])}"/> however, executing the above query turns out to be rather difficult. i always killed the process after waiting for more than half an hour without getting any result. x.xml is 17MB large and contains 300000 candidates nodes c. i run it on Monet Database Server V4.19.0 where the query crashed ERROR = !ERROR: GDKload: cannot mmap(): name=10/1030, ext=buns.priv !OS: Cannot allocate memory !ERROR: GDKload failed: name=10/1030, ext=buns.priv !ERROR: CMDleftjoin: operation failed. and on the newer stable release MonetDB Server v4.20.0 on a machine with 16GB memory where the query just runs endless. apparently the query compiler does not recognise the necessary join and aggregation here. is that a known problem? btw. sorting the candidates by @id value is done in seconds: let $cands := doc("x.xml")//c for $c in $cands order by $c/@id return $c best -henning

3 4