April 2010 - developers-list

[Monetdb-developers] Mapi query parameter constness
by Isidor Zeuner 09 Apr '10

09 Apr '10

Dear MonetDB developers, as I have been working on interfacing Mapi to C++ in a manner as lightweight as possible, I have noticed that the parameter binding interface does not interface to STL strings as seamlessly as it probably could. Similar considerations might well apply to other C-based string APIs: The STL string API provides accessor functions to the string's char data and its size. To ensure secure programming, the pointer to the char data has to be const. Yet, the Mapi interface for passing string parameters expects a writable char pointer. I'm not sure how future plans for Mapi look like, but currently thsi doesn't seem necessary to me. I have attached a patch to have Mapi treat the data as const, which works well for me. I also noticed that Mapi expects the string size parameter to be passed by reference. Is this necessary? Having an interface which supports pass-by-value would facilitate string API integration even more. Best regards, Isidor

1 0

Re: [Monetdb-developers] [Monetdb-checkins] clients/src Makefile.ag, , 1.17, 1.18
by Stefan Manegold 09 Apr '10

09 Apr '10

On Fri, Apr 09, 2010 at 10:28:06AM +0000, Fabian wrote: > Update of /cvsroot/monetdb/clients/src > In directory sfp-cvsdas-4.v30.ch3.sourceforge.com:/tmp/cvs-serv15735/src > > Modified Files: > Makefile.ag > Log Message: > don't try to compile ODBC if configure already concluded it won't fly, or if the user actually requested it not to be built Am I right that on system where configure is not available (read: Windows), we'll now have to set HAVE_UNIXODBC (provided we do have ODBC) "by hand" to have odbc compiled on such system(s)? Stefan > Index: Makefile.ag > =================================================================== > RCS file: /cvsroot/monetdb/clients/src/Makefile.ag,v > retrieving revision 1.17 > retrieving revision 1.18 > diff -u -d -r1.17 -r1.18 > --- Makefile.ag 7 Jan 2010 15:24:16 -0000 1.17 > +++ Makefile.ag 9 Apr 2010 10:28:04 -0000 1.18 > @@ -15,4 +15,4 @@ > # Copyright August 2008-2010 MonetDB B.V. > # All Rights Reserved. > > -SUBDIRS = mapilib mapiclient odbc HAVE_PERL?perl php HAVE_PYTHON?python HAVE_RUBYGEM?ruby examples HAVE_MAPILITE?mapilite > +SUBDIRS = mapilib mapiclient HAVE_UNIXODBC?odbc HAVE_PERL?perl php HAVE_PYTHON?python HAVE_RUBYGEM?ruby examples HAVE_MAPILITE?mapilite > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-checkins mailing list > Monetdb-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-checkins > > > > > > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4199 |

2 1

[Monetdb-developers] other optimizer pipelines
by Wouter Alink 09 Apr '10

09 Apr '10

Dear M5 developers, Yesterday I reported a bug regarding the minimal optimizer pipe (ID: 2983773). And, as expected, I was asked to add a test for the issue, which I would like to do. The bug is triggered as follows: - start an mserver5 instance with the optimizer pipe set to the minimal pipe: "inline,remap,deadcode,multiplex" - connect with an mclient - connect again with an mclient This is obviously very easy to reproduce. But, I couldn't find any other test that sets a different optimizer upon startup of the mserver. I found a few tests that change the optimizer within a SQL script, but this will very likely not trigger bug (ID: 2983773). Then I was wondering; there are currently a few different optimizer pipelines defined in the monetdb5.conf. Isn't it a good idea to run at least a few (preferrably all) tests for each of those optimizer pipelines? I can imagine that testing all optimizer pipelines will take too much time for nightly testing, but running the testweb with different pipelines would probably trigger most obvious bugs that are currently found one-by-one. Bug #2983773 would most probably have been detected too. Anyway, I would like to add a test, and I guess testing multiple optimizer pipelines won't be high on the priority list. Therefore, could somebody perhaps point out how I could specify in the 'prologue' which optimizer pipeline to use? I did find a python file "sql/src/test/Connections/Tests/connections.py" which perhaps could be used? What is the preferred way for adding a test with a different optimizer path? Kind regards, Wouter

2 1

[Monetdb-developers] Compiler Mapi.h on windows
by Ken Kao 09 Apr '10

09 Apr '10

Deal all, I have to access data in MonetDB from C++ on windows , so I try to include Mapi.h and Mapi.c in my code . But Mapi.h must include many Linux header file (ex: unistd.h) . I can not Compiler my code after include Mapi.h and Mapi.c on windows. More seriously I can not access data in MonetDB from C++ on windows. If anyone had this experience . Please give me some suggestion to Solve the simple but big problem. Thank you very much!!

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime pathfinder.mx, Feb2010, 1.478.2.4, 1.478.2.5
by Ying Zhang 09 Apr '10

09 Apr '10

On Fri, Apr 09, 2010 at 11:15:08AM +0000, Sjoerd Mullender wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory sfp-cvsdas-4.v30.ch3.sourceforge.com:/tmp/cvs-serv30978 > > Modified Files: > Tag: Feb2010 > pathfinder.mx > Log Message: > leftfetchjoin may return a view (in this case on idx_timestamps), > preventing the replace on idx_timestamps later on. > This fixes the problem that > doc("http://...") > gives a "no such document" error. No need to add test for this. It is already included by several tests, e.g., WebSite/Tests/books1.xq WebSite/Tests/HelloWorld9.xq WebSite/Tests/books2.xq WebSite/Tests/slashdot2.xq WebSite/Tests/books3.xq WebSite/Tests/slashdot.xq WebSite/Tests/HelloWorldA.xq The testweb results (of the candidate branch) show that HelloWorld9.xq, HelloWorldA.xq and books1.xq fail with this error, *only* on Fedora10 G.64.64.d.0 Jennie > > > Index: pathfinder.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/pathfinder.mx,v > retrieving revision 1.478.2.4 > retrieving revision 1.478.2.5 > diff -u -d -r1.478.2.4 -r1.478.2.5 > --- pathfinder.mx 29 Mar 2010 10:38:24 -0000 1.478.2.4 > +++ pathfinder.mx 9 Apr 2010 11:15:06 -0000 1.478.2.5 > @@ -3284,7 +3284,7 @@ > > # for not-yet-cached URIs: get lifetime from uri_lifetime BAT > var idx_idx := idx_doc.ord_uselect(oid_nil).mirror(); > - var idx_ts := idx_idx.leftfetchjoin(idx_filenames).ord_uselect(str_nil).mirror().leftfetchjoin(idx_timestamps); > + var idx_ts := idx_idx.leftfetchjoin(idx_filenames).ord_uselect(str_nil).mirror().leftfetchjoin(idx_timestamps).copy(); > idx_ts@batloop() { # URI (filename = nil) > var b := [startsWith](idx_names.find($h), mirror(uri_lifetime)).uselect(true); > var lifetime := lng_nil; > > > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins

1 0

[Monetdb-developers] maximum column name length
by kss ram 08 Apr '10

08 Apr '10

Hello, i am just starting up with monetdb, i have been going through the documentation and other resource but could not trace the information on this, what is the maximum size/length of the column name? Thank you. Saurabh

2 1

[Monetdb-developers] maximum column name length
by kss ram 08 Apr '10

08 Apr '10

Hello, i am just starting up with monetdb, i have been going through the documentation and other resource but could not trace the information on this, what is the maximum size/length of the column name? Thank you. Saurabh

1 0

[Monetdb-developers] Announcement: New Feb2010-SP1 bugfix release of MonetDB suite
by Sjoerd Mullender 08 Apr '10

08 Apr '10

The MonetDB team at CWI/MonetDB BV is pleased to announce the Feb2010-SP1 bug fix release of the MonetDB suite of programs. More information on this release is available at <http://monetdb.cwi.nl/Development/Releases/Feb2010/>. -- Sjoerd Mullender

2 1

[Monetdb-developers] How can I get the libmapi.lib file
by KEN 08 Apr '10

08 Apr '10

Hi , I have to make my application programs (MFC C++) access data in MonetDB/XQuery on windows . I try to use static link by libMapi.dll ( the file in MonetDB4-XQuery-Installer ), but I can not find libMapi.lib in any package at Download area . Please give me a hand to get libMapi.lib or other ways. Let my MFC C++ access data easily in MonetDB/XQuery on windows. Thank you very much!!

2 1

[Monetdb-developers] dealing with 1G XML file in MonetDB/XQuery
by Mo Zhou 08 Apr '10

08 Apr '10

Hi, When I load a 1G XML file to MonetDB/XQuery, it throws exceptions as follows. I did not find related parameters in the monetDB config file to enlarge the heap size. I wonder how I can solve this problem? Thank you. #GDKmmap(1073741824) fails, try to free up space [memory in use=156511940,virtual memory in use=1309212672] #GDKmmap(1073741824) result [mem=156511940,vm=1309212672] MAPI = mozhou@localhost:40000 QUERY = pf:add-doc("/.../new1GL1Comp/xmldoc3.xml","1GL1doc3") ERROR = !ERROR: [shred_url]: 1 times inserted nil due to errors at tuples 0@0. !ERROR: [shred_url]: first error was: !ERROR: HEAPextend: failed to extend to 1073741824 for 03/02/30243theap !ERROR: shredBAT_append_str: APPEND-STR[_prop_text](http://www4.wiwiss.fu-berlin.de/bizer/bsbm/v01/instances/dataFromVendor20/Offer31281/), BUNappend fails !ERROR: CMDshred_url: operation failed. -- Thanks, Mo

2 2