- developers-list - monetdb.org

Announcement: New Oct2012-SP2 Bugfix release of MonetDB suite
by Sjoerd Mullender 21 Dec '12

21 Dec '12

The MonetDB team at CWI/MonetDB BV is pleased to announce the Oct2012-SP2 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Oct 2012-SP2 bugfix release SQL * Fixed crash when performing an INSERT on a table with string-like column defaulting to NULL and omitting that column from VALUES, bug #3168 Java Module * Implemented type map support of Connection to allow custom mapping of UDTs to Java classes. By default the INET and URL UDTs are now mapped to nl.cwi.monetdb.jdbc.types.{INET,URL}. Most notably, ResultSet.getObject() and PreparedStatement.setObject() deal with the type map. * Fixed a problem in PreparedStatement where the prepared statement's ResultSetMetaData (on its columns to be produced) incorrectly threw exceptions about non existing columns. Bug #3192 Bug Fixes * 2291: small doubles end up as NULL after arithmetic * 2579: SQL: incorrect cast from double to int * 2659: tuples INTERSECT vs count (... INTERSECT ...) differs * 2805: row_number doesn't work in complex query * 2886: warning: Catalog parameter '' ignored * 2977: timestamp minus date results in program error * 2978: now() + 1 results in illegal argument * 2999: Up-cast from SQL drops order information? * 3048: algebra.join undefined when using multiple arithmetic operations in SQL where-clause * 3124: insert into table with two foreign keys crashes mserver5 * 3136: Memleak (in querycache?) while querying * 3143: Type resolution error in SQL procedural code * 3163: mserver5 crashes with large number of concurrent clients * 3168: crash when insert varchar/char/clob with default NULL * 3169: php driver uses call-time pass-by-reference * 3173: SQL queries with limit and offset clauses are unable to use bind parameters for either * 3181: Join query returns zero results when there is an index on the tables * 3185: inconsistency between documentation and implementation of command line options * 3186: case evaluted to early * 3188: Storage of client history * 3189: Overflow in calculation * 3190: When subtracting two columns of type "timestamp", no results are returned * 3191: rel_optimizer.c:5596: _rel_optimizer: Assertion `0' failed. * 3192: "No such column with index" error if CASE in SELECT clause * 3199: Inconspicuous sequence of prepare, execute, commit and close produces error * 3205: Inet datatype handling inconsistent between int, cast( as inet) and string _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

1 0

readline and the Mac build
by Masood Mortazavi 21 Dec '12

21 Dec '12

It seems "readline" isn't linked in the Mac build and installation. Configure or package repository don't indicate any issues, and yet history completions fail on mclient's sql prompt. Regards, -m. $ sudo port list | grep readline gauche-readline @0.1 devel/gauche-readline hs-readline @1.0.1.0 devel/hs-readline pure-readline @0.1 devel/pure-readline readline @6.2.000 devel/readline readline-4 @4.3 devel/readline-4 readline-5 @5.2.014 devel/readline-5 ... ... $ more config.log | grep readline configure:18493: checking readline/readline.h usability configure:18493: checking readline/readline.h presence configure:18493: checking for readline/readline.h configure:18495: checking for readline in -lreadline configure:18520: gcc -o conftest -g conftest.c -lreadline >&5 configure:18631: checking for rl_completion_matches in -lreadline configure:18656: gcc -o conftest -g conftest.c -lreadline -lreadline >&5 | #include <readline/readline.h> ac_cv_header_readline_readline_h=yes ac_cv_lib_readline_readline=yes ac_cv_lib_readline_rl_completion_matches=yes _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

4 8

Re: MonetDB: Feb2013 - Properly realloc the namespace
by Stefan Manegold 19 Dec '12

19 Dec '12

Martin, assertions are not the most suitable way to check for malloc failures. Assertions are to *assert* facts that must hold, i.e., the would be a logical error if they do not hold. Consequently, assertions are only enabled during development and testing, but disabled (for among others for performance reasons) in any production builds. If triggered, assertions stop the entire process instantly. Failing mallocs is a runtime exception that can occur at any time for various reasons. The code should check for this and gracefully handle such situations with proper exeption handling. Having said that, in particular is the man namespace is local per query/client, a failure in one query/client should not crash the whole server by an assertion (during development/testing) or a segfault (in production builds), but rather only greacefull trigger and handle an exception for that one query/client. Also, if namespaces are global and a malloc failure prevent the whole server from continuing properly, it should at least (try to) gracefully shut itself down (with a proper error message), rather than crashing instantly with an assertion of segfault. Best, Stefan On Wed, Dec 19, 2012 at 11:53:37AM +0100, Martin Kersten wrote: > Changeset: 2a9bd075c039 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=2a9bd075c039 > Modified Files: > monetdb5/mal/mal_namespace.c > Branch: Feb2013 > Log Message: > > Properly realloc the namespace > The expandName always lead to a different anchoring point of the namespace. > This may leave concurrent threads with dead meat. > This patch reduces the chance on a SEGfault. > > > diffs (37 lines): > > diff --git a/monetdb5/mal/mal_namespace.c b/monetdb5/mal/mal_namespace.c > --- a/monetdb5/mal/mal_namespace.c > +++ b/monetdb5/mal/mal_namespace.c > @@ -66,26 +66,13 @@ typedef struct NAMESPACE{ > static Namespace namespace; > > static void expandNamespace(void){ > - str *nme; > - size_t *length; > - int *link, newsize, incr = 2048; > - > - newsize= namespace.size + incr; > - nme= (str *) GDKmalloc(sizeof(str *) * newsize); > - assert(nme != NULL); /* we cannot continue */ > - link= (int *) GDKmalloc(sizeof(int) * newsize); > - assert(link != NULL); /* we cannot continue */ > - length = (size_t *) GDKmalloc(sizeof(size_t) * newsize); > - assert(length != NULL); /* we cannot continue */ > - > - memcpy(nme, namespace.nme, sizeof(str *) * namespace.nmetop); > - memcpy(link, namespace.link, sizeof(int) * namespace.nmetop); > - memcpy(length, namespace.length, sizeof(size_t) * namespace.nmetop); > - > - namespace.size += incr; > - GDKfree(namespace.nme); namespace.nme= nme; > - GDKfree(namespace.link); namespace.link= link; > - GDKfree(namespace.length); namespace.length= length; > + namespace.size += 2048; > + namespace.nme= (str *) GDKrealloc(namespace.nme, sizeof(str *) * namespace.size); > + assert(namespace.nme != NULL); /* we cannot continue */ > + namespace.link= (int *) GDKrealloc(namespace.link, sizeof(int) * namespace.size); > + assert(namespace.link != NULL); /* we cannot continue */ > + namespace.length = (size_t *) GDKrealloc(namespace.length, sizeof(size_t) * namespace.size); > + assert(namespace.length != NULL); /* we cannot continue */ > } > > void initNamespace(void) { > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list > -- | Stefan.Manegold @ CWI.nl | DB Architectures (INS1) | | http://CWI.nl/~manegold/ | Science Park 123 (L321) | | Tel.: +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

1 0

Re: MonetDB: Oct2012 - fixed bug 3209, ie first crossproduct if the ...
by Ying Zhang 16 Dec '12

16 Dec '12

Hai Niels, Your fix works in Feb2013, but not in Oct2012… Jennie On Dec 15, 2012, at 12:29, Niels Nes wrote: > Changeset: 8650dce52dd8 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=8650dce52dd8 > Modified Files: > sql/server/rel_exp.c > sql/server/rel_exp.h > Branch: Oct2012 > Log Message: > > fixed bug 3209, ie first crossproduct if the join expression consists > of functions (these should have been pushed down, whenever possible). > > > diffs (59 lines): > > diff --git a/sql/server/rel_exp.c b/sql/server/rel_exp.c > --- a/sql/server/rel_exp.c > +++ b/sql/server/rel_exp.c > @@ -1032,6 +1032,44 @@ exp_is_atom( sql_exp *e ) > } > > static int > +exps_has_func( list *exps) > +{ > + node *n; > + int has_func = 0; > + > + for(n=exps->h; n && !has_func; n=n->next) > + has_func |= exp_has_func(n->data); > + return has_func; > +} > + > +int > +exp_has_func( sql_exp *e ) > +{ > + switch (e->type) { > + case e_atom: > + return 0; > + case e_convert: > + return exp_has_func(e->l); > + case e_func: > + case e_aggr: > + return 1; > + case e_cmp: > + if (e->flag == cmp_or) { > + return (exps_has_func(e->l) || exps_has_func(e->r)); > + } else if (e->flag == cmp_in || e->flag == cmp_notin || e->flag == cmp_filter) { > + return (exp_has_func(e->l) || exps_has_func(e->r)); > + } else { > + return (exp_has_func(e->l) || exp_has_func(e->r) || > + (e->f && exp_has_func(e->f))); > + } > + case e_column: > + case e_psm: > + return 0; > + } > + return 0; > +} > + > +static int > exp_key( sql_exp *e ) > { > if (e->name) > diff --git a/sql/server/rel_exp.h b/sql/server/rel_exp.h > --- a/sql/server/rel_exp.h > +++ b/sql/server/rel_exp.h > @@ -105,6 +105,7 @@ extern int exp_is_eqjoin(sql_exp *e); > extern int exp_is_correlation(sql_exp *e, sql_rel *r ); > extern int exp_is_join_exp(sql_exp *e); > extern int exp_is_atom(sql_exp *e); > +extern int exp_has_func(sql_exp *e); > > extern sql_exp *exps_bind_column( list *exps, char *cname, int *ambiguous); > extern sql_exp *exps_bind_column2( list *exps, char *rname, char *cname); > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

1 0

Re: MonetDB: default - fixed a low level bug where empty mapi result...
by Sjoerd Mullender 14 Dec '12

14 Dec '12

On 2012-12-14 12:10, Gijs Molenaar wrote: > Changeset: 81f191d61822 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=81f191d61822 > Modified Files: > clients/python2/monetdb/mapi.py > clients/python3/monetdb/mapi.py > Branch: default > Log Message: > > fixed a low level bug where empty mapi results where not properly handled Is this is fix that should have gone to the Oct2012 branch? Please, make sure you fix bugs in the lowest branch where the bug occurs and that is still maintained. Currently the still maintained branches are Oct2012, Feb2013 and default. > > diffs (30 lines): > > diff --git a/clients/python2/monetdb/mapi.py b/clients/python2/monetdb/mapi.py > --- a/clients/python2/monetdb/mapi.py > +++ b/clients/python2/monetdb/mapi.py > @@ -163,9 +163,9 @@ class Connection(object): > self.__putblock(operation) > response = self.__getblock() > if not len(response): > - return True > + return "" > elif response.startswith(MSG_OK): > - return response[3:].strip() or True > + return response[3:].strip() or "" Isn't this equivalent to: return response[3:].strip() > if response == MSG_MORE: > # tell server it isn't going to get more > return self.cmd("") > diff --git a/clients/python3/monetdb/mapi.py b/clients/python3/monetdb/mapi.py > --- a/clients/python3/monetdb/mapi.py > +++ b/clients/python3/monetdb/mapi.py > @@ -163,9 +163,9 @@ class Connection(object): > self.__putblock(operation) > response = self.__getblock() > if not len(response): > - return True > + return "" > elif response.startswith(MSG_OK): > - return response[3:].strip() or True > + return response[3:].strip() or "" > if response == MSG_MORE: > # tell server it isn't going to get more > return self.cmd("") > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list > -- Sjoerd Mullender _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 1

group_concat
by Tapomay Dey 13 Dec '12

13 Dec '12

Almost there. As suggested by Fabian in the following thread I gave up the MX file approach and implemented group_concat as UDF in C. http://sourceforge.net/mailarchive/forum.php?thread_name=mailman.243.135532… When I try to conclude my function UDFBATgroup_concat_(BAT **ret, BAT *b, BAT *g, BAT *h, FILE* fp) //ignore fp as follows: BATaccessBegin(h, USE_HEAD | USE_TAIL, MMAP_SEQUENTIAL); index = 0; BATloop(h, p, q) { ptr hhead = BUNhead(hi, p); fprintf(fp, "%d: hhead=%d", index, hhead); str dst = tailValArray[index]; fprintf(fp, "%d: dstStr=%s# ", index, dst); BUNins(bn, hhead, dst, FALSE); fprintf(fp, "%d: Insert complete\n", index); index++; } I get the following error on the client terminal [tapomay@tapomay-laptop monetdata]$ echo "select house, group_concat(name) from gs group by house;" | mclient -d tapomay GDKerror:!ERROR: BUNins: access denied to tmp_10162, aborting. BUNins: access denied to tmp_10162, aborting. BUNins: access denied to tmp_10162, aborting. The groupings are ready in the tailVarArray. NEED HELP. Thanks and Regards, Tapomay. _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 1

Still searching to find the Octopus :-)
by Masood Mortazavi 12 Dec '12

12 Dec '12

I'm still searching for user documentation that would explain MonetDB/octopus usage/feature. Does any exist? Thanks, Masood P.S. My earlier e-mails regarding the octopus documentation was somewhat rushed, it seems. The documentation in the man pages are actually for remtoe access and funnel-multiplex features, which seem entirely different. _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 1

MX file expansion
by Tapomay Dey 12 Dec '12

12 Dec '12

How do I generate the sources from a new mx file. Thanks and Regards, Tapomay _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

3 5

Re: MonetDB: Oct2012 - configure fixes for if there is no python2 bi...
by Fabian Groffen 11 Dec '12

11 Dec '12

On 11-12-2012 15:59:04 +0100, Sjoerd Mullender wrote: > Changeset: fb7305c917ec for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=fb7305c917ec > Modified Files: > configure.ag > Branch: Oct2012 > Log Message: > > configure fixes for if there is no python2 binary, but python is version 2. > Also fixed a syntax error. > +AC_PATH_PROG(PYTHON,python,no,$PATH) > +PYTHON_MAJ= > +if test "x$PYTHON" != xno; then > + AC_MSG_CHECKING([major version of $PYTHON]) > + case "`"$PYTHON" -V 2>&1`" in > + "Python 2."[[67]]*) # older Pythons don't get Python3 syntax > + PYTHON_MAJ=2 > + case "$have_python2" in > + yes|auto) > + have_python2=yes > + PYTHON2="$PYTHON" Because PYTHON2=/path/to/python here, we no longer check for python2 which is preferably over "/path/to/python", since it contains a version. The active python can change over updates or preferences of the user. Perhaps (something like) the following would be enough? diff --git a/configure.ag b/configure.ag --- a/configure.ag +++ b/configure.ag @@ -1164,7 +1164,7 @@ fi if test "x$have_python2" != xno; then if test x$cross_compiling != xyes; then - AC_PATH_PROG(PYTHON2,$PYTHON2,no,$PATH) + AC_PATH_PROG(PYTHON2,python2,no,$PATH) if test "x$PYTHON2" = xno; then if ( test "x$have_python2" = xyes || test "x$have_python2" = xauto ) && test "x$PYTHON_MAJ" = x2; then PYTHON2="$PYTHON" @@ -1220,7 +1220,7 @@ AC_SUBST(PYTHON2_LIBDIR) if test "x$have_python3" != xno; then if test x$cross_compiling != xyes; then - AC_PATH_PROG(PYTHON3,$PYTHON3,no,$PATH) + AC_PATH_PROG(PYTHON3,python3,no,$PATH) if test "x$PYTHON3" = xno; then if ( test "x$have_python3" = xyes || test "x$have_python3" = xauto ) && test "x$PYTHON_MAJ" = x3; then PYTHON3="$PYTHON" -- Fabian Groffen fabian(a)monetdb.org column-store pioneer http://www.monetdb.org/Home _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

2 3

Re: MonetDB: Feb2013 - dotmonetdb: don't support passwd
by Lefteris 11 Dec '12

11 Dec '12

I was using that:P On Sat, Dec 8, 2012 at 4:20 PM, Fabian Groffen <commits(a)monetdb.org> wrote: > Changeset: c1f634d9db8c for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=c1f634d9db8c > Modified Files: > clients/mapiclient/dotmonetdb.c > Branch: Feb2013 > Log Message: > > dotmonetdb: don't support passwd > > The purposely only option for it ever documented is "password", so no > need to check for more than that. > > > diffs (12 lines): > > diff --git a/clients/mapiclient/dotmonetdb.c > b/clients/mapiclient/dotmonetdb.c > --- a/clients/mapiclient/dotmonetdb.c > +++ b/clients/mapiclient/dotmonetdb.c > @@ -95,7 +95,7 @@ parse_dotmonetdb(char **user, char **pas > if (user) > *user = strdup(q); > q = NULL; > - } else if (strcmp(buf, "password") == 0 || > strcmp(buf, "passwd") == 0) { > + } else if (strcmp(buf, "password") == 0) == 0) { > if (passwd) > *passwd = strdup(q); > q = NULL; > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/checkin-list > _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list

1 0