July 2016 - developers-list

does cracking implemented in monetdb
by Narendra Pradeep 28 Jul '16

28 Jul '16

My questions are 1) Does cracking implemented in monetdb ? 2) Which file contains the code for cracking in source ? 3) Can we trace cracking and find whether query reads record from disc or the cracked columns ? Thanks in advance. regards , Pradeep.

2 1

Re: MonetDB: Jun2016 - Trace BATs should be reset before the next TR...
by Sjoerd Mullender 28 Jul '16

28 Jul '16

This is not correct. I made the exact opposite change in changeset 080dcfcb43e4 in order to fix memory leaks. That worked, but now those leaks are back. Clearly another solution is needed. On 28/07/16 00:31, Martin Kersten wrote: > Changeset: 25c896ae6a53 for MonetDB > URL: http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=25c896ae6a53 > Modified Files: > monetdb5/mal/mal_profiler.c > Branch: Jun2016 > Log Message: > > Trace BATs should be reset before the next TRACE call > BBPunfix was slipped in, while it should simply be a BATclear. > > > diffs (36 lines): > > diff --git a/monetdb5/mal/mal_profiler.c b/monetdb5/mal/mal_profiler.c > --- a/monetdb5/mal/mal_profiler.c > +++ b/monetdb5/mal/mal_profiler.c > @@ -761,19 +761,19 @@ clearTrace(void) > return; /* not initialized */ > } > /* drop all trace tables */ > - BBPunfix(TRACE_id_event->batCacheid); > - BBPunfix(TRACE_id_time->batCacheid); > - BBPunfix(TRACE_id_pc->batCacheid); > - BBPunfix(TRACE_id_thread->batCacheid); > - BBPunfix(TRACE_id_ticks->batCacheid); > - BBPunfix(TRACE_id_rssMB->batCacheid); > - BBPunfix(TRACE_id_tmpspace->batCacheid); > - BBPunfix(TRACE_id_inblock->batCacheid); > - BBPunfix(TRACE_id_oublock->batCacheid); > - BBPunfix(TRACE_id_minflt->batCacheid); > - BBPunfix(TRACE_id_majflt->batCacheid); > - BBPunfix(TRACE_id_nvcsw->batCacheid); > - BBPunfix(TRACE_id_stmt->batCacheid); > + BBPclear(TRACE_id_event->batCacheid); > + BBPclear(TRACE_id_time->batCacheid); > + BBPclear(TRACE_id_pc->batCacheid); > + BBPclear(TRACE_id_thread->batCacheid); > + BBPclear(TRACE_id_ticks->batCacheid); > + BBPclear(TRACE_id_rssMB->batCacheid); > + BBPclear(TRACE_id_tmpspace->batCacheid); > + BBPclear(TRACE_id_inblock->batCacheid); > + BBPclear(TRACE_id_oublock->batCacheid); > + BBPclear(TRACE_id_minflt->batCacheid); > + BBPclear(TRACE_id_majflt->batCacheid); > + BBPclear(TRACE_id_nvcsw->batCacheid); > + BBPclear(TRACE_id_stmt->batCacheid); > TRACE_init = 0; > MT_lock_unset(&mal_contextLock); > initTrace(); > _______________________________________________ > checkin-list mailing list > checkin-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/checkin-list > -- Sjoerd Mullender

1 0

Instrumentation in monetdb
by Narendra Pradeep 22 Jul '16

22 Jul '16

eello everyone , How can I get instumemtation in monetdb ? I need thedetails like planning time , execution time for each MAL statement in monetdb . Is there any command for it ? regards , Pradeep

2 1

Fwd: Monet php_mapi.inc
by Mark Raasveldt 22 Jul '16

22 Jul '16

> Begin forwarded message: > > From: Alberto Ferrari <aferrari(a)starconnecting.com> > Subject: Monet php_mapi.inc > Date: 21 July 2016 at 17:22:34 GMT+2 > To: Mark Raasveldt <m.raasveldt(a)cwi.nl> > > Hi Mark, > (about https://dev.monetdb.org/hg/MonetDB/file/tip/clients/php/lib/php_mapi.inc) > > I've been using the "php_mapi.inc" in my php web application in the > last few months. So I modified the "php_mapi.inc" to a php class, > which is more efficient and correct (to me). > I am not registered in the Mercurial repo, so , if you (or somebody) > are interested on my "class" version, I can send you attached, and > then feel free to publish it, if you want. > Just tell me. > > regards > Alberto Ferrari.

2 1

Announcement: New Jun2016-SP1 Bugfix release of MonetDB suite
by Sjoerd Mullender 22 Jul '16

22 Jul '16

The MonetDB team at CWI/MonetDB BV is pleased to announce the Jun2016-SP1 bugfix release of the MonetDB suite of programs. More information about MonetDB can be found on our website at <http://www.monetdb.org/>. For details on this release, please see the release notes at <http://www.monetdb.org/Downloads/ReleaseNotes>. As usual, the download location is <http://dev.monetdb.org/downloads/>. Jun 2016-SP1 bugfix release . * Lots of memory leaks have been plugged across the whole system. Java Module * Corrected PROCEDURE_TYPE output value of method DatabaseMetaData.getProcedures(). It used to return procedureReturnsResult. Now it returns procedureNoResult. Corrected ORDINAL_POSITION output value of method DatabaseMetaData.getProcedureColumns(). It used to start with 0, but as procedures do not return a result value it now starts with 1 for all the procedure arguments, as defined by the JDBC API. * Improved output of method DatabaseMetaData.getProcedures(). The REMARKS column now contains the procedure definition as stored in sys.functions.func. The SPECIFIC_NAME column now contains the procedure unique identifier as stored in sys.functions.id. This allows the caller to retrieve the specific overloaded procedure which has the same name, but different arguments. Also improved output of method DatabaseMetaData.getProcedureColumns(). The SPECIFIC_NAME column now contains the procedure unique identifier as stored in sys.functions.id. This allows the caller to retrieve the proper arguments of the specific overloaded procedure by matching the SPECIFIC_NAME value. * Improved output of method DatabaseMetaData.getFunctions(). The REMARKS column now contains the function definition as stored in sys.functions.func. The SPECIFIC_NAME column now contains the function unique identifier as stored in sys.functions.id. This allows the caller to retrieve the specific overloaded function which has the same name, but different arguments. Also improved output of method DatabaseMetaData.getFunctionColumns(). The SPECIFIC_NAME column now contains the function unique identifier as stored in sys.functions.id. This allows the caller to retrieve the proper arguments of the specific overloaded function by matching the SPECIFIC_NAME value. Bug Fixes * 4014: KILL signal * 4021: Analyze query does not escape input [security] * 4026: JDBC driver incorrectly converts TINYINT fields to String instead of an integer type. * 4028: inputs not the same size * 4031: mclient doesn't accept - argument to refer to stdin * 4032: no decimal places after update. ODBC driver * 4035: SQL Function call bug * 4036: Possible sql_catalog corruption due to unclean backuped tail

1 0

Tracking query & user information during execution
by Playfair, Daniel 19 Jul '16

19 Jul '16

Hi MonetDB Developers, I'm working to add intra-query checkpoint/restart functionality to MonetDB as part of my PhD work. I have a partial implementation and have completed the component for transmitting intermediate values (to a separate middleware), and have a plan that I think should work for replay. Most of these modifications are in the runMALsequence function in the mal interpreter. Currently my implementation transmits all intermediates and I'm having some difficulty on the component to selectively transmit selected intermediates. I was hoping you might be able answer some of my questions to point me in the right direction on this aspect. I intend for the actual checkpoint planning to be performed on the query plan graphs in an offline step. This relates to one of my problems - The MAL variable names for intermediates seem to change accross executions. 1. Is there a way to have these identifiers be consistent? 2. What factors determine the values they take? Secondly, I am having difficulty with tracking/accessing information about the user, original SQL query, and current MAL operation step to be able to tag the transmitted intermediates with sufficient data for the middleware & load balancer to be able to relate this to a user session & query. I believe this should be accessible via 3. How can I access this information from the inputs available in runMALsequence (in mal_interpreter.c) I believe it's probably somewhere in the mal stack, instruction record, or client structs, but I am having difficulty here. Any help and input would be greatly appreciated. Many thanks, ~ Daniel.

1 0