June 2010

MonetDB Jun2010 release

Release “Jun2010” consists of the following updated components.

NOTE: Before upgrading to the latest “Jun2010” release from a release of MonetDB older than the Nov2008 release, please make a dump SQL, XQuery) of your database, and rename/move/backup the database directories (‘dbfarm’, ‘sql_logs’, ‘xquery_logs’). After the upgrade, restore your database, again. Once you have checked and confirmed the correctness of the restore, you can delete the above renamed/moved/backed-up old database directories.

When upgrading from a release of MonetDB older than the May2009 release, you need to move your write-ahead log following the “recommended” instructions for SQLand/or XQuery.

Linux

We now package for Fedora 11, 12, and 13, for Debian 5.0 (Lenny), and for Ubuntu 9.10 (Karmic Koala) and 10.04 (Lucid Lynx).

MonetDB Common

• Updated Vendor information.
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .

MonetDB Server 4

• Updated Vendor information.
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .

MonetDB Server 5

• When libxml2 is available, the XML module is automatically loaded.
• Updated Vendor information.
• Created a new RPM MonetDB5-server-rdf for the optional MonetDB/RDF module.
• Added the Z-order module to simplify future manipulation of arrays.
• fixed BUG #2994521 “mat.slice unable to cope with only empty BAT arguments” by making MATpackSliceInternal() handle empty input BATs correctly
• Selectfrom limit has been improved by introducing mat.slice().
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .
• The MAL debugger list command has been extended with an optional hash ‘#’, which produces line numbers for each of reference and analysis of variable span.
• The dataflow scheduler has been revamped to allow for more parallelism to be exploited.
• The garbage collection administration has been changed. Every variable record now comes with an end-of-life field (eolife), which denotes the instruction after which the BAT variable reference counter can be decremented. The garbage collector is never called automagically on MAL functions, because there may be other pressing needs to retain them. This means that MAL functions defined and used in the context of SQL, and which are not inlined, may cause a leakage. The garbage collection has become part of each interpreter step. The new approach makes the SQL/MAL plans half the size as before.
• Removed stethoscope from MonetDB5 sources. New location is in the clients repository.
• Added the compression optimizer as an example of how to gain access to foreign file formats deep down in the kernel and transfer them just in time into a temporary BAT.
• Renamed configure argument –with-console to –enable-console. Default remains console being enabled.
• Fixed cleaning the user module context upon session end. Fixes bug #2956664
• The config variable mapi_usock can now be used to instruct the server to listen for connections on a local UNIX domain socket on UNIX-like systems.
• The MAL interpreter has been extended with an operation admission policy to control the memory claims of all concurrent running interpreters. Instructions are hold up unto there is sufficient resource or the query plan can not avoid its execution anymore.
• The join path optimizer has been extended with searching for join*, semijoin*, and leftjoin* paths. Furthermore, it avoids duplicate work by factoring out all common simple join paths.

SQL

• make it possible to use ‘?’ in offset and limit
• Added include and .lib files to Windows installers that are needed to compile client programs.
• Updated Vendor information.
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .

XQuery

• Updated Vendor information.
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .

Client Packages

• Updated Vendor information.
• The MonetDB ODBC driver now no longer depends on its own copy of the standard ODBC include files but instead depends on system include files (unixODBC on Linux and Microsoft SDK on Windows).
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .
• Changed d output of mclient no longer to list (internal use only) system tables. Administrator users who like to inspect these tables can use SELECT * FROM tables; instead
• Implemented the changes required for properly running ODBC on a 64-bit platform.
• Added stethoscope, an utility to profile MonetDB5 instances, originally from the MonetDB5 repository.

Geom Module

• Updated Vendor information.
• Made compilation of “testing” (and “java”) independent of MonetDB. This is mainly for Windows, but also on other systems, “testing” can now be built independently of (and hence before) “MonetDB”. Files that mimic configure functionality on Windows were moved from “MonetDB” to “buildtools”; hence, this affects all packages on Windows, requiring a complete rebuild from scratch on Windows. getopt() support in testing has changed; hence, (most probably) requiring a rebuild from scratch of testing on other systems.
• Implemented build directory support for Windows, i.e., like on Unix/Linux also on Windows we can now build in a separate build directory as alternative to …NT, and thus keep the latter clean from files generated during the build. On Windows, the build directory must be a sibling of …NT .