- developers-list - monetdb.org

[Monetdb-developers] Announcement: New bug fix release of MonetDB suite
by Sjoerd Mullender 23 Jan '09

23 Jan '09

The MonetDB team at CWI is pleased to announce the Nov2008-SP2 bug fix release of the MonetDB suite of programs. This is a bug fix release of the Nov2008 release. More information on this release can be found at <http://monetdb.cwi.nl/projects/monetdb/Development/Releases/Nov2008/#Nov200…>. The sources and binaries are available at <http://monetdb.cwi.nl/projects/monetdb/Download/>. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime serialize.mx, , 1.119, 1.120 xrpc_server.mx, , 1.85, 1.86
by Stefan Manegold 22 Jan '09

22 Jan '09

On Thu, Jan 22, 2009 at 03:06:44PM +0100, Ying Zhang wrote: > On Thu, Jan 22, 2009 at 12:30:21PM +0000, Ying Zhang wrote: > > Update of /cvsroot/monetdb/pathfinder/runtime > > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16608 > > > > Modified Files: > > serialize.mx xrpc_server.mx > > Log Message: > > Added a new env. var. to make the root directory, from which the XRPC HTTP > > server serves files, configurable. > > > > This was (mainly) needed to get the xrpc admin tests run with RunMtest, since RunMtest doesn't have monet installed yet (i.e., there is no $prefix/share/ MonetDB/xrpc/ yet), so we need a way to tell the xrpc server to serve file from > > a different directory, in this case, from $srcdir/runtime/xrpc. > > Sorry, I forgot to mention that this checkin requires an update and a > rebuild of MonetDB4, because changes in MonetDB4/conf/MonetDB.conf.in > are needed. question is why are they needed? or differently, why is the default (only) set in MonetDB.conf, rather then where it is (first) used in Pathfinder/XRPC? I would have expected that the newly added code in Pathfinder/XRPC, just checks, whether the new environment variable is set; if so, it uses that value; otherwise, it uses a default (defined there). In case your code does already exactly this, the changes in MonetDB.conf, should not be required for the new PF/XRPC code to work, rather, they mainly document the new variable and its default value. Stefan > Jennie > > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime serialize.mx, , 1.119, 1.120 xrpc_server.mx, , 1.85, 1.86
by Stefan Manegold 22 Jan '09

22 Jan '09

On Thu, Jan 22, 2009 at 12:30:21PM +0000, Ying Zhang wrote: > Update of /cvsroot/monetdb/pathfinder/runtime > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv16608 > > Modified Files: > serialize.mx xrpc_server.mx > Log Message: > Added a new env. var. to make the root directory, from which the XRPC HTTP > server serves files, configurable. > > This was (mainly) needed to get the xrpc admin tests run with RunMtest, since RunMtest doesn't have monet installed yet (i.e., there is no $prefix/share/ MonetDB/xrpc/ yet), so we need a way to tell the xrpc server to serve file from > a different directory, in this case, from $srcdir/runtime/xrpc. > [...] > > U xrpc_server.mx > Index: xrpc_server.mx > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc_server.mx,v > retrieving revision 1.85 > retrieving revision 1.86 > diff -u -d -r1.85 -r1.86 > --- xrpc_server.mx 8 Jan 2009 16:54:18 -0000 1.85 > +++ xrpc_server.mx 22 Jan 2009 12:30:19 -0000 1.86 > @@ -89,6 +89,10 @@ > xrpc_trusted.append(prefix); > } > > +proc set_xrpc_docroot(str new_docroot) : void { > + > +} > + Jennie, what is the purpose of the above *empty* MIL proc? Stefan > proc get_xrpc_open() : bit { > if (monet_environment.exist("xrpc_open")){ > return bit(monet_environment.find("xrpc_open")); [...] -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

2 1

[Monetdb-developers] Results of FastBit Experiment
by Ross Bates 21 Jan '09

21 Jan '09

A question for any of the core team who were involved.... what resulted when FastBit was plugged into the backend of MonetDB? -Ross

1 0

[Monetdb-developers] mclient running out of memory, crashing mserver5
by sylver_b 21 Jan '09

21 Jan '09

Hi, I've finally found a better way to bulk load records via perl & odbc - a lot more stable. However, I've noticed many times mclient crashing mserver5 when loading records via the interactive interface. For instance, I tried to load about 130 inserts from a sql file using this command : mclient -lsql -d mydb < public_sysuser.sql After few seconds I started to see : #BBPTRIM: memtarget=17978753 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=273741960 [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] #BBPTRIM_ENTER: memsize=275281456,vmsize=275166768 #BBPTRIM: memtarget=19273201 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=275158816 [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] [ 1 ] #BBPTRIM_ENTER: memsize=276161752,vmsize=276047064 #BBPTRIM: memtarget=20153497 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=276056368 [ 1 ] #BBPTRIM_ENTER: memsize=276322608,vmsize=276207920 #BBPTRIM: memtarget=20314353 vmtarget=0 #BBPTRIM_EXIT: memsize=24100864,vmsize=276198064 Top is showing : top - 23:26:14 up 249 days, 9:57, 5 users, load average: 0.00, 0.20, 0.45 Tasks: 96 total, 1 running, 95 sleeping, 0 stopped, 0 zombie Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st Mem: 4025600k total, 2433324k used, 1592276k free, 191788k buffers Swap: 9502408k total, 92k used, 9502316k free, 1993392k cached I don't think i'm running out of memory. I had to stop and restart mserver5, flush the table, then re-run the command - all the records were inserted. Also I noticed this type of messages on the mserver5 console when piping records through the mclient (over 1million records) . It seems that the mclient is quiet instable (cf my post about "COPY, terminating connection" few months ago). So, is there a way to increase the memory limit or make sure mserver5 won't crash when running bash inserts via a cron job ? Please advise, Thank you SB

3 9

[Monetdb-developers] MonetDb comparison Data Load
by Prometheus WillSurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S

1 0

[Monetdb-developers] MonetDB Comparison and Power
by willsurvive 19 Jan '09

19 Jan '09

Dear Developers-Users, First of all I would like to thanks all of your afforts to birng us these DB technologies and a platform for openly discussion. We are consulting big sized customers and deploying their data search technologies. Total size is around 1 petabytes daily . (total of our customers number ) . Their data size starts 1 TB (9.000.000.000 lines cvs) to 100 TB. so we have different size of customer base. We are looking opensource db solutions for a while due to lack of support and technological cumbersome of the current commercial solutions. We have 3 test customer now : 1-1 TB data dailiy read only purposes. 9.000.000.000 cvs file should be load to database . Data should be load to the database max 2 hours. after that comlex crm analitic queries. max 10 concurrent user/queries. database will be daily and wil not grow dailiy. so limit is 1 TB data load. 2-10 TB data daily. same as above .. 3-50 TB data stabil. will not grow. So we are looking for a solutions: *Fast data loading. How fast we load data to the MonetDB ? Is it could be multithreaded data loading possible ? *Is it possible to MPP ? can we add more server to share cpu resources and decrease the load time ? what is the best HW solution for above first customer ? Do we need still fat enterrprise servers or what ? We are also looking for InfoBright, Vertica and also Luciddb. VErtica is not opensource so out of the list. Infobright seems not giving its full power in the opensource.. Also we heard about the MonetDB X100 and interested. After 3 months succefully test we will support monetDB developer if its solved our problems. We can pay . Best Regards W.S -- View this message in context: http://www.nabble.com/MonetDB-Comparison-and-Power-tp21541998p21541998.html Sent from the monetdb-developers mailing list archive at Nabble.com.

1 0

[Monetdb-developers] prepare for release
by Sjoerd Mullender 14 Jan '09

14 Jan '09

This is a heads-up. Next week I will create a new bug fix release, so please fix the last remaining bugs in the stable branch now. When the bug fix release has been done, I will create a new stable branch based on the development branch in preparation for the February feature release. This means that if there is anything that you want in that release, implement it now. Once the branch has been made, we will have a few weeks to stabilize the new stable branch before it is released. -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/runtime/xrpc/admin/Tests add_del_doc.xq.in, Nov2008, 1.1.4.3, 1.1.4.4 add_del_doc_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 add_trusted.mil, Nov2008, 1.1.4.2, 1.1.4.3 backup_restore.xq.in, Nov2008, 1.1.4.5, 1.1.4.6 backup_restore_noxrpc.xq.in, Nov2008, 1.1.2.2, 1.1.2.3 db_env.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_env_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2 db_stats.xq.in, Nov2008, 1.1.4.2, 1.1.4.3 db_stats_noxrpc.xq.in, Nov2008, 1.1.2.1, 1.1.2.2
by Sjoerd Mullender 12 Jan '09

12 Jan '09

On 2009-01-12 17:16, Ying Zhang wrote: > Sorry, forgot to mention: please don't propagate these changes to HEAD! I took care of that. > Thanks. > > Jennie > > > On Mon, Jan 12, 2009 at 04:01:02PM +0000, Ying Zhang wrote: >> Update of /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests >> In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv10518 >> >> Modified Files: >> Tag: Nov2008 >> add_del_doc.xq.in add_del_doc_noxrpc.xq.in add_trusted.mil >> backup_restore.xq.in backup_restore_noxrpc.xq.in db_env.xq.in >> db_env_noxrpc.xq.in db_stats.xq.in db_stats_noxrpc.xq.in >> Log Message: >> - *.xq.in >> >> the xrpc http server is not available (yet) in RunMtest, hence, use the module >> file 'admin.xq'-s local path, instead of using its URL served by the xrpc http server. >> >> -add_trusted.mil >> >> allow 'admin.xq' to be executed >> >> >> >> U add_del_doc.xq.in >> Index: add_del_doc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc.xq.in,v >> retrieving revision 1.1.4.3 >> retrieving revision 1.1.4.4 >> diff -u -d -r1.1.4.3 -r1.1.4.4 >> --- add_del_doc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.4.3 >> +++ add_del_doc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.4 >> @@ -11,17 +11,17 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -61,11 +61,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U backup_restore_noxrpc.xq.in >> Index: backup_restore_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore_noxrpc.xq.in,v >> retrieving revision 1.1.2.2 >> retrieving revision 1.1.2.3 >> diff -u -d -r1.1.2.2 -r1.1.2.3 >> --- backup_restore_noxrpc.xq.in 9 Jan 2009 14:40:24 -0000 1.1.2.2 >> +++ backup_restore_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.3 >> @@ -15,13 +15,13 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -38,23 +38,23 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:backup("test") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ adm:collections() }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:restore("test", 10) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -73,11 +73,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { adm:documents() } >> </db-after-cleanup> >> >> U db_env_noxrpc.xq.in >> Index: db_env_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_env_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_env_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in adm:db-env() >> return >> (text { "
 " }, >> >> U db_stats.xq.in >> Index: db_stats.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_stats.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_stats.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in execute at {"$HOST:$XRPCPORT"} {adm:db-stats()} >> return >> (text { "
 " }, >> >> U add_del_doc_noxrpc.xq.in >> Index: add_del_doc_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_del_doc_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- add_del_doc_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ add_del_doc_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -11,13 +11,13 @@ >> - adm:del-doc() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> -(adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> - adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> +(adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", "xmark1.xml", "xmark", 10), >> + adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", "xmark2.xml", "xmark", 10) >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-add>{ >> @@ -57,11 +57,11 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> adm:del-col("xmark") >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text { "
 "}, >> <collections-after-del>{ >> >> U db_stats_noxrpc.xq.in >> Index: db_stats_noxrpc.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_stats_noxrpc.xq.in,v >> retrieving revision 1.1.2.1 >> retrieving revision 1.1.2.2 >> diff -u -d -r1.1.2.1 -r1.1.2.2 >> --- db_stats_noxrpc.xq.in 9 Jan 2009 10:36:24 -0000 1.1.2.1 >> +++ db_stats_noxrpc.xq.in 12 Jan 2009 16:01:00 -0000 1.1.2.2 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $stat in adm:db-stats() >> return >> (text { "
 " }, >> >> U db_env.xq.in >> Index: db_env.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/db_env.xq.in,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- db_env.xq.in 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ db_env.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -4,7 +4,7 @@ >> Filter out uninteresting differences in the results >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> for $env in execute at {"$HOST:$XRPCPORT"} {adm:db-env()} >> return >> (text { "
 " }, >> >> U add_trusted.mil >> Index: add_trusted.mil >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/add_trusted.mil,v >> retrieving revision 1.1.4.2 >> retrieving revision 1.1.4.3 >> diff -u -d -r1.1.4.2 -r1.1.4.3 >> --- add_trusted.mil 18 Nov 2008 10:43:35 -0000 1.1.4.2 >> +++ add_trusted.mil 12 Jan 2009 16:01:00 -0000 1.1.4.3 >> @@ -2,12 +2,17 @@ >> module("unix"); >> >> var TSTSRCDIR := getenv("TSTSRCDIR"); >> +var TSTSRCBASE := getenv("TSTSRCBASE"); >> var TSTTRGDIR := getenv("TSTTRGDIR"); >> +var TSTTRGBASE := getenv("TSTTRGBASE"); >> var HOST := getenv("HOST"); >> var XRPCPORT := getenv("XRPCPORT"); >> >> add_xrpc_trusted(TSTSRCDIR); >> +add_xrpc_trusted(TSTSRCBASE); >> + >> add_xrpc_trusted(TSTTRGDIR); >> +add_xrpc_trusted(TSTTRGBASE); >> add_xrpc_trusted("http://"+HOST+":"+XRPCPORT); >> >> commit(); >> >> U backup_restore.xq.in >> Index: backup_restore.xq.in >> =================================================================== >> RCS file: /cvsroot/monetdb/pathfinder/runtime/xrpc/admin/Tests/backup_restore.xq.in,v >> retrieving revision 1.1.4.5 >> retrieving revision 1.1.4.6 >> diff -u -d -r1.1.4.5 -r1.1.4.6 >> --- backup_restore.xq.in 9 Jan 2009 14:40:24 -0000 1.1.4.5 >> +++ backup_restore.xq.in 12 Jan 2009 16:01:00 -0000 1.1.4.6 >> @@ -15,17 +15,17 @@ >> - adm:restore-col() >> :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> (execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark1.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark1.xml", >> "xmark1.xml", "xmark", 10)}, >> execute at {"$HOST:$XRPCPORT"} >> - {adm:add-doc("http://$HOST:$XRPCPORT/admin/xmark2.xml", >> + {adm:add-doc("$TSTSRCBASE/runtime/xrpc/admin/xmark2.xml", >> "xmark2.xml", "xmark", 10)} >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-before-backup>{ >> @@ -42,25 +42,25 @@ >> ) >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:backup("test")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-del>{ >> execute at {"$HOST:$XRPCPORT"} {adm:collections()} >> }</db-after-del> >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:restore("test", 10)} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> ( >> text {"
 "}, >> <db-after-restore>{ >> @@ -79,11 +79,11 @@ >> <> >> (: clean DB at the end of the test :) >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> execute at {"$HOST:$XRPCPORT"} {adm:del-col("xmark")} >> <> >> import module namespace adm = "http://monetdb.cwi.nl/XQuery/admin/" >> - at "http://$HOST:$XRPCPORT/admin/admin.xq"; >> + at "$TSTSRCBASE/runtime/xrpc/admin/admin.xq"; >> <db-after-cleanup> >> { execute at {"$HOST:$XRPCPORT"} {adm:documents()} } >> </db-after-cleanup> >> >> >> ------------------------------------------------------------------------------ >> Check out the new SourceForge.net Marketplace. >> It is the best place to buy or sell services for >> just about anything Open Source. >> http://p.sf.net/sfu/Xq1LFB >> _______________________________________________ >> Monetdb-pf-checkins mailing list >> Monetdb-pf-checkins(a)lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > ------------------------------------------------------------------------------ > This SF.net email is sponsored by: > SourcForge Community > SourceForge wants to tell your story. > http://p.sf.net/sfu/sf-spreadtheword > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins -- Sjoerd Mullender

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/Tests usage.stable.out, , 1.19, 1.20 usageH.stable.out, , 1.49, 1.50
by Stefan Manegold 09 Jan '09

09 Jan '09

On Fri, Jan 09, 2009 at 09:50:35AM +0000, Jan Rittinger wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/Tests > In directory 23jxhf1.ch3.sourceforge.com:/tmp/cvs-serv17274/Tests > > Modified Files: > usage.stable.out usageH.stable.out > Log Message: > -- Adjust help messages to the new copyright information. Just for info for you and for who ever will take care of updating the stable output accordingly in the Nov2008 release branch and then (not) propagating it to the development trunk (most probably Sjoerd or me ...): The copyright information has obviously also been updated in the Nov2008 release branch, and the stable output for the respective tests should be updated there as well --- propagating these updates *might* then cause (probably easily resolvable) conflicts as the stable output in the development trunk has just experienced two changes: new copyright and new usage info. Note, this is neither a critique nor a major problem, but just to share information that might help to reduce / prevent inconveniences, in particular with (semi-automa[tgn]ic) propagation of chnages from the latest release branch to the development trunk. (For the future, the "ideal" procedure would (have) be(en) to first update the copyright info in the stable output of the release branch, then propagate these changes, and then update / extend the usage info in the development trunk and update the stable output there accordingly. ;-)) Stefan > -- Extend help message 'pf -H' to list all available optimization phases. > > > U usageH.stable.out > Index: usageH.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usageH.stable.out,v > retrieving revision 1.49 > retrieving revision 1.50 > diff -u -d -r1.49 -r1.50 > --- usageH.stable.out 2 Dec 2008 17:30:41 -0000 1.49 > +++ usageH.stable.out 9 Jan 2009 09:50:33 -0000 1.50 > @@ -11,7 +11,7 @@ > # 15:43:45 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > @@ -38,6 +38,9 @@ > = -p, --physical-algebra-plan: enable generation of physical algebra plan > = -f<format>, --format=<format>: enable generation of algebra properties > + print all available properties (logical/physical algebra) > + <optoptions> selectively choose optimization options that are based > + on a single property (e.g., 'O') to print the respective > + property > c print cost value (physical algebra) > o print orderings (physical algebra) > > @@ -65,23 +68,30 @@ > 21 after compiling the physical algebra into MIL code > 22 after the MIL program has been serialized > > -= -o<options>, --optimize-algebra=<options>: optimize algebra according to options: > += -o<optoptions>, --optimize-algebra=<optoptions>: optimize algebra according to optimization options: > + E merge common subexpressions (CSE) > + G apply general optimization (without properties) > O apply optimization based on constant property > I apply optimization based on icols property > K apply optimization based on key property > - C apply optimization using multiple properties (complex) > - (and icols based optimization will be applied afterwards) > - G apply general optimization (without properties) > + N apply optimization based on required node values property > V apply optimization based on required values property > - [ map column names to unique column names > - J push down equi-joins (requires unique column names) > - ] map column names back (from unique names to original names) > - M apply optimization based on multi-value dependencies > S apply optimization based on set property > + U apply optimization based on XML Guide information > + (only works for the SQL code generation) > + C apply optimization using multiple properties (complex) > + (and icols based optimization will be applied afterwards) > + J push down equi-joins > + M push up cross products (based on multi-value dependencies > + T push up theta-joins (based on multi-value dependencies > + R push up rank operators > } introduce proxy operators that representoperator groups > { remove proxy operators > + Q apply optimizations tailored for the SQL code generation > + [ assign a new set of unique column names > + ] assign bit-encoded column names (deprecated optimization option) > P infer all properties > - _ does nothing (used for structuring the options) > + _ does nothing (used for structuring the optimization options) > (default for option -A is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_}MT{JISI_OK_GECSVR_GP') > (default for option -S is: '-o OIKCG_VG_JISI_GECSVR_OK_N}MT{JISI_GECSVR_Q_}MT{JISI_OK_GECSVR_QGP') > > > U usage.stable.out > Index: usage.stable.out > =================================================================== > RCS file: /cvsroot/monetdb/pathfinder/compiler/Tests/usage.stable.out,v > retrieving revision 1.19 > retrieving revision 1.20 > diff -u -d -r1.19 -r1.20 > --- usage.stable.out 19 Jun 2008 14:13:10 -0000 1.19 > +++ usage.stable.out 9 Jan 2009 09:50:33 -0000 1.20 > @@ -11,7 +11,7 @@ > # 13:16:47 > > > Pathfinder XQuery Compiler ($Revision$, $Date$) > -(c) Database Group, Technische Universitaet Muenchen > +(c) Database Systems Group, Eberhard Karls Universitaet Tuebingen > > Usage: pf [OPTION] [FILE] > > > > ------------------------------------------------------------------------------ > Check out the new SourceForge.net Marketplace. > It is the best place to buy or sell services for > just about anything Open Source. > http://p.sf.net/sfu/Xq1LFB > _______________________________________________ > Monetdb-pf-checkins mailing list > Monetdb-pf-checkins(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-pf-checkins > > -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0