- developers-list - monetdb.org

[Monetdb-developers] Q: pathfinder - cdata
by Arjen P. de Vries 13 Jul '07

13 Jul '07

While <a /> is accepted as a query, <![CDATA[<]]> is not. !parse error: syntax error, unexpected <![CDATA[ on line 1, column 9 (next token is `<![CDATA[') !parse error: XQuery parsing failed Is that the expected behaviour? Context: I try to output email addresses as "test <test(a)my.org>" and failing Arjen -- ==================================================================== CWI, room C1.16 Centre for Mathematics and Computer Science Kruislaan 413 Email: Arjen.de.Vries(a)cwi.nl 1098 SJ Amsterdam tel: +31-(0)20-5924306 The Netherlands fax: +31-(0)20-5924312 ===================== http://www.cwi.nl/~arjen/ ====================

3 5

[Monetdb-developers] [M5] RFC: function shipping semantics
by Fabian Groffen 13 Jul '07

13 Jul '07

Hi all, I'd like some input on an issue that I can't get a clear vision on for now. Recently I added the remote module in MonetDB 5 which basically has 3 functions which perform actions with a remote (MonetDB 5) server. The functions get, put and exec retrieve, store and execute an object from, to or on a remote host. get and put allow for retrieval and storage of basically any type, scalars, strings, BATs, etc. exec only executes functions available on the remote host. The idea is to have one to "put()" a function to the remote host, and then execute it, retrieving its return value. exec is currently implemented that way, however, get and put of functions is not because it is unclear to me how this should exactly happen. For the case of put() I can think of the following which seems quite intuitive and ok to me: function user.func(v:int):str; r := "something"; return(r); end func; m := remote.put("host", "user.func(:int):str"); t := 5; q := remote.exec("host", m, t); io.print(q); The example puts function func to the remote host and executes it with argument t which is 5. The return string kept in q will contain the string "something". Because the identifier of the function on the remote host is returned and assigned to m, the function can easily be executed, since exec requires the function name as string. Currently that function name is just the function without its signature. The signature (which is not required, even not desired currently) can be deduced from the arguments given, resulting in a normal function resolution and (slightly misleading) error reporting if that fails. The other way around (thus to get a remote function) is still unclear to me how to do it. I could imagine the following that should work: v := remote.get("host", m); w := remote.get("host", "user.func(:int):str"); Problem with v is that m is not a full signature, so a conflict may arise if m is overloaded. This is not necessarily a problem, since m is a unique identifier, so no overloading for it exists. However, it is a requirement that a get after a put should always succeed and result in the same object that was put. The bigger problem here, however, is how to deal with the function being get. Since a function cannot be stored in a variable in MAL, it has to be stored on the local machine, or its contents as a string returned. In the first case the get() function would return its local identifier. In the latter case it would return a (big) string. In both cases, the function cannot be "used" as function in the program. A variable containing a function name cannot be used as in e.g.: k := v(t); where v, a variable, would be used as function, "dereferencing" v's value or something. Of course with a human factor one can do: io.print(v); and use the value of v to construct a call to the locally stored function. In the case of a string, the function has to be made, which I don't know how to do that, but would give explicit control over its name to the program. I don't think the concept of eval is clearing up things, as well as possible at all (if you think about the k := statement where only v should be expanded, not t neither k). Ideas?

3 3

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/modules/mal/Tests remote00.mal, , 1.3, 1.4 remote00.stable.out, , 1.4, 1.5
by Martin Kersten 10 Jul '07

10 Jul '07

Fabian wrote: > Update of /cvsroot/monetdb/MonetDB5/src/modules/mal/Tests > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv4482/Tests > > Modified Files: > remote00.mal remote00.stable.out > Log Message: > Be a little bit smarter when dealing with functions. Allow dotted > notation for <module>.<func> next to just <func> for the default/current > module. (currently I guess this is "user", but should be retrieved > somehow to be on the safe site...) Yes, the default is the user module. I have been 'struggling' with arguments for reflective functions. I settled down to using two arguments where needed e.g. f(mod:str,fcn:str,...) It is not optimal, but avoid string construction/analysis

3 5

[Monetdb-developers] Swallowed logmessage of /cvsroot/monetdb/pathfinder/compiler/Tests/usageH.stable.out; /cvsroot/monetdb/pathfinder/compiler/main.c
by Manuel Mayr 09 Jul '07

09 Jul '07

Sorry, somehow SF accomplished to swallow my Log-Messages for the last two checkins. I set them afterwards with 'cvs admin' to "Pathfinders SQL support is now available with -S." Regards, Manuel -- Manuel Mayr, Dipl. Inf. Institut fuer Informatik, TU Muenchen Tel.: +49 89 289-17288

1 0

Re: [Monetdb-developers] [Monetdb-checkins] MonetDB5/src/optimizer opt_statistics.mx, , 1.3, 1.4
by Martin Kersten 04 Jul '07

04 Jul '07

Thanks! It is not yet working. The test shows wrong bats. Looking into it.

1 0

Re: [Monetdb-developers] [Monetdb-pf-checkins] pathfinder/compiler/algebra load_stats.c, , 1.2, 1.3
by Stefan Manegold 04 Jul '07

04 Jul '07

On Tue, Jul 03, 2007 at 02:20:25PM +0000, Alexander Gafriller wrote: > Update of /cvsroot/monetdb/pathfinder/compiler/algebra > In directory sc8-pr-cvs16.sourceforge.net:/tmp/cvs-serv26332 > > Modified Files: > load_stats.c > Log Message: > * compiler error fixed > > /scratch/monet.GNU.64.64.s.25128/pathfinder/compiler/algebra/load_stats.c:84: warning: pointer targets in passing argument 1 of 'atoi' differ in signedness > /scratch/monet.GNU.64.64.s.25128/pathfinder/compiler/algebra/load_stats.c:86: warning: pointer targets in passing argument 1 of 'atoi' differ in signedness > /scratch/monet.GNU.64.64.s.25128/pathfinder/compiler/algebra/load_stats.c:88: warning: pointer targets in passing argument 1 of 'atoi' differ in signedness Hi Alexander, thanks for noticing and fixing it instantly! A perfect start as new MonetDB developer!! ;-) > and > > /scratch/monet.ntv.64.32.d.25128/pathfinder/compiler/debug/../include/load_stats.h(71): error #310: old-style parameter list (anachronism) > PFguide_tree_t* PFguide_tree(); > ^ this one still failes; I guess, your forgot to checkin your changes in pathfinder/compiler/include/load_stats.h ... Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

1 0

Re: [Monetdb-developers] [Monetdb-sql-checkins] sql/src/benchmarks/tpch/Tests 01-22.stable.out, , 1.8, 1.9 01.stable.out, , 1.10, 1.11 18.stable.out, , 1.9, 1.10
by Martin Kersten 29 Jun '07

29 Jun '07

Gaan we Venks en Colin separaat benadering om te testen?

1 0

[Monetdb-developers] build problem for java jdbc driver
by Frans Verster 23 Jun '07

23 Jun '07

Hi monetdb-developers, I just build the MonetDB-Venus-SuperBall-SR1, the build of the c code went ok (nice!) except for the java jdbc driver I do find checking for javac itself in the build log but not the actual use of it. Do i build correctly? /var/tmp/MonetDB-1182546749/log : Fri Jun 22 23:12:29 CEST 2007 called with arguments: --prefix=/tmp/frans/MonetDB --enable-sql --enable-xquery Calling javac (1.6.0) with all/most files does not help: javac nl/cwi/monetdb/jdbc/*.java nl/cwi/monetdb/jdbc/MonetDataSource.java:57: cannot find symbol symbol : class MonetDriver location: class nl.cwi.monetdb.jdbc.MonetDataSource private MonetDriver driver; ^ etc... The only file with that name is /var/tmp/MonetDB-1182546749/MonetDB-client/clients/src/java/src/nl/cwi/monetdb/jdbc/MonetDriver.java.in but renaming doesnt help. and for an other file: nl/cwi/monetdb/jdbc/MonetClob.java:35: nl.cwi.monetdb.jdbc.MonetClob is not abstract and does not override abstract method getCharacterStream(long,long) in java.sql.Clob public class MonetClob implements Clob { ^ Did the jdbc changed with java 1.6, is the code compatible? Howto proceed? Thanks in advance Frans Verster

2 1

[Monetdb-developers] problem building monetdb from cvs stable
by Colin Foss 22 Jun '07

22 Jun '07

I've read some recent emails about stable having issues so forgive me if this is expected behaviour at the moment. When I run monetdb-install.sh --enable-sql --prefix=/var/lib/MonetDB --enable-optimise --cvs=stable I receive the following cvs error: cvs [export aborted]: no such tag stable Please refer to the full log at /var/tmp/MonetDB-1182455148/log If you believe this is an error in the script or the software, file a bug and attach the logfile. exporting MonetDB from CVS failed! monetdb-install.sh: line 204: glibtool: command not found Am I doing something wrong?

2 1

Re: [Monetdb-developers] [MonetDB-users] SQL server startup time problem (undo/redo problem?)
by Martin Kersten 20 Jun '07

20 Jun '07

Dear James, Can you specify the system you are working on, e.g. hardware/os. You are really beating the system. I don't know a system that can handle a TPC-H SF100 out of the box. This size often require a multistage process and careful setting of the system parameters. But, let's see what you have done and learn from your experience. James Laken wrote: > Dear MonetDB Developers and Users, > > My TPC-H SF100 test is still producing interesting problems. After > several hours of work I have managed to import near 420 million record > to the lineitem table (7x 60 million record slice). Accidentally I Ok, you perform a sliced base load. i.e. 7 x a SF-10 > killed the import process, and stopped the server process. I have tried Did you stop and restart the server between the loads? If not, then from a recovery point of view all 420M are stored in a single log file and become the target of a single reload. It behaves as if you loaded the 7x60M as a single batch. Killing a database process is of course hard. In that case, the recovery process has to reload the data and enters a really expensive part of TPC-H: ensure correctness of the integrity relationships. Protection against this is hard, because it requires that integrity rules enforcement should either be disabled (the method persued in MySQL). > to restart the server process but after three hours of intensive > processing the sql module still not started. Please note that the > initialization process allocated nearly all memory and swap. This is what we expect. Your tables require a lot of space, because MonetDB does not automatically partitioning it. (That's scheduled for an upcoming release ;-)) > > I have attached a gdb to the server process and the execution stacks > looks like this: > > Program received signal SIGINT, Interrupt. > 0x00002b240cb1c2a4 in file_read () from /usr/lib/libstream.so.0 > (gdb) where > #0 0x00002b240cb1c2a4 in file_read () from /usr/lib/libstream.so.0 > #1 0x00002b240cb1b744 in stream_readLngArray () from > /usr/lib/libstream.so.0 > #2 0x00002b240c67a27f in lngRead () from /usr/lib/libbat.so.0 > #3 0x00002b240c788e90 in logger_readlog () from /usr/lib/libbat.so.0 > #4 0x00002b240c789b0c in logger_create () from /usr/lib/libbat.so.0 > #5 0x00002aaaaab42658 in store_init () from > /usr/lib/MonetDB5/lib/lib_sql.so > #6 0x00002aaaaab179b3 in mvc_init () from /usr/lib/MonetDB5/lib/lib_sql.so > #7 0x00002aaaaaacf9f4 in SQLinit () from /usr/lib/MonetDB5/lib/lib_sql.so > #8 0x00002b240bf89e3a in initScenario () from /usr/lib/libmal.so.0 > #9 0x00002aaaaaacf968 in SQLsession () from > /usr/lib/MonetDB5/lib/lib_sql.so > #10 0x00002b240bf6536e in runMALsequence () from /usr/lib/libmal.so.0 > #11 0x00002b240bf6697b in runMAL () from /usr/lib/libmal.so.0 > #12 0x00002b240bf5f3f3 in MALengine () from /usr/lib/libmal.so.0 > #13 0x00002b240bf5e3ab in callString () from /usr/lib/libmal.so.0 > #14 0x0000000000402a65 in main () > (gdb) c > Continuing. > > Program received signal SIGINT, Interrupt. > 0x00002b240d6c31a0 in malloc () from /lib/libc.so.6 > (gdb) where > #0 0x00002b240d6c31a0 in malloc () from /lib/libc.so.6 > #1 0x00002b240c675c04 in GDKmallocmax () from /usr/lib/libbat.so.0 > #2 0x00002b240c675da9 in GDKmalloc () from /usr/lib/libbat.so.0 > #3 0x00002b240c6787ee in strRead () from /usr/lib/libbat.so.0 > #4 0x00002b240c788e90 in logger_readlog () from /usr/lib/libbat.so.0 > #5 0x00002b240c789b0c in logger_create () from /usr/lib/libbat.so.0 > #6 0x00002aaaaab42658 in store_init () from > /usr/lib/MonetDB5/lib/lib_sql.so > #7 0x00002aaaaab179b3 in mvc_init () from /usr/lib/MonetDB5/lib/lib_sql.so > #8 0x00002aaaaaacf9f4 in SQLinit () from /usr/lib/MonetDB5/lib/lib_sql.so > #9 0x00002b240bf89e3a in initScenario () from /usr/lib/libmal.so.0 > #10 0x00002aaaaaacf968 in SQLsession () from > /usr/lib/MonetDB5/lib/lib_sql.so > #11 0x00002b240bf6536e in runMALsequence () from /usr/lib/libmal.so.0 > #12 0x00002b240bf6697b in runMAL () from /usr/lib/libmal.so.0 > #13 0x00002b240bf5f3f3 in MALengine () from /usr/lib/libmal.so.0 > #14 0x00002b240bf5e3ab in callString () from /usr/lib/libmal.so.0 > #15 0x0000000000402a65 in main () > > Any idea? > > Regards, > J. > > > > ------------------------------------------------------------------------- > This SF.net email is sponsored by DB2 Express > Download DB2 Express C - the FREE version of DB2 express and take > control of your XML. No limits. Just data. Click to get it now. > http://sourceforge.net/powerbar/db2/ > _______________________________________________ > MonetDB-users mailing list > MonetDB-users(a)lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/monetdb-users

2 2