Hi,
With a build of the latest version in the Jan2014 branch I encounter a problem which worked fine in the Feb2013-SP5 release.
I load multiple files into a single table with a COPY INTO … LOCKED statement for each file. This seems to work correctly but
When quering this table I get the following results (note I masked sensitive data with 9’s but that does not matter):
bkaptijn@DevRef1:~/DDDB$ mclient -d cacis
Welcome to mclient, the MonetDB/SQL interactive terminal (unreleased)
Database: MonetDB v11.17.2 (unreleased), 'mapi:monetdb://DevRef1:50000/cacis'
Type \q to quit, \? for a list of available commands
auto commit mode: on
sql>SELECT COUNT(*) FROM source1;
+---------+
| L1 |
+=========+
| 6474324 |
+---------+
1 tuple (0.662ms)
sql>SELECT COUNT(*), file FROM source1 GROUP BY file;
+---------+-----------------------------------------------------------------------------+
| L1 | file |
+=========+=============================================================================+
| 809290 | /home/bkaptijn/DDDB/.tmpinputdir/9723_9999_20130301_20130331_Schade_516.ASC |
| 1618580 | /home/bkaptijn/DDDB/.tmpinputdir/9772_9999_20130501_20130531_Schade_516.ASC |
| 809290 | /home/bkaptijn/DDDB/.tmpinputdir/9787_9999_20130401_20130430_Schade_516.ASC |
| 809290 | /home/bkaptijn/DDDB/.tmpinputdir/9788_9999_20130601_20130630_Schade_516.ASC |
| 1618580 | /home/bkaptijn/DDDB/.tmpinputdir/9795_9999_20130701_20130731_Schade_516.ASC |
| 809294 | /home/bkaptijn/DDDB/.tmpinputdir/9978_9999_20130801_20130831_Schade_516.ASC |
+---------+-----------------------------------------------------------------------------+
6 tuples (13.204ms)
sql>\q
bkaptijn@DevRef1:~/DDDB$ wc -l /home/bkaptijn/DDDB/.tmpinputdir/9772_9999_20130501_20130531_Schade_516.ASC
1655861 /home/bkaptijn/DDDB/.tmpinputdir/9772_9999_20130501_20130531_Schade_516.ASC
bkaptijn@DevRef1:~/DDDB$ wc -l /home/bkaptijn/DDDB/.tmpinputdir/9723_9999_20130301_20130331_Schade_516.ASC
540299 /home/bkaptijn/DDDB/.tmpinputdir/9723_9999_20130301_20130331_Schade_516.ASC
bkaptijn@DevRef1:~/DDDB$ wc -l /home/bkaptijn/DDDB/.tmpinputdir/*.ASC
540299 /home/bkaptijn/DDDB/.tmpinputdir/9723_9999_20130301_20130331_Schade_516.ASC
1655861 /home/bkaptijn/DDDB/.tmpinputdir/9772_9999_20130501_20130531_Schade_516.ASC
476629 /home/bkaptijn/DDDB/.tmpinputdir/9787_9999_20130401_20130430_Schade_516.ASC
886713 /home/bkaptijn/DDDB/.tmpinputdir/9788_9999_20130601_20130630_Schade_516.ASC
1404888 /home/bkaptijn/DDDB/.tmpinputdir/9795_9999_20130701_20130731_Schade_516.ASC
1509934 /home/bkaptijn/DDDB/.tmpinputdir/9978_9999_20130801_20130831_Schade_516.ASC
6474324 total
bkaptijn@DevRef1:~/DDDB$ mclient -d cacis
Welcome to mclient, the MonetDB/SQL interactive terminal (unreleased)
Database: MonetDB v11.17.2 (unreleased), 'mapi:monetdb://DevRef1:50000/cacis'
Type \q to quit, \? for a list of available commands
auto commit mode: on
sql>SELECT COUNT(*) FROM source1 WHERE SUBSTRING(source,1,2) = '04';
+---------+
| L1 |
+=========+
| 2842771 |
+---------+
1 tuple (1.1s)
sql>SELECT * FROM source1 WHERE SUBSTRING(source,1,2) = '04' LIMIT 1 OFFSET 326372;
+------+------+--------+
| file | line | source |
+======+======+========+
+------+------+--------+
0 tuples (752.096ms)
sql>SELECT * FROM source1 WHERE SUBSTRING(source,1,2) = '04' LIMIT 1 OFFSET 326371;
+-----------------------------------------------------------------------------+--------+-------------------------------------------------------------------------------------------+
| file | line | source |
+=============================================================================+========+===========================================================================================+
| /home/bkaptijn/DDDB/.tmpinputdir/9772_9999_20130501_20130531_Schade_516.ASC | 268991 | 04999999999999999999999999999999999999999999999999999999999999999999999 |
+-----------------------------------------------------------------------------+--------+-------------------------------------------------------------------------------------------+
1 tuple (832.778ms)
This can’t be right.
I formerly compiled, build and used the Feb2013 from the mercurial site without problems.
bkaptijn@DevRef1:~/DDDB$ mserver5 --version
MonetDB 5 server v11.17.2 (64-bit, 64-bit oids)
This is an unreleased version
Copyright (c) 1993-July 2008 CWI
Copyright (c) August 2008-2014 MonetDB B.V., all rights reserved
Visit http://www.monetdb.org/ for further information
Found 15.6GiB available memory, 8 available cpu cores
Libraries:
libpcre: 8.12 2011-01-15 (compiled with 8.12)
openssl: OpenSSL 1.0.1 14 Mar 2012 (compiled with OpenSSL 1.0.1 14 Mar 2012)
libxml2: 2.7.8 (compiled with 2.7.8)
Compiled by: bkaptijn@DevRef1 (x86_64-unknown-linux-gnu)
Compilation: gcc -O3 -pipe -Werror -Wall -Wextra -W -Werror-implicit-function-declaration -Wpointer-arith -Wdeclaration-after-statement -Wundef -Wformat=2 -Wno-format-nonliteral -Winit-self
-Winvalid-pch -Wmissing-declarations -Wmissing-format-attribute -Wmissing-prototypes -Wold-style-definition -Wpacked -Wunknown-pragmas -Wvariadic-macros -fstack-protector-all -Wstack-protector -Wpacked-bitfield-compat -Wsync-nand -Wjump-misses-init -Wmissing-include-dirs
-Wlogical-op -Wunreachable-code -Wp,-D_FORTIFY_SOURCE=2
Linking : /usr/bin/ld -m elf_x86_64
Is this a bug?
Regards,
Bas Kaptijn
PS I also tried to install the Jan2014 RC1 but I can’t get it working on my Ubuntu (precise) system. First it misses libstream6.so while a libstream3.so was installed… when creating a
symlink referring to the libstream3 lib it fails to startup mentioning that it can not setup communication channel. The Merovingian log mentions a MALException that says that it can not write to the “querylog” (which I also can not find in the dbfarm where
I though it should be) and a MALException something about sysmon.