March 2016 - users-list

Bitwise operations in Monetdb
by Shmagi Kavtaradze 11 Mar '16

11 Mar '16

I am new to Monetdb. I am using Postgresql mainly, but want to check Monetdb performace. In Postres I have column of type bit() filled with 0s and 1s. Then I am comparing each row to all other rows with bitwise AND on that column. Monetdb does not have bit() type so I used text. Any ideas how to do bitwise AND in monetdb and what type of column should I use for this? The query I tried: select a.sentenecid, b.sentenecid, a.sentence AND b.sentence from test a, test b;

4 11

Monitoring JDBC Connections
by Arno Mittelbach 11 Mar '16

11 Mar '16

Hi all, I am looking for a way to monitor open remote connections (i.e., JDBC connections) and possibly to force close them. As far as I can tell, MonetDB restricts the number of simultaneous connections to 64 by default. Via select * from sys.queue I can monitor running queries but I haven't yet figured out a way to list all open connections. Consider e.g. the case that a JDBC connection is for some reason not properly closed. Any hints would be much appreciated. Best regards, Arno

1 0

R session crashes every time with MonetDBLite package
by David Jankoski 08 Mar '16

08 Mar '16

Hi everone, I am new to this help list so before I post my problem I just want to ask how to provide as much information as possible ( in terms of log files and similar) The problem : Using the MonetDBLite package for R i pushed a relatively big chunk of data (~ 11 Mil rows x 14 cols) in a monetDB lite on disk. Now _every_ time i try connecting to it and running some commands, it crashes my R session. Happens with RStudio and Rgui. So, what additional information to this should i provide in order to best describe the problem : - Machine & OS info, R version, sessionInfo(), R script i'm trying to run. Are there any additional logs kept by monetDB which would be helpful ? Thanks in front, David -- [image: hellotrip] <http://www.hellotrip.fr/> *David Jankoski* <http://www.hellotrip.fr/> Teerketelsteeg 1 1012TB Amsterdam www.hellotrip.com [image: Twitter] <https://twitter.com/hellotrip_nl>[image: facebook] <http://facebook.com/HellotripNederland>[image: Linkedin] <https://www.linkedin.com/company/hellotrip>

2 1

Re: MonetDB: leftmart - trying to fix Windows compilation: do not "i...
by Lefteris 08 Mar '16

08 Mar '16

Dear Souri, please direct these kind of questions not at the developers-list but at the users-list (users-list(a)monetdb.org) Now for the issue at hand. Which version of monetdb are you using and which operating system? In order for us to reproduce the error, we need to know the schema of both the main and temp table (you can hide attribute names if it is sensitive information) and also the *exact* query you are using to copy rows from one table to the other. If you could also share the values of the records would also help. In general you have to provide us with more information on your setup, and a way to reproduce the problem:) Also, did you check the merovegnian.log ? no errors there? Maybe you can attach a debugger and see where monetdb fails? Thank you, Lefteris On Tue, Mar 8, 2016 at 6:08 AM, Souri Ratnaparkhi < souri.ratnaparkhi(a)usain.com> wrote: > Hello monetdb team, > > A gentle reminder. > We have a main table with 126 columns and approx. 94000 rows. > We are trying to load approx 2500 records from temporary table into main > table using query “insert into select” query. The database crashes upon > query execution. No specific error is created in log file. > When tried with 1500 records, it works. > We also created another main table with same DDL, that table is empty & > inserted all the records from temp successfully without any issue. > > What could be the reason? Is 126 cols an issue? Please help. We are stuck. > > (btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free)) > > Thank you > > > Souri Ratnaparkhi > United Software Associates Pvt. Ltd. > Pune, India > Mob: 8975677255 > Phone (India Lines): (91) 020-25445550 > www.usain.com > > > -----Original Message----- > From: developers-list > [mailto:developers-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] > On Behalf Of Stefan Manegold > Sent: Tuesday, March 08, 2016 5:05 AM > To: Lefteris > Cc: Communication channel for developers of the MonetDB > Subject: Re: MonetDB: leftmart - trying to fix Windows compilation: do not > "i... > > > My mistake. Sorry! > > Stefan > > ----- On Mar 8, 2016, at 12:12 AM, Lefteris lsidir(a)gmail.com wrote: > > > Stefan, > > > > this needs to be inlined because it is used many times. I will deal > > with compilation issues later on. This is a dev branch and we are > > running different experiments every night. But with this change if > > measured times are different I would not know if it is because of > > other changes or because of the inline statement removal. > > > > I would appreciate if you did not make any changes in this branch at > > the moment. > > > > thank you, > > > > lefteris > > > > > > On Mon, Mar 7, 2016 at 8:34 PM, Stefan Manegold < > > commits+Stefan.Manegold=cwi.nl(a)monetdb.org> wrote: > > > >> Changeset: ea1aed8beff8 for MonetDB > >> URL: > >> http://dev.monetdb.org/hg/MonetDB?cmd=changeset;node=ea1aed8beff8 > >> Modified Files: > >> gdk/gdk_bloom.c > >> Branch: leftmart > >> Log Message: > >> > >> trying to fix Windows compilation: do not "inline" BLOOMask() > >> > >> On Windows, compilation fails with > >> failed invocation: cl -GF -W3 -WX -MD -nologo -Ox -Zi -Oi -I. -I.\.. > >> -I.\..\..\gdk -I..\common\options -I.\..\..\gdk\..\common\options > >> -I..\common\stream -I.\..\..\gdk\..\common\stream -I..\common\utils > >> -I.\..\..\gdk\..\common\utils -I.\..\..\buildtools\conf -DHAVE_ICONV > >> -IC:\Libraries\iconv-1.11.1.win64-vs2010\include -DHAVE_LIBATOMIC_OPS > >> -IC:\Libraries\atomic_ops-7.4.2 -DNDEBUG -LD -Felibbat.dll > >> gdk_batop.obj gdk_select.obj gdk_search.obj gdk_hash.obj gdk_tm.obj > >> gdk_orderidx.obj gdk_align.obj gdk_bbp.obj gdk_heap.obj gdk_utils.obj > >> gdk_atoms.obj gdk_qsort.obj gdk_ssort.obj gdk_storage.obj gdk_bat.obj > >> gdk_delta.obj gdk_cross.obj gdk_system.obj gdk_value.obj > >> gdk_posix.obj gdk_logger.obj gdk_sample.obj gdk_calc.obj gdk_aggr.obj > >> gdk_group.obj gdk_imprints.obj gdk_bloom.obj gdk_join.obj > >> gdk_project.obj gdk_unique.obj gdk_firstn.obj libbat.res /link > >> ..\common\options\monet_options.obj > >> ..\common\stream\libstream.lib ..\common\utils\mutils.obj > >> ..\common\utils\prompt.obj wsock32.lib Ws2_32.l ib > >> C:\Libraries\zlib-1.2.8.win64-vs2010\lib\zdll.lib > >> C:\Libraries\bzip2-1.0.6.win64-vs2010\lib\libbz2.lib psapi.lib > >> Creating library libbat.lib and object libbat.exp gdk_join.obj : > >> error LNK2019: unresolved external symbol BLOOMask referenced in > >> function hashjoin libbat.dll : fatal error LNK1120: 1 unresolved > >> externals > >> > >> > >> Maybe, the fact that BLOOMask() is "inline"d triggers this problem ... > >> > >> > >> diffs (11 lines): > >> > >> diff --git a/gdk/gdk_bloom.c b/gdk/gdk_bloom.c > >> --- a/gdk/gdk_bloom.c > >> +++ b/gdk/gdk_bloom.c > >> @@ -240,7 +240,6 @@ BATbloom(BAT *b) > >> return GDK_SUCCEED; > >> } > >> > >> -inline > >> int BLOOMask(BUN v, Bloomfilter *bloom) { > >> BUN hv,mv,x,y,z; > >> _______________________________________________ > >> checkin-list mailing list > >> checkin-list(a)monetdb.org > >> https://www.monetdb.org/mailman/listinfo/checkin-list > > -- > | Stefan.Manegold(a)CWI.nl | DB Architectures (DA) | > | www.CWI.nl/~manegold/ | Science Park 123 (L321) | > | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | > _______________________________________________ > developers-list mailing list > developers-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/developers-list >

1 0

BATfetchjoin does not hit always => can't use fetchjoin
by John Burgess 07 Mar '16

07 Mar '16

Hi, I'm completely new to monetdb and have been dropped in at the deep end with an application support issue at a customer site. The release running is FEB2013 SP6 on Windows Server 2012 64 bit. There are customizations including aggregate functions written in MAL so the issue may not derive from monetdb source. I have searched bug lists but not found an obvious match for the error that is being reported, so I'm wondering whether anyone has experienced similar symptoms and found a solution. (Bug 3375 is the closest match and was fixed in the release in use) The reported problem is that the application works normally for a period until something causes monetdb to consistently report errors: Error: GDK reported error. SQLState: 22000 ErrorCode: 0 Error: BATfetchjoin(tmp_3662,tmp_4362) does not hit always (|bn|=0 != 2660745=|l|) => can't use fetchjoin. SQLState: 22000 ErrorCode: 0 It has been noted that the error appears to be in response to some SQL which up to that point had been working : select count(*) as "_m1_", avg("B"."C") as "_m2_" from "A" left outer join "B" on "A"."A_ID" = "B"."A_ID" Further, there is a foreign key relationship defined: ALTER TABLE "B" ADD CONSTRAINT fk_B FOREIGN KEY ("A_ID") REFERENCES "A"("A_ID") and dropping the index corresponding to the foreign key causes monetdb to recover. i.e. drop index fk_B All suggestions would be gratefully appreciated. In the meantime, I will try to reproduce the issue in house. Thanks, John Burgess ________________________________

3 5

should DROP TABLE work even after a table has been SET READ ONLY?
by Anthony Damico 07 Mar '16

07 Mar '16

hi, this bugzilla ticket is marked as resolved, but this behavior seems unintuitive to me.. is it ok? thanks team CREATE TABLE my_table AS SELECT 1 AS my_column WITH DATA; ALTER TABLE my_table SET READ ONLY; SELECT COUNT(*) FROM my_table; DROP TABLE my_table; from https://www.monetdb.org/bugzilla/show_bug.cgi?id=3895

3 3

extreme performance breakdown after update
by Andreas F. Hoffmann 06 Mar '16

06 Mar '16

Hello List, I'm running monetdb on a Debian server and the software is managed via Debian packages. A few days ago I installed an update for the monetdb5-server package. After that I noticed a problem with queries with the function lower() in the WHERE clause: >>WHERE LOWER(“fieldname”) LIKE '%lower_string%'<< without any change to the data, the requests became much, much slower then before (from some hundred microseconds to some minutes). Not only in my application but also in the monetdb client... I could solve the problem via a switch from using LIKE to ILIKE and no lower()-function, but I'm curious what could be the cause for this dramatic performance breakdown? I searched the release history but I found nothing... Has anybody experienced the same effect? Anny ideas on this phenomenon? Greetings from Germany, Andreas (theafh)

4 6

how to turn off double quotes
by Anton Kravchenko 03 Mar '16

03 Mar '16

Hi there, I wonder if there is a way to "copy select * from some_table into '\path\to\some.csv' delimiters ','; ", so that in output csv there is no double quotes for char vars? (for example, some_string instead of "some_string") P.S. I am using MonetDB v11.21.11 (Jul2015-SP1) on Windows. Thank you, Anton

1 1

(no subject)
by Anthony Damico 03 Mar '16

03 Mar '16

http://stackoverflow.com/questions/35730919/monetdb-select-query-slow-when-…

1 0

how to change the user "monetdb" password?
by Lynn Carol Johnson 02 Mar '16

02 Mar '16

Hi all - I've been googling to try and find a method of changing the default password for user monetdb. The links I've found are all 8-9 years old (e.g. This<https://www.monetdb.org/pipermail/users-list/2007-December/001345.html> one) My commands: 1. monetdbd stop <mydbfarm> 2. cd /Usr/local/monetdb/bin 3. ./mserver5 Then execute a change password command and get these results, which look similar to the email exchange noted in the 8 year old link above: rs-btlcj34lt:bin lcj34$ ./mserver5 # MonetDB 5 server v11.21.11 "Jul2015-SP1" # Serving database 'demo', using 8 threads # Compiled for x86_64-apple-darwin14/64bit with 64bit OIDs and 128bit integers dynamically linked # Found 16.000 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50000/ # MonetDB/GIS module loaded # Start processing logs sql/sql_logs version 52200 # Finished processing logs sql/sql_logs # MonetDB/SQL module loaded >changePassword("monetdb","bucklerLab"); !TypeException:user.main[1]:'user.changePassword' undefined in: user.changePassword("monetdb":str,"bucklerLab":str); > We are opening up our database to some outside folks. I've successfully created a read-only user/pwd for them, but want to protect the db by changing the default monetdb user password. I'm practicing on my own local copy before messing with our "real" db, but can't get this to work. Is there some other way I should be going about this? One additional question: What is the "passphrase" parameter I see when I run "monetdbd get all <mydbfarm>"? I tried playing with that but have not found what it effects. Thanks - Lynn

2 2