August 2015 - users-list

Release Jul2015
by Luciano Sasso 31 Aug '15

31 Aug '15

Jul2015 is stable version ? This master/slave(master pull data for salave automatic) features this release Jul2015? -- Luciano Sasso Vieira Data Scientist & Solutions Architect luciano(a)gsgroup.com.br <http://www.gsgroup.com.br> | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br <http://www.gsgroup.com.br> --- Este email foi escaneado pelo Avast antivírus. https://www.avast.com/antivirus

2 1

Information for Datastorage, Indizes and Query optimization
by Dennis Wiest 31 Aug '15

31 Aug '15

Hello there, there is detailed information about MonetDB with respect to the data storage, indexing and query optimization. I think, unfortunately, on the website is not very much. Special for the Internal index and query optimization. Can you help me there? I need that for my work. greetings Wiest Dennis ________________________________ Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Gesch?ftsf?hrer/Managing Director: Antonio Maria Gonzalez Gorostiza VAT No.: DE223719716 http://avitech.aero

3 4

dplyr & monetdb - appropriate syntax for querying schema.table?
by Enzo 31 Aug '15

31 Aug '15

I’ve just posted the following on stackoverflow. Any help is welcome! In monetdb I have set up a schema main and my tables are created into this schema. For example, the department table is main.department. With dplyr I try to query the table: mdb <- src_monetdb(dbname="model", user="monetdb", password="monetdb") tbl(mdb, "department") But I get Error in .local(conn, statement, ...) : Unable to execute statement 'PREPARE SELECT * FROM "department"'. Server says 'SELECT: no such table 'department'' [#42S02]. I tried to use "main.department" and other similar combinations with no luck. What is the appropriate syntax? Enzo enzo(a)smartinsightsfromdata.com

2 1

password issue with Jul2015 Feature release of MonetDB suite
by Enzo 29 Aug '15

29 Aug '15

I do not seem to be able to log in R: the following was working before, but now it doesn’t. aconn <- dbConnect(MonetDB.R(), "monetdb://localhost:50000/ClevelandBaseModel", user= "monetdb", password="monetdb”) Error in .mapiAuthenticate(socket, dbname, user, password, language = language) : Authentication error: !InvalidCredentialsException:checkCredentials:invalid credentials for user ‘monetdb’ Has the password been changed?? Enzo enzo(a)smartinsightsfromdata.com

1 1

issue granting administrator rights
by Enzo 28 Aug '15

28 Aug '15

I have successfully managed to configure multi-user access to my user defined schema. All the users are granted monetdb “rights with: GRANT monetdb TO user1 Once logging the new user has ability to SELECT / DROP / INSERT etc. in the user schema. Sadly at the time of executing the MonetDB.R command: tStatus <- dbWriteTable(conn, tPFile, dataDt,overwrite=TRUE, csvdump=TRUE) I’ve got: Unable to execute statement 'COPY OFFSET 2 INTO demand FROM '/Users/xxx/demand.csv' USIN...'. Server says '!COPY INTO: insufficient privileges: COPY INTO from file(s) requires database administrator rights, use 'COPY INTO "demand" FROM STDIN' instead' So clearly GRANT monetdb TO user1 is not enough to empower user1. I tried: GRANT monetdb to “user1" WITH ADMIN OPTION; But at this point after: SET SCHEMA cleveland; SET ROLE monetdb; I get error "Role (monetdb) missing” It does not seem correct to me: surely it should be possible to grant rights to a user at the same level of “monetdb”, including administrator rights? Enzo enzo(a)smartinsightsfromdata.com

1 0

Re: any idea what's going on here? it was created under the previous version but now isn't loading after upgrade
by Niels Nes 28 Aug '15

28 Aug '15

On Fri, Aug 28, 2015 at 06:29:38AM -0400, Anthony Damico wrote: > hi, thanks, here's the file from > > R:\American Community Survey\MonetDB\acs\bat\BACKUP\BBP.dir So the db upgrade did create the sql_dsnapshots bat, but its not part of the sql catalog. Fixed a bug in the code for this now. Niels > > On Fri, Aug 28, 2015 at 5:56 AM, Niels Nes <Niels.Nes(a)cwi.nl> wrote: > > On Thu, Aug 27, 2015 at 02:09:22PM -0400, Anthony Damico wrote: > > # MonetDB 5 server v11.21.3 "Jul2015" > > # Serving database 'acs', using 4 threads > > # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically > linked > > # Found 64.000 GiB available main-memory. > > # Copyright (c) 1993-July 2008 CWI. > > # Copyright (c) August 2008-2015 MonetDB B.V., all rights > reserved > > # Visit http://www.monetdb.org/ for further information > > # Listening for connection requests on mapi:monetdb:// > 127.0.0.1:50001/ > > # Start processing logs sql/sql_logs version 52200 > > !FATAL: Logger_new: BBPrename to sql_dsnapshots failed > > Press any key to continue . . . > > > _______________________________________________ > > users-list mailing list > > users-list(a)monetdb.org > > https://www.monetdb.org/mailman/listinfo/users-list > > Anthony > > As the server doesn't successfully start we need to see why the > rename > fails. Could you check the BBP.dir file (usualy in the bat > directory of > your dbpath, sometimes in the BACKUP directory there), and see > if a bat with this name exists (sql_dsnapshots). > > Niels > > > -- > Niels Nes, Manager ITF, Centrum Wiskunde & Informatica (CWI) > Science Park 123, 1098 XG Amsterdam, The Netherlands > room L3.14, phone ++31 20 592-4098 sip:4098@sip.cwi.nl > url: https://www.cwi.nl/people/niels e-mail: Niels.Nes(a)cwi.nl > _______________________________________________ > users-list mailing list > users-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/users-list > > -- Niels Nes, Manager ITF, Centrum Wiskunde & Informatica (CWI) Science Park 123, 1098 XG Amsterdam, The Netherlands room L3.14, phone ++31 20 592-4098 sip:4098@sip.cwi.nl url: https://www.cwi.nl/people/niels e-mail: Niels.Nes(a)cwi.nl

3 2

any idea what's going on here? it was created under the previous version but now isn't loading after upgrade
by Anthony Damico 28 Aug '15

28 Aug '15

# MonetDB 5 server v11.21.3 "Jul2015" # Serving database 'acs', using 4 threads # Compiled for x86_64-pc-winnt/64bit with 64bit OIDs dynamically linked # Found 64.000 GiB available main-memory. # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2015 MonetDB B.V., all rights reserved # Visit http://www.monetdb.org/ for further information # Listening for connection requests on mapi:monetdb://127.0.0.1:50001/ # Start processing logs sql/sql_logs version 52200 !FATAL: Logger_new: BBPrename to sql_dsnapshots failed Press any key to continue . . .

2 1

Multiple MonetDB nodes behind HAProxy loadbalancer
by Dennis Pallett 20 Aug '15

20 Aug '15

Hi all, We're thinking about running multiple MonetDB servers with the same databases behind a single HAProxy loadbalancer (see attached diagram). Would this be a good idea? bad idea? Any experiences with this kind of setup? We are thinking about this route primarily so that we can bring a new dataset online during business hours without disrupting end-users who are running queries from our application. An additional benefit would be the ability to handle more load and enable horizontal scalability. Any insights would be much appreciated! Best regards, Dennis

3 3

Jul2015 Release Candidate
by Sjoerd Mullender 19 Aug '15

19 Aug '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 I have created a release candidate for the Jul2015 release. The candidate is available at http://dev.monetdb.org/downloads/testing/. If all goes well, this candidate will morph into a release sometime soon(ish). In the mean time, you can use this release candidate and test to see whether it works. And if it doesn't work, I would really like to hear about it. - -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJVyKZgAAoJEISMxT6LrWYgE28H/2rudFXhcIfNgnX4yYJlpRT5 eI2Dzp9kShEmRibvNkWvCEF1j/qyWgQhx/jlHvucuEF/0k+U+7NYuK0vhzA0llyJ hspMkQ73UDXeVO0/SivtNYb40UpMyUQoXC7nSaSneglVDe4JcX4S3Y5GvHPByiqz 3UNMGDARfWlqPcbTtW57XfLejK/sd8nNZ3mGQuerVqEvMcKZaZIBSXjg/16WQVsN DMbPacPpu3yFeWQQtP2er6SL3UdfwgOP5+VNifKyjW9i6ZtB2lHWLEBWQY8G/5Tb 5lwgHvD99SJeLRMzcW5TFWhwv0ROx8chKP3btxMofZxjHhqseswGRLNDQa4XCU0= =ktpg -----END PGP SIGNATURE-----

6 13

RE: Concurrent queries problem (Gustavo Brian)
by Gustavo Brian 18 Aug '15

18 Aug '15

Hi, After checking CPU (48 cores) none of them get over 15%, there's free memory (119Gb) and 0% reads but high WRITE activity, any idea why? Thanks, Gustavo Brian Developer -----Original Message----- From: users-list [mailto:users-list-bounces+gustavo.brian=sunhotels.net@monetdb.org] On Behalf Of users-list-request(a)monetdb.org Sent: lunes, 17 de agosto de 2015 12:00 To: users-list(a)monetdb.org Subject: users-list Digest, Vol 36, Issue 19 Send users-list mailing list submissions to users-list(a)monetdb.org To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request(a)monetdb.org You can reach the person managing the list at users-list-owner(a)monetdb.org When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..." Today's Topics: 1. Concurrent queries problem (Gustavo Brian) 2. Re: Concurrent queries problem (Martin Kersten) 3. Inserting in 'raw' mode?? (Vijay Krishna) ---------------------------------------------------------------------- Message: 1 Date: Sun, 16 Aug 2015 17:07:41 +0000 From: Gustavo Brian <Gustavo.Brian(a)sunhotels.net> To: "users-list(a)monetdb.org" <users-list(a)monetdb.org> Subject: Concurrent queries problem Message-ID: <4A8379DA0ABDFC42B172EDB698BD76E8D46EF829@mailbox02> Content-Type: text/plain; charset="iso-8859-1" Hi, I'm using one big table a my main storage for hotel prices and I'm running queries to get the best prices for specific dates and a couple of filters. On one test I have a query scanning 30 millions rows in ~400ms but when I try to run several queries at a time monetdb hangs. I've tried creating a funnel over the database but same result. What's the best approach if I need to run 150 queries per second ? Thanks in advance, Gustavo Brian Developer SunHotels E-mail Skype Tel Fax Web Operational Office gustavo.brian(a)sunhotels.net<mailto:gustavo.brian@sunhotels.net> Gustavo.brian.sunhotels +34 871 955 649 +34 971 281 460 www.sunhotels.org SunHotels Calle Cal?at 6 Pol?gono Son Valent? 07011 Palma de Mallorca Spain >> Winner of Grand Travel Award - Best Provider in Scandinavia << Confidential and proprietary information notice: This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and are hereby notified that any disclosure, copying, or distribution of this message, or the taking of any action based on it, is strictly prohibited. Please preserve message history when replying to this e-mail

1 0