October 2017 - users-list

MonetDB build failure on Alpine Linux
by Artem Klevtsov 14 Oct '17

14 Oct '17

Hi, I tried to build MonetDB from source on the Alpine Linux. But build process was stopped with the following message: merovingian.c: In function 'main': merovingian.c:835:51: error: 'S_IRWXO' undeclared (first use in this function) (e = openConnectionUNIX(&unsock, control_usock, S_IRWXO, _mero_ctlout)) == NO_ERR) { ^~~~~~~ merovingian.c:835:51: note: each undeclared identifier is reported only once for each function it appears in … [View More]

1 0

RE: users-list Digest, Vol 62, Issue 5
by Warren Master 13 Oct '17

13 Oct '17

Restarting the server resolved the issue. I did not look at the plans.. There still remains the isse that tables can be added multiple times to the same merge table causing duplicate rows to be returned In some cases we were unable to remove a table from a merge table without first dropping the merge table Additionally we also have issues with bulk copy into tables of merge tables GDKerror:!ERROR: Incompatible operands. - this occurs now and then.. the only fix is to drop the merge table , … [View More]drop the affecting table that fails to bulk copy to , recreate it and recreate the merge table. When I tried to drop the table after removing from the merge table , the server would core dump., I was only able to drop the bad table after dropping the merge table, the alter table Merge Table drop table Sub Table did not work Warren S. Master Chief Technology Officer, TRG Management LP 280 Park Avenue - 30th floor/West - New York, NY 10017 Phone 212.984.3504 Email warren.master(a)rohatyngroup.com Web www.rohatyngroup.com Linkedin www.linkedin.com/in/warrenmaster -----Original Message----- From: users-list [mailto:users-list-bounces+warren.master=rohatyngroup.com@monetdb.org] On Behalf Of users-list-request(a)monetdb.org Sent: Friday, October 13, 2017 6:00 AM To: users-list(a)monetdb.org Subject: users-list Digest, Vol 62, Issue 5 Send users-list mailing list submissions to users-list(a)monetdb.org To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request(a)monetdb.org You can reach the person managing the list at users-list-owner(a)monetdb.org When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..." Today's Topics: 1. Re: Merge Table Issues (Niels Nes) ---------------------------------------------------------------------- Message: 1 Date: Thu, 12 Oct 2017 20:39:51 +0200 From: Niels Nes <Niels.Nes(a)cwi.nl> To: Communication channel for MonetDB users <users-list(a)monetdb.org> Subject: Re: Merge Table Issues Message-ID: <20171012183951.GA8701(a)niels.cwi.nl> Content-Type: text/plain; charset=utf-8 On Thu, Oct 05, 2017 at 07:29:08PM +0000, Warren Master wrote: > all_vw is a merge table with three tables all with identical structure Warren Do the plan's look correct, ie include the proper member tables? Niels > > > > intraday > > history > > currentyear > > ---------------------------------------------------------------------- > ----------------------- > > > > My merge tables do not return consistent results > > > > I have tried to refresh statistics > > > > ANALYZE sys. intraday (asofdate) MINMAX > > ANALYZE sys. history (asofdate) MINMAX > > ANALYZE sys. currentyear (asofdate) MINMAX > > > > still same issue > > > > the issue exists for a few dates that I checked, there are many days > that do work on the merge table , all dates work on the view and the > individual tables. > > I thought it might be an issue with statistics then the conversion > function made it work on the merge table , so now at a loss. > > > > > > > > the following query on the merge table return no rows > > ---------------------------------------------------------------------- > ----------------------- > > > > select fundid,sum(curdlttot) as fxt > > from vw where asofdate='2017-10-02' > > group by fundid > > > > The following does return data from the merge table albeit, much > slower ? after converting date value > > ---------------------------------------------------------------------- > ----------------------- > > select fundid,sum(curdlttot) as fxt > > from vw where asofdate='2017-10-02D' > > group by fundid > > > > select fundid,sum(curdlttot) as fxt > > from vw where asofdate= date_to_str(asofdate, '%Y-%m-%d') = > '2017-10-02' > > group by fundid > > > > > > the followings query on the subtable of the merge table returns data > with no issues or performance > > ---------------------------------------------------------------------- > ----------------------- > > select fundid,sum(curdlttot) as fxt > > from currentyear where asofdate='2017-10-02' > > group by fundid > > > > creating a view on the union of all three tables returns data as > expected > > > > create view test_all as > > select * from intraday > > union all > > select * from history > > union all > > select * from currentyear > > > > > > select fundid,sum(curdlttot) as fxt > > from test_all where asofdate='2017-10-02' > > group by fundid > > > > > > > > > > > > Warren S. Master > > Chief Technology Officer, CISO > > TRG Management LP > > 280 Park Avenue - 30th floor/West - New York, NY 10017 > > Phone 212.984.3504 > > Email warren.master(a)rohatyngroup.com > > Web www.rohatyngroup.com > > Linkedin www.linkedin.com/in/warrenmaster > > > > This e-mail communication and any attachments may contain confidential > and privileged information and are for use by the intended > addressee(s) only. If you are not the intended addressee, you have > received this communication in error. Any dissemination or > reproduction of this email or its contents is strictly prohibited and > may be unlawful. If you suspect you have received this communication > in error, please notify us immediately by replying to this message and > delete it from your computer.Thank you. > _______________________________________________ > users-list mailing list > users-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/users-list -- Niels Nes, Manager ITF, Centrum Wiskunde & Informatica (CWI) Science Park 123, 1098 XG Amsterdam, The Netherlands room L3.14, phone ++31 20 592-4098 sip:4098@sip.cwi.nl url: https://www.cwi.nl/people/716e-mail: Niels.Nes(a)cwi.nl ------------------------------ Subject: Digest Footer _______________________________________________ users-list mailing list users-list(a)monetdb.org https://www.monetdb.org/mailman/listinfo/users-list ------------------------------ End of users-list Digest, Vol 62, Issue 5 ***************************************** This e-mail communication and any attachments may contain confidential and privileged information and are for use by the intended addressee(s) only. If you are not the intended addressee, you have received this communication in error. Any dissemination or reproduction of this email or its contents is strictly prohibited and may be unlawful. If you suspect you have received this communication in error, please notify us immediately by replying to this message and delete it from your computer.Thank you. [View Less]

1 0

Merge Table Issues
by Warren Master 12 Oct '17

12 Oct '17

all_vw is a merge table with three tables all with identical structure intraday history currentyear --------------------------------------------------------------------------------------------- My merge tables do not return consistent results I have tried to refresh statistics ANALYZE sys. intraday (asofdate) MINMAX ANALYZE sys. history (asofdate) MINMAX ANALYZE sys. currentyear (asofdate) MINMAX still same issue the issue exists for a few dates that I checked, there are many days that do … [View More]work on the merge table , all dates work on the view and the individual tables. I thought it might be an issue with statistics then the conversion function made it work on the merge table , so now at a loss. the following query on the merge table return no rows --------------------------------------------------------------------------------------------- select fundid,sum(curdlttot) as fxt from vw where asofdate='2017-10-02' group by fundid The following does return data from the merge table albeit, much slower - after converting date value --------------------------------------------------------------------------------------------- select fundid,sum(curdlttot) as fxt from vw where asofdate='2017-10-02D' group by fundid select fundid,sum(curdlttot) as fxt from vw where asofdate= date_to_str(asofdate, '%Y-%m-%d') = '2017-10-02' group by fundid the followings query on the subtable of the merge table returns data with no issues or performance --------------------------------------------------------------------------------------------- select fundid,sum(curdlttot) as fxt from currentyear where asofdate='2017-10-02' group by fundid creating a view on the union of all three tables returns data as expected create view test_all as select * from intraday union all select * from history union all select * from currentyear select fundid,sum(curdlttot) as fxt from test_all where asofdate='2017-10-02' group by fundid Warren S. Master Chief Technology Officer, CISO TRG Management LP 280 Park Avenue - 30th floor/West - New York, NY 10017 Phone 212.984.3504 Email warren.master(a)rohatyngroup.com<mailto:warren.master@rohatyngroup.com> Web www.rohatyngroup.com<http://www.rohatyngroup.com/> Linkedin www.linkedin.com/in/warrenmaster<http://www.linkedin.com/in/warrenmaster> This e-mail communication and any attachments may contain confidential and privileged information and are for use by the intended addressee(s) only. If you are not the intended addressee, you have received this communication in error. Any dissemination or reproduction of this email or its contents is strictly prohibited and may be unlawful. If you suspect you have received this communication in error, please notify us immediately by replying to this message and delete it from your computer.Thank you. [View Less]

2 1

mal function returns clob datatype
by Gatis Ozoliņš 10 Oct '17

10 Oct '17

I have string aggregation mal function with this definition: function group_concat(b:bat[:str],s:bat[:str]):str; It was working fine on Dec 2016-SP3, however we upgraded to Jul 2017-SP1 and now function is returning clob datatype. I looked at Changelog and code changes and couldn't find anything that would explain this. Is it feature or bug? Gatis

1 0

make[9]: *** No rule to make target `../../../../sql/backends/monet5/lib_sql.la', needed by `lib_myudfname.la'. Stop.
by Anton Kravchenko 09 Oct '17

09 Oct '17

Hi there, I will try to map my issue to something that you are familiar with. For example "MonetDB-11.23.3/sql/backends/monet5/vaults" module. 1) It has Makefile.ag which has (among other lines): lib__vault = { MODULE DIR = libdir/monetdb5 SOURCES = vault.c LIBS = ../../../../monetdb5/tools/libmonetdb5 \ ../../../../gdk/libbat $(curl_LIBS) } And that means that "libmonetdb.la" has to be created before "vaults" is built. 2) Let's say I have added … [View More]

2 4

Error starting monetdb
by Corbit, Dann 06 Oct '17

06 Oct '17

When M5server.bat runs, it outputs this message: !FATAL: BBPinit: first != 0 (ID = 72). And exits. I do not have any data I need to save in my database. Is there a way to drop the old database and create a new one, so that I can again run tests?

1 0

How to improve query performance on a single node in MonetDB?
by Tomas Repik | Instarea 04 Oct '17

04 Oct '17

Hello list, recently I came across MonetDB as a columnar database and I have some issues with getting it perform well. I posted my question on StackOverflow <https://stackoverflow.com/questions/46558842/how-to-improve-query-performan…>, idealy post your answers there but, mailing it to the list is fine as well. Thank you Tomas > TL;DR > I've installed the latest (MonetDB 5 server v11v.27.5 "Jul2017-SP1") on > Windows 2012 Server and I'm trying to query large table 1,4 billion … [View More]

3 2