- users-list - monetdb.org

Performance degradation
by Herman Knief 10 Jan '19

10 Jan '19

Greetings, Running MonetDB v11.31.11 (Aug2018-SP1), we ran into an issue where queries that have been running quite well, suddenly slowed by about 5x. Looking at the explain, it seems we hit a condition that is preventing mitosis? Copying the tables related to the query seems to restore performance to the previous level, but would be very curious to understand what happened here. What metrics or stats should we be looking at? Changes we see in the plan are as follows: Bad example: sql.tid(X_4:int, "waltest":str, "cmdb":str); Good example: sql.tid(X_4:int, "waltest":str, "cmdb2":str, 0:int, 32:int); Looking at the storage info, the sizes (heap and column), type width and counts look the same between the two tables. Any thoughts or suggestions would be appreciated. - Herman -- Please excuse typos... I can't type.

1 0

Embedded Python module is not available in recent builds of Windows version
by Kevin Chen 21 Dec '18

21 Dec '18

Hi, I upgraded the MonetDB windows version to 2018Aug and found that the embedded Python module is no longer working. Even the startup script with “embedded_py=true”, the module was not loaded. There was no message showing “MonetDB/Python2 module loaded”. All my Python functions are failed. Please help. Thanks. Kevin

2 1

!FATAL: SQL type wrd missing
by Ariel Abadi 18 Dec '18

18 Dec '18

Hi! Please I need an urgent solution (if there is one) I have upgraded a database to the latest version, and when Im trying to start the DB, there is an error: 2018-12-18 10:58:06 ERR DB[29818]: !FATAL: SQL type wrd missing Can someone help me with any clue!???? Thks in advance Ariel

2 3

Re: grafana-monetdb-datasource installation problem
by Svetlin 03 Dec '18

03 Dec '18

Hi Ariel, The current version of the grafana-monetdb-datasource plugin cannot be used with the latest grafana release. There is a missing breaking dependency that has being introduced(see #10053 <https://github.com/grafana/grafana/issues/10053>) and we didn’t have time to patch that in. Secondly, you would need a http server as a mediator to forward the queries to monetdb. The grafana monetdb datasource plugin merely creates MonetDB compatible queries and forwards responses back to grafana core for visualization. I hope this helps. Cheers, Svetlin > On Dec 3, 2018, at 11:03 AM, Ying (Jennie) Zhang <ying.zhang(a)monetdbsolutions.com> wrote: > >> aabadi(a)starconnecting.com <mailto:aabadi@starconnecting.com>

2 1

grafana-monetdb-datasource installation problem
by Ariel Abadi 01 Dec '18

01 Dec '18

Does anybody has installed the monetdb datasource plugin for Grafana? Im running Grafana v5.3.4. The plugin was downloaded from https://github.com/MonetDBSolutions/grafana-monetdb-datasource And is not working... :'( Does anybody knows how to connect MonetDB within Grafana? Any ideas will be very much appreciated!!! Thks Ariel

2 1

Re: Issues trying to create a table...
by Stefan Manegold 28 Nov '18

28 Nov '18

Hi, Internally (as in in the MonetDB code base),the impact of the problem could imho be significantly reduced (though not fully avoided)by "simply" using different separator characters (or even strings?) when creating qnames,e.g. schema:table;column insteadof schema_table_column ... A unique bijective reversible mapping from schema,table,column to qname should avoid the problem entirely , but might require to use separator chracter(s) that are not valid in SQL identifiers, if such exist ... Best,Stefan -------- Original message --------From: Ying Zhang <Y.Zhang(a)cwi.nl> Date: 28/11/2018 07:33 (GMT+01:00) To: Communication channel for MonetDB users <users-list(a)monetdb.org> Subject: Re: Issues trying to create a table... > On 28 Nov 2018, at 04:18, Herman Knief <hknief(a)gmail.com> wrote: > > Hi Folks, > I'm new to MonetDB and trying to setup a schema from a MariaDB export. > I have a particular table that reports a conflict with the create statement. I've stripped this down to just a particular field that seems to be causing the issue, but unsure where to go from here. > > sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script" string); > CREATE TABLE: zboot_sc_cat_item_delivery_plan_script conflicts Hai Herman, This is because something has already been defined before, whose complete qname is “zboot_sc_cat_item_delivery_plan_script”. This often happens with (but probably not limited to) schema_name+table_name+column_name. In MonetDB test suite, we have two examples to trigger this (type of) error: sql>create table foo (id integer, bar_id integer); operation successful sql>create table foo_bar (id integer); CREATE TABLE: sys_foo_bar_id conflicts and sql>create table foo_bar (baz int); operation successful sql>create table foo (bar_baz int); CREATE TABLE: sys_foo_bar_baz conflicts This is not a bug. You need to change your table and/or column definitions, like your alternatives below. Then CREATE TABLE will succeed. Regards, Jennie > > What's interesting is that either changing the name of the table or the name of the field and these statements work. There is something about this particular combo that is problematic. > sql>CREATE TABLE "sc_cat_item_delivery_plan1" ("script" string); > operation successful > sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script1" string); > operation successful > > I have a total of 2251 tables... all were created except for this one. I've tried to destroy and recreate the schema with no luck. Logs don't seem to indicate any issue and trying to use the debug on the client didn't get me anywhere. Thoughts? Suggestions? > > -- > Please excuse typos... I can't type. > _______________________________________________ > users-list mailing list > users-list(a)monetdb.org > https://www.monetdb.org/mailman/listinfo/users-list _______________________________________________ users-list mailing list users-list(a)monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

2 1

Issues trying to create a table...
by Herman Knief 28 Nov '18

28 Nov '18

Hi Folks, I'm new to MonetDB and trying to setup a schema from a MariaDB export. I have a particular table that reports a conflict with the create statement. I've stripped this down to just a particular field that seems to be causing the issue, but unsure where to go from here. sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script" string); CREATE TABLE: zboot_sc_cat_item_delivery_plan_script conflicts What's interesting is that either changing the name of the table or the name of the field and these statements work. There is something about this particular combo that is problematic. sql>CREATE TABLE "sc_cat_item_delivery_plan1" ("script" string); operation successful sql>CREATE TABLE "sc_cat_item_delivery_plan" ("script1" string); operation successful I have a total of 2251 tables... all were created except for this one. I've tried to destroy and recreate the schema with no luck. Logs don't seem to indicate any issue and trying to use the debug on the client didn't get me anywhere. Thoughts? Suggestions? -- Please excuse typos... I can't type.

3 2

Issue while connecting to MonetDB via Perl cpan driver
by Sharma, Sreejith 15 Nov '18

15 Nov '18

Hi, We have a Perl code via which we are trying to connect to one of the MonetDB instance. Here we are using DBD::monetdb Perl cpan driver for connectivity. when we run the snippet, it just tries to connect to DB and seems hung, looks like it's awaiting for user input for password. Also, on the server side logs we see an error (challenge error) can connection will not be established. Here is a sample snippet which isn't working. Could anyone help with an idea or code snippet which works with Perl DBI for MonetDB connectivity? [cid:image001.png@01D47D35.C23AD040] #!/usr/bin/perl # use strict; use warnings; use DBI(); print "Attempting to connect...\n"; my $dbh = DBI->connect('dbi:monetdb:host=XXXX;port=55555', 'USERNAME', 'Password', { RaiseError => 1 } ); print "Connected. Trying SQL...\n"; my $sth = $dbh->prepare('SELECT * FROM env'); $sth->execute; $sth->dump_results; print "Done\n"; exit 0; Regards, Sreejith

1 0

Error: cannot bind delete column
by Doherty, Adam 15 Nov '18

15 Nov '18

Hello all: I have run across a show-stopping error, "cannot bind delete column" which renders Monet unusable until I restart the service. A batch import of events runs every 10 minutes and has been unable to complete for the last 28 hours because the service is not accepting commands. I'm not sure where to look for the source of this error. Restarting the service correct the issue, but this is a problem as the Monet instance drives live Tableau dashboards using this imported data. Where do I need to start looking to track down the source of this error? I am currently running 11.29.3 on CentOS 7. Adam

2 1

Adding columns to tables via binary bulk loading
by Anderson, David B 12 Nov '18

12 Nov '18

All, Is it possible to add a column to an existing table via binary bulk loading? We have a table with ~1 billion rows and we would like to add columns to the table, but would prefer bulk loads for speed. Also, does anyone have a snippet of code to create the binary file format that bulk loading expects. I've tried a couple versions (simple int and double), but the server wouldn't recognize the files. Thanks, Dave

2 1