On 21/02/16 19:47, Luciano Sasso wrote:

Hi, about slow query

Yes, there is, but still left over resources. While the query (which takes 90 minutes) are running, to perform another in another table (9M rows), this latter returns usually in seconds. Hi

Its all about concurrent processes while working with MonetDB. All those processes compete for RAM and disk bandwidth. Even running a browser already takes off a few GB from your RAM. At some point, you end up swapping intermediates to disk, which is a slow process (depending on your HDD). For performance analysis, you better shut down all the processes you don't need. Ideally, the CPU load = 0 before doing a performance analysis.

"

A simple "select count(*) from table", run on 90 minutes.

that is not normal. most likely there are a lot of other processes competing for resources.

"

Em 21/02/2016 08:00, users-list-request@monetdb.org escreveu:

...

Send users-list mailing list submissions to users-list@monetdb.org

To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request@monetdb.org

You can reach the person managing the list at users-list-owner@monetdb.org

When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..."

Today's Topics:

1. Re: Slow Query (Martin Kersten) 2. Re: Slow Query (Stefan Manegold) 3. might be of interest (Anthony Damico)

----------------------------------------------------------------------

Message: 1 Date: Sat, 20 Feb 2016 21:34:06 +0100 From: Martin Kersten To:users-list@monetdb.org Subject: Re: Slow Query Message-ID:<56C8CDBE.3060006@monetdb.org> Content-Type: text/plain; charset=windows-1252; format=flowed

...

Hi,

I have MonetDB JUL2015-SP2, with table of 100M rows and 20 coluns, 4 of number type, others string type.

A simple "select count(*) from table", run on 90 minutes.

On 20/02/16 19:39, Luciano Sasso wrote: that is not normal. most likely there are a lot of other processes competing for resources.

...

Hardware and SO is: Debian 8, 4 cores, 11G RAM and 20G free on disc.

While monet run the query, command top, show 42G of virtual memory

Its normal ?, any idea ?

thanks.

--

Luciano Sasso Vieira Data Scientist & Solutions Architect

http://www.gsgroup.com.brluciano@gsgroup.com.br | tel: 17 3353-0833 | cel: 17 99706-9335 http://www.gsgroup.com.brwww.gsgroup.com.br

Este e-mail foi enviado por um computador sem v?rus e protegido pelo Avast. www.avast.com https://www.avast.com/sig-email

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

------------------------------

Message: 2 Date: Sat, 20 Feb 2016 22:16:01 +0100 (CET) From: Stefan Manegold To: Communication channel for MonetDB users Subject: Re: Slow Query Message-ID:<1956506938.11256849.1456002961125.JavaMail.zimbra@cwi.nl> Content-Type: text/plain; charset="utf-8"

Hi,

this is indeed unexpected.

To possibly better understand what's happening, could you please run your query prefixed with keyword TRACE and share the trace (profiling) result?

Best, Stefan

----- On Feb 20, 2016, at 7:39 PM, Luciano Sassoluciano@gsgroup.com.br wrote:

...

Hi,

I have MonetDB JUL2015-SP2, with table of 100M rows and 20 coluns, 4 of number type, others string type.

A simple "select count(*) from table", run on 90 minutes.

Hardware and SO is: Debian 8, 4 cores, 11G RAM and 20G free on disc.

While monet run the query, command top, show 42G of virtual memory.

Its normal ?, any idea ?

thanks.

--

Luciano Sasso Vieira Data Scientist & Solutions Architect

luciano@gsgroup.com.br | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br

Este e-mail foi enviado por um computador sem v?rus e protegido pelo Avast. www.avast.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

--

Luciano Sasso Vieira Data Scientist & Solutions Architect

http://www.gsgroup.com.brluciano@gsgroup.com.br | tel: 17 3353-0833 | cel: 17 99706-9335 http://www.gsgroup.com.brwww.gsgroup.com.br

Este e-mail foi enviado por um computador sem vírus e protegido pelo Avast. www.avast.com https://www.avast.com/sig-email

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list