Hi, thanks for awnsers. Precisely, I tried last year to deploy Vertical, but had trouble install and configure, since the MonetDB, was simply install and use, so do I use to this day with a database analytical about 30G, and 50 million records in the main table. I use Pentaho (Saiku) to explore the data, and also queries for creating dashboards. Now I pretty increase the volume of data, so that is posted another question about MonetDB clustered, it is the only thi still worries me, if I need to scalling. I dont think I still need something like HBase / Hadoop. Also have questioned me about using MongoDB, but from what I saw on MongoDB, needs a lot of programming to performance aggregations etc. with the MonetDB it is transparent. Today my data for analysis in MonetDB are fully denormalized not use model schema star. I see that many proposes the architecture with MongoDB for DW and Vertica or MonetDB, for analysis, but that think with volume that I have, I can use the MonetDB dw as well. I see there are many things about trying to force the use of Big data tools without really need it. Att, On 16/04/2015 10:38, users-list-request@monetdb.org wrote:
Send users-list mailing list submissions to users-list@monetdb.org
To subscribe or unsubscribe via the World Wide Web, visit https://www.monetdb.org/mailman/listinfo/users-list or, via email, send a message with subject or body 'help' to users-list-request@monetdb.org
You can reach the person managing the list at users-list-owner@monetdb.org
When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..."
Today's Topics:
1. Re: MonetDB vs Vertica CE (Ruben Silva)
----------------------------------------------------------------------
Message: 1 Date: Thu, 16 Apr 2015 14:37:47 +0100 From: Ruben Silva
To: Communication channel for MonetDB users Subject: Re: MonetDB vs Vertica CE Message-ID: Content-Type: text/plain; charset="utf-8" Hello Luciano,
I don't have a full grasp of the new stuff introduced into MonetDB in the last year, but as far as I know there are still major differences between the two systems for me the most important is scalability. Vertica has no single point of failure when working as a cluster. However the CE version is limited to three nodes, so scalability is also limited in that case.
Vertica relies heavily on projections as a way to improve performance. If your data model is relatively stable it is something fairly easy to use, but if your data model changes at a high rate you will have a considerable amount of additional work managing the projections. Also if you use many projections they will hurt your DML statements performance.
MonetDB feeds on CPU and has no boundaries for its appetite, consuming as much resources as possible in order to respond to a single statement. That can be very good or very bad, it depends on your use case. Vertica has resource pools that are used to regulate the stuff (IO, Ram, CPU) that each query is allowed to use.
I don't know your use case (and that is crucial for a good advice), but if you are considering a scenario where you have a single machine for the database system, then go with MonetDB without any doubt. It is just faster and simpler.
Cumprimentos (Regards),
2015-04-16 14:04 GMT+01:00 Luciano Sasso
: Hi,
The team of staff this questioning me about using Vertica, but it has limitations on the CE version. Someone already used the Vertica has some advantage over MonetDB?
-- Luciano Sasso Vieira Data Scientist & Solutions Architect
luciano@gsgroup.com.br http://www.gsgroup.com.br | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br
------------------------------ [image: Avast logo] http://www.avast.com/
Este email foi escaneado pelo Avast antiv?rus. www.avast.com
_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
On Apr 16, 2015, at 16:08, Luciano Sasso
wrote: Hi, thanks for awnsers.
Precisely, I tried last year to deploy Vertical, but had trouble install and configure, since the MonetDB, was simply install and use, so do I use to this day with a database analytical about 30G, and 50 million records in the main table. I use Pentaho (Saiku) to explore the data, and also queries for creating dashboards. Now I pretty increase the volume of data, so that is posted another question about MonetDB clustered, it is the only thi still worries me, if I need to scalling. I dont think I still need something like HBase / Hadoop. Also have questioned me about using MongoDB, but from what I saw on MongoDB, needs a lot of programming to performance aggregations etc. with the MonetDB it is transparent. Today my data for analysis in MonetDB are fully denormalized not use model schema star.
Just want to point out that you can perfectly use MonetDB for star schema's. You don't _have to_ denormalise your data because of MonetDB.
I see that many proposes the architecture with MongoDB for DW and Vertica or MonetDB, for analysis, but that think with volume that I have, I can use the MonetDB dw as well. I see there are many things about trying to force the use of Big data tools without really need it.
Att,
On 16/04/2015 10:38, users-list-request@monetdb.org wrote:
Send users-list mailing list submissions to
users-list@monetdb.org
To subscribe or unsubscribe via the World Wide Web, visit
https://www.monetdb.org/mailman/listinfo/users-list
or, via email, send a message with subject or body 'help' to
users-list-request@monetdb.org
You can reach the person managing the list at
users-list-owner@monetdb.org
When replying, please edit your Subject line so it is more specific than "Re: Contents of users-list digest..."
Today's Topics:
1. Re: MonetDB vs Vertica CE (Ruben Silva)
----------------------------------------------------------------------
Message: 1 Date: Thu, 16 Apr 2015 14:37:47 +0100 From: Ruben Silva
To: Communication channel for MonetDB users
Subject: Re: MonetDB vs Vertica CE Message-ID:
Content-Type: text/plain; charset="utf-8"
Hello Luciano,
I don't have a full grasp of the new stuff introduced into MonetDB in the last year, but as far as I know there are still major differences between the two systems for me the most important is scalability. Vertica has no single point of failure when working as a cluster. However the CE version is limited to three nodes, so scalability is also limited in that case.
Vertica relies heavily on projections as a way to improve performance. If your data model is relatively stable it is something fairly easy to use, but if your data model changes at a high rate you will have a considerable amount of additional work managing the projections. Also if you use many projections they will hurt your DML statements performance.
MonetDB feeds on CPU and has no boundaries for its appetite, consuming as much resources as possible in order to respond to a single statement. That can be very good or very bad, it depends on your use case. Vertica has resource pools that are used to regulate the stuff (IO, Ram, CPU) that each query is allowed to use.
I don't know your use case (and that is crucial for a good advice), but if you are considering a scenario where you have a single machine for the database system, then go with MonetDB without any doubt. It is just faster and simpler.
Cumprimentos (Regards),
2015-04-16 14:04 GMT+01:00 Luciano Sasso
: Hi,
The team of staff this questioning me about using Vertica, but it has limitations on the CE version. Someone already used the Vertica has some advantage over MonetDB?
-- Luciano Sasso Vieira Data Scientist & Solutions Architect
luciano@gsgroup.com.br http://www.gsgroup.com.br | tel: 17 3353-0833 | cel: 17 99706-9335 www.gsgroup.com.br
------------------------------ [image: Avast logo] http://www.avast.com/
Este email foi escaneado pelo Avast antiv?rus.
www.avast.com
_______________________________________________ users-list mailing list
users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Luciano Sasso
-
Ying Zhang