[MonetDB-users] Data compression in MonetDB

Hi All, I am going to build a DW based on MonetDB. After check on the internet I found that MonetDB does not do data compression. Same data set in MonetDb is much bigger than MySQL and infoBright. Are there any plan to do data compression in the MonetDB? Yours sincerely, Ken Cheng

Hi MonetDB uses internally dictionary compression for strings only. For the remainder it relies on the user to properly use the data types. For decimals types, it is known that the storage space is often larger then strictly needed. Please sent a snippet of your database schema to assess the issues at more depth. regards, Martin On 6/18/11 2:51 PM, Ken Cheng wrote:
Hi All,
I am going to build a DW based on MonetDB. After check on the internet I found that MonetDB does not do data compression. Same data set in MonetDb is much bigger than MySQL and infoBright. Are there any plan to do data compression in the MonetDB?
Yours sincerely, Ken Cheng
------------------------------------------------------------------------------ EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev
_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Hi Martin,
Thank you quick response very much. In fact I did not do the test yet. I
just googled some threads about this.
http://www.mysqlperformanceblog.com/2009/10/02/analyzing-air-traffic-perform...
http://www.mysqlperformanceblog.com/2009/09/29/quick-comparison-of-myisam-in...
http://www.mysqlperformanceblog.com/2009/10/26/air-traffic-queries-in-lucidd...
All the above threads mentioned the data size after load into database.
Yours sincerely,
Ken Cheng
On Sat, Jun 18, 2011 at 21:17, Martin Kersten
Hi MonetDB uses internally dictionary compression for strings only. For the remainder it relies on the user to properly use the data types. For decimals types, it is known that the storage space is often larger then strictly needed.
Please sent a snippet of your database schema to assess the issues at more depth.
regards, Martin
On 6/18/11 2:51 PM, Ken Cheng wrote:
Hi All,
I am going to build a DW based on MonetDB. After check on the internet I found that MonetDB does not do data compression. Same data set in MonetDb is much bigger than MySQL and infoBright. Are there any plan to do data compression in the MonetDB?
Yours sincerely, Ken Cheng
------------------------------------------------------------------------------
EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev
_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
------------------------------------------------------------------------------ EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

And all these threads show that the data size in MonetDb is the bigger.
Yours sincerely,
Ken Cheng
On Sat, Jun 18, 2011 at 21:35, Ken Cheng
Hi Martin,
Thank you quick response very much. In fact I did not do the test yet. I just googled some threads about this.
http://www.mysqlperformanceblog.com/2009/10/02/analyzing-air-traffic-perform...
http://www.mysqlperformanceblog.com/2009/09/29/quick-comparison-of-myisam-in...
http://www.mysqlperformanceblog.com/2009/10/26/air-traffic-queries-in-lucidd...
All the above threads mentioned the data size after load into database.
Yours sincerely, Ken Cheng
On Sat, Jun 18, 2011 at 21:17, Martin Kersten
wrote: Hi MonetDB uses internally dictionary compression for strings only. For the remainder it relies on the user to properly use the data types. For decimals types, it is known that the storage space is often larger then strictly needed.
Please sent a snippet of your database schema to assess the issues at more depth.
regards, Martin
On 6/18/11 2:51 PM, Ken Cheng wrote:
Hi All,
I am going to build a DW based on MonetDB. After check on the internet I found that MonetDB does not do data compression. Same data set in MonetDb is much bigger than MySQL and infoBright. Are there any plan to do data compression in the MonetDB?
Yours sincerely, Ken Cheng
------------------------------------------------------------------------------
EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev
_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
------------------------------------------------------------------------------ EditLive Enterprise is the world's most technically advanced content authoring tool. Experience the power of Track Changes, Inline Image Editing and ensure content is compliant with Accessibility Checking. http://p.sf.net/sfu/ephox-dev2dev _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
participants (2)
-
Ken Cheng
-
Martin Kersten