Hi Medha,

can you tell us a bit more how you load the data, which SQL statements you used and how you did the vertical partitioning?

What you are describing should not be happening.

thank you

On Wed, Nov 14, 2012 at 2:25 PM, Medha Atre <medha.atre@gmail.com> wrote:
Just wondering if anyone could throw a light on this issue?


---------- Forwarded message ----------
From: Medha Atre <medha.atre@gmail.com>
Date: Mon, Nov 12, 2012 at 5:11 PM
Subject: growing size of database
To: Communication channel for MonetDB users <users-list@monetdb.org>


Hi,

I am running the latest MonetDB 11.13.3. I loaded a pretty tiny RDF
dataset of 13 million triples and created some "vertical partitions"
on predicate values. After having done dataset loading, I checked the
size of the dataset folder and it showed to be _258 MB_. Then I ran
about 6000+ bulk queries by periodically shutting down the server
after about 1000 queries each time. The queries finished successfully
and there was no crash. After the final query I stopped the database
"monetdb stop dbname" and shutdown the main server too "monetdbd stop
/path/to/dbfarm".

After that I again checked the size of the database folder and then it
showed it to be _5.8GB_ and the "HC" folder under "bat" was shown to
have size of about 3 GB with some other files having sizes between
300-700 MBs.

It seems mysterious to me why would the size of database go on
increasing as much as 25 times the original size.

I intend to load much larger data (> 1 billion triples), and want to
avoid growing disk size of the dataset due to limited disk-space.

Can someone please enlighten?

Medha
_______________________________________________
users-list mailing list
users-list@monetdb.org
http://mail.monetdb.org/mailman/listinfo/users-list