Is the attached representative of the creating a hash/index without enough memory?

-----Original Message-----
From: Bryan Senseman [mailto:monetdb@openbi.com]
Sent: Thursday, March 27, 2014 11:58 AM
To: 'Communication channel for MonetDB users'
Subject: RE: Restore/Load just hangs for hours (Windows Jan2014)

Martin,

It failed on a grant in the end and rolled back everything :( See Below:

An improvement suggestion; commit after all the data is loaded then attempt grants, waiting ~24 hours to find out I forgot to create a role in the new database is painful.

Bryan

Welcome to mclient, the MonetDB/SQL interactive terminal (Jan2014)

Database: MonetDB v11.17.9 (Jan2014), 'iis_bi_reporting'

Type \q to quit, \? for a list of available commands auto commit mode: on

sql>set schema iis_bi_reporting;

auto commit mode: on

sql>\<y:\tmp\iis_bi_reporting.dump\iis_bi_reporting.dump

auto commit mode: off

operation successful

166536 affected rows

operation successful

228 affected rows

operation successful

224 affected rows

operation successful

461 affected rows

operation successful

318 affected rows

operation successful

4 affected rows

operation successful

19 affected rows

operation successful

328 affected rows

operation successful

7391 affected rows

operation successful

7391 affected rows

operation successful

9 affected rows

operation successful

299 affected rows

operation successful

3 affected rows

operation successful

381 affected rows

operation successful

4 affected rows

operation successful

14844 affected rows

operation successful

52194 affected rows

operation successful

44 affected rows

operation successful

391 affected rows

operation successful

14844 affected rows

operation successful

1 affected row

operation successful

328 affected rows

operation successful

113106821 affected rows

operation successful

24669750 affected rows

operation successful

259065 affected rows

operation successful

11503 affected rows

operation successful

2420690 affected rows

operation successful

49594775 affected rows

operation successful

261986363 affected rows

operation successful

12918844 affected rows

operation successful

44144 affected rows

operation successful

4721051 affected rows

operation successful

1084 affected rows

operation successful

5 affected rows

operation successful

GRANT: user/role 'iis' unknown

current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK) current transaction is aborted (please ROLLBACK)

COMMIT: failed

sql>

-----Original Message-----

From: users-list [mailto:users-list-bounces+monetdb=openbi.com@monetdb.org] On Behalf Of Martin Kersten

Sent: Thursday, March 27, 2014 11:02 AM

To: Communication channel for MonetDB users

Subject: Re: Restore/Load just hangs for hours (Windows Jan2014)

Hi,

Whatever it is doing can not be seen, indeed.

I would normally use the mclient tool with the echo input feature to see how far I am in re-running a dump and to understand what it is doing.

A hinge, it might be locked up in building a hash/join index on a box with insufficient memory, leading large numbers of small disk accesses.

regards,Martin

On 27/03/14 13:36, Bryan Senseman wrote:

> For about 3 hours I saw cyclical activity on memory and disk when

> loading the 55GB dump file (created on Linux via \D), however for the last 12 hours it has just sat there doing nothing. No CPU activity, no disk; this happened last time and I believe after 17 hours of “nothing” it popped up with a series of “operation completed” messages, what is it doing?

> ----------------------------------------------------------------------

> ----------------------------------------------

> This transmission is confidential and intended solely for the use of

> the recipient named above. It may contain confidential, proprietary, or legally privileged information. If you are not the intended recipient, you are hereby notified that any unauthorized review, use, disclosure or distribution is strictly prohibited. If you have received this transmission in error, please contact the sender by reply e-mail and delete the original transmission and all copies from your system.

> _______________________________________________

> users-list mailing list

> users-list@monetdb.org

> https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________

users-list mailing list

users-list@monetdb.org

https://www.monetdb.org/mailman/listinfo/users-list

This transmission is confidential and intended solely for the use of the recipient named above. It may contain confidential, proprietary, or legally privileged information. If you are not the intended recipient, you are hereby notified that any unauthorized review, use, disclosure or distribution is strictly prohibited. If you have received this transmission in error, please contact the sender by reply e-mail and delete the original transmission and all copies from your system.