Monetdb crashes.

newer
why "INSERT INTO ... SELECT" is...

older
User Defined Function and regular...

Souri Ratnaparkhi

14 Mar 2016 14 Mar '16

4:10 a.m.

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “*monetdbd: internal error while starting mserver, please refer to the logs*” when to try to connect again. No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue. What could be the reason? Is 126 cols an issue? Please help. We are stuck. (btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free)) OS* - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)* Monetdb version* - MonetDB v11.21.13 (Jul2015-SP2)* Thank you [image: Description: Description: Description: Description: logo] * Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255* * Phone (India Lines): (91) 020-25445550 **www.usain.com* http://www.usain.com/

Attachments:

attachment.html (text/html — 3.9 KB)
image001.jpg (image/jpeg — 2.4 KB)

Show replies by date

Stefan Manegold

14 Mar 14 Mar

8:39 a.m.

Dear Souri, as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it. We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general. If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets. If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table? Best, Stefan ----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Souri Ratnaparkhi

8:21 a.m.

Hello Team, I had shared all the data with Lefteris. When database crashes we restore it from the backup. Thank you Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com -----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes. Dear Souri, as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it. We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general. If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets. If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table? Best, Stefan ----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Lefteris

10:14 a.m.

Hi Souri, I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into. The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed. while trying to load the data. And the trace reads #4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306 So I suspect to be a parse error that is not treated as it is supposed to. Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it. Lefteris On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote:

...

Hello Team,

I had shared all the data with Lefteris. When database crashes we restore it from the backup.

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

Dear Souri,

as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

Best, Stefan

----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Souri Ratnaparkhi

10:11 a.m.

Hello Lefteris , Thank you for reply. You can share the data for bug report. Or else please guide me how to open a bug report. Thank you [image: Description: Description: Description: Description: logo] * Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255* * Phone (India Lines): (91) 020-25445550 **www.usain.com* http://www.usain.com/ *From:* users-list [mailto:users-list-bounces+souri.ratnaparkhi= usain.com@monetdb.org] *On Behalf Of *Lefteris *Sent:* Monday, March 14, 2016 3:45 PM *To:* Communication channel for MonetDB users *Subject:* Re: Monetdb crashes. Hi Souri, I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into. The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed. while trying to load the data. And the trace reads #4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306 So I suspect to be a parse error that is not treated as it is supposed to. Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it. Lefteris On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote: Hello Team, I had shared all the data with Lefteris. When database crashes we restore it from the backup. Thank you Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com -----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes. Dear Souri, as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it. We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general. If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets. If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table? Best, Stefan ----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Lefteris

11:05 a.m.

Hi, you can report the bug at https://www.monetdb.org/bugzilla/ You can do it yourself so you can now how to do it next time and have a quicker response from the monetdb team:) In the meanwhile, what I can see is that the crash is because of a parse error. MonetDB should deal with that error without crashing, but once we fix that, the parse error will remain anyhow. I suspect that it is because of non-ascii wierd-utf(??) characters that your data have. You can either clean the data before importing or try to specify the correct encoding. Hope this helps for now, Lefteris On Mon, Mar 14, 2016 at 11:11 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote:

...

Hello Lefteris ,

Thank you for reply. You can share the data for bug report. Or else please guide me how to open a bug report.

Thank you

[image: Description: Description: Description: Description: logo]

* Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255*

* Phone (India Lines): (91) 020-25445550 **www.usain.com* http://www.usain.com/

*From:* users-list [mailto:users-list-bounces+souri.ratnaparkhi= usain.com@monetdb.org] *On Behalf Of *Lefteris *Sent:* Monday, March 14, 2016 3:45 PM

*To:* Communication channel for MonetDB users *Subject:* Re: Monetdb crashes.

Hi Souri,

I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

The error I get is

server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

while trying to load the data. And the trace reads

#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80,

v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

So I suspect to be a parse error that is not treated as it is supposed to.

Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

Lefteris

On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote:

Hello Team,

I had shared all the data with Lefteris. When database crashes we restore it from the backup.

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

Dear Souri,

as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

Best, Stefan

----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Souri Ratnaparkhi

10:55 a.m.

Thank you Lefteris. I will try to clean the data and try to import again Also will open bug report. [image: Description: Description: Description: Description: logo] * Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255* * Phone (India Lines): (91) 020-25445550 **www.usain.com* http://www.usain.com/ *From:* users-list [mailto:users-list-bounces+souri.ratnaparkhi= usain.com@monetdb.org] *On Behalf Of *Lefteris *Sent:* Monday, March 14, 2016 4:35 PM *To:* Communication channel for MonetDB users *Subject:* Re: Monetdb crashes. Hi, you can report the bug at https://www.monetdb.org/bugzilla/ You can do it yourself so you can now how to do it next time and have a quicker response from the monetdb team:) In the meanwhile, what I can see is that the crash is because of a parse error. MonetDB should deal with that error without crashing, but once we fix that, the parse error will remain anyhow. I suspect that it is because of non-ascii wierd-utf(??) characters that your data have. You can either clean the data before importing or try to specify the correct encoding. Hope this helps for now, Lefteris On Mon, Mar 14, 2016 at 11:11 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote: Hello Lefteris , Thank you for reply. You can share the data for bug report. Or else please guide me how to open a bug report. Thank you [image: Description: Description: Description: Description: logo] * Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255* * Phone (India Lines): (91) 020-25445550 **www.usain.com* http://www.usain.com/ *From:* users-list [mailto:users-list-bounces+souri.ratnaparkhi= usain.com@monetdb.org] *On Behalf Of *Lefteris *Sent:* Monday, March 14, 2016 3:45 PM *To:* Communication channel for MonetDB users *Subject:* Re: Monetdb crashes. Hi Souri, I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into. The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed. while trying to load the data. And the trace reads #4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306 So I suspect to be a parse error that is not treated as it is supposed to. Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it. Lefteris On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi < souri.ratnaparkhi@usain.com> wrote: Hello Team, I had shared all the data with Lefteris. When database crashes we restore it from the backup. Thank you Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com -----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi=usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes. Dear Souri, as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it. We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general. If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets. If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table? Best, Stefan ----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com wrote:

...

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Sjoerd Mullender

11:23 a.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 14/03/16 11:14, Lefteris wrote:

...

Hi Souri,

I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

while trying to load the data. And the trace reads

#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

So I suspect to be a parse error that is not treated as it is supposed to.

This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.

...

Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

Lefteris

On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi mailto:souri.ratnaparkhi@usain.com> wrote:

Hello Team,

I had shared all the data with Lefteris. When database crashes we restore it from the backup.

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi mailto:users-list-bounces%2Bsouri.ratnaparkhi=usain.com@monetdb.org mailto:usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

Dear Souri,

as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

Best, Stefan

----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com wrote:

...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

- -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJW5p85AAoJEISMxT6LrWYgd0MIAKe8euGNGKLHRJhMoQgIZyIN tia/LGef1qlMtcobbzzCE4HW3jF+bwgdYWWJa/BgObpXpxmkpLeV1o0NiFuO0Ru9 wObPBp2m2UNTe1tpRYbLCZyxub52uZbux0DYCUMtSRDhrzvxpRkVMRJ/SMf48TW9 0YU9nW+SCtTtorq71oGG98oZVElHB80zuzydrKoa2mk/3bdQt+ZCepfmy7odmzEK mAxmBVSKh8RoXWCero6lbbd6RE9OVMMrrECw1P7rbPpvfzbCjEF1hTv+THAsEBP9 SfZBbk93P+aYJMN/SPDEtf5K2MeVW0C/AuXI8UOHqbiEn7p/1NNsm98R/qRWDBs= =6DB/ -----END PGP SIGNATURE-----

Lefteris

11:50 a.m.

The latest default checkout gives me the following error:

...

mserver5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

#0 0x00007ffff49f39c8 in raise () from /lib64/libc.so.6 #1 0x00007ffff49f565a in abort () from /lib64/libc.so.6 #2 0x00007ffff49ec187 in __assert_fail_base () from /lib64/libc.so.6 #3 0x00007ffff49ec232 in __assert_fail () from /lib64/libc.so.6 #4 0x00007ffff72dcf12 in strPut (h=0x7fffc414b680, dst=0x7fffd4acbc80, v=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,100000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,56000005,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306 #5 0x00007ffff737c2c7 in BUNappend (b=0x7fffc414b3e0, t=0x7fffd4acbdd0, force=0 '\000') at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_bat.c:1059 #6 0x00007ffff7a8ab76 in tablet_error (task=0x7fffd5ccf710, row=1783, col=127, msg=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,100000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,56000005,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"..., fcn=0x7fff94003120 "3/2/2016,LOANS,LAA,STLLO,1000586,12060,***-**-0586,***-**-0007,abc-*de-LAA,-30587274.52,30000000,INR,-61759247.44,7/11/2014,1/7/2015,,N,14000007,50000007,56000005,1,FR25711,ACCNT,7/10/2014,3/2/2016,7/"...) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:720 #7 0x00007ffff7a8d869 in SQLload_parse_line (task=0x7fffd5ccf710, idx=1783) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1109 #8 0x00007ffff7a8db3c in SQLworker (arg=0x7fffd5ccf710) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1152 #9 0x00007ffff4d87555 in start_thread () from /lib64/libpthread.so.0 #10 0x00007ffff4ac1ded in clone () from /lib64/libc.so.6 The fix has not been ported to default? or a different issue? Lefteris On Mon, Mar 14, 2016 at 12:23 PM, Sjoerd Mullender wrote:

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256

On 14/03/16 11:14, Lefteris wrote:

...
Hi Souri,

I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

while trying to load the data. And the trace reads

#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

So I suspect to be a parse error that is not treated as it is supposed to.

This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.

...
Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

Lefteris

On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi mailto:souri.ratnaparkhi@usain.com> wrote:

Hello Team,

I had shared all the data with Lefteris. When database crashes we restore it from the backup.

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi mailto:users-list-bounces%2Bsouri.ratnaparkhi=usain.com@monetdb.org mailto:usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

Dear Souri,

as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

Best, Stefan

----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com wrote:

...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

- -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2

iQEcBAEBCAAGBQJW5p85AAoJEISMxT6LrWYgd0MIAKe8euGNGKLHRJhMoQgIZyIN tia/LGef1qlMtcobbzzCE4HW3jF+bwgdYWWJa/BgObpXpxmkpLeV1o0NiFuO0Ru9 wObPBp2m2UNTe1tpRYbLCZyxub52uZbux0DYCUMtSRDhrzvxpRkVMRJ/SMf48TW9 0YU9nW+SCtTtorq71oGG98oZVElHB80zuzydrKoa2mk/3bdQt+ZCepfmy7odmzEK mAxmBVSKh8RoXWCero6lbbd6RE9OVMMrrECw1P7rbPpvfzbCjEF1hTv+THAsEBP9 SfZBbk93P+aYJMN/SPDEtf5K2MeVW0C/AuXI8UOHqbiEn7p/1NNsm98R/qRWDBs= =6DB/ -----END PGP SIGNATURE----- _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

Sjoerd Mullender

11:57 a.m.

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 On 14/03/16 12:50, Lefteris wrote:

...

The latest default checkout gives me the following error:

Latest before or after the merge I did this morning (changeset d47fadbc0f0c)?

...

...
mserver5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

#0 0x00007ffff49f39c8 in raise () from /lib64/libc.so.6 #1 0x00007ffff49f565a in abort () from /lib64/libc.so.6 #2 0x00007ffff49ec187 in __assert_fail_base () from /lib64/libc.so.6 #3 0x00007ffff49ec232 in __assert_fail () from /lib64/libc.so.6 #4 0x00007ffff72dcf12 in strPut (h=0x7fffc414b680, dst=0x7fffd4acbc80, v=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1 00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...)

at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

...

#5 0x00007ffff737c2c7 in BUNappend (b=0x7fffc414b3e0, t=0x7fffd4acbdd0, force=0 '\000') at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_bat.c:1059 #6 0x00007ffff7a8ab76 in tablet_error (task=0x7fffd5ccf710, row=1783, col=127, msg=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1 00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"..., fcn=0x7fff94003120 "3/2/2016,LOANS,LAA,STLLO,1000586,12060,***-**-0586,***-**-0007,abc-*d e-LAA,-30587274.52,30000000,INR,-61759247.44,7/11/2014,1/7/2015,,N,14000 007,50000007,56000005,1,FR25711,ACCNT,7/10/2014,3/2/2016,7/"...)

at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:720

...

#7 0x00007ffff7a8d869 in SQLload_parse_line (task=0x7fffd5ccf710, idx=1783) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1109 #8 0x00007ffff7a8db3c in SQLworker (arg=0x7fffd5ccf710) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1152 #9 0x00007ffff4d87555 in start_thread () from /lib64/libpthread.so.0 #10 0x00007ffff4ac1ded in clone () from /lib64/libc.so.6

The fix has not been ported to default? or a different issue?

Lefteris

On Mon, Mar 14, 2016 at 12:23 PM, Sjoerd Mullender mailto:sjoerd@acm.org> wrote:

On 14/03/16 11:14, Lefteris wrote:

...
Hi Souri,

...
I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

...
The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

...
while trying to load the data. And the trace reads

...
#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

...
So I suspect to be a parse error that is not treated as it is supposed to.

This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.

...
Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

...
Lefteris

...
On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com>> wrote:

...
Hello Team,

...
I had shared all the data with Lefteris. When database crashes we restore it from the backup.

...
Thank you

...
Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com http://www.usain.com

...
-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi mailto:users-list-bounces%2Bsouri.ratnaparkhi mailto:users-list-bounces%252Bsouri.ratnaparkhi>=usain.com@monetdb.o rg

mailto:usain.com@monetdb.org

...

...
mailto:usain.com@monetdb.org>] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

...
Dear Souri,

...
as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

...
We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

...
If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

...
If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

...
Best, Stefan

...
----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com> wrote:

...
...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com http://www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list

...
-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list

...
_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

- -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBCAAGBQJW5qcfAAoJEISMxT6LrWYgTrkIAJIgt7A9HUR7PMLdyCQsQ2wl C82MqGTrNP8a8Jvxxq0uLQz7ykhILVtvXRphOX6nXjTHbw/+UFVbOAtqOPiCW8zw p1ogiaxpeMUpzdkbqPqVdC2fcYSEoD9DxlSLMfF98Fyp07C5/n8GLWdGGBLdrQk0 mdrbL+YSgak3BxB/B2aukhKEadWo8rQsPFVpZMnEGGy9sYrIfzop3BJdESPsggfk glkvTBDbuz051bw8X3jWCqOgdswpbkaytUMR5nwQAanbK8HBjcpHbEPiidK3U9Wc sMxoBzPfkra9EhSfDRRDB4clU423xrE+tnjtz48sTFnawLUqPnNYZTB5CMmt1/Y= =GTEk -----END PGP SIGNATURE-----

Lefteris

12:48 p.m.

...

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256

On 14/03/16 12:50, Lefteris wrote:

...
The latest default checkout gives me the following error:

Latest before or after the merge I did this morning (changeset d47fadbc0f0c)?

...
...
mserver5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

#0 0x00007ffff49f39c8 in raise () from /lib64/libc.so.6 #1 0x00007ffff49f565a in abort () from /lib64/libc.so.6 #2 0x00007ffff49ec187 in __assert_fail_base () from /lib64/libc.so.6 #3 0x00007ffff49ec232 in __assert_fail () from /lib64/libc.so.6 #4 0x00007ffff72dcf12 in strPut (h=0x7fffc414b680, dst=0x7fffd4acbc80, v=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1 00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...)

at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

...
#5 0x00007ffff737c2c7 in BUNappend (b=0x7fffc414b3e0, t=0x7fffd4acbdd0, force=0 '\000') at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_bat.c:1059 #6 0x00007ffff7a8ab76 in tablet_error (task=0x7fffd5ccf710, row=1783, col=127, msg=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,1 00000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,5600000 5,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"..., fcn=0x7fff94003120 "3/2/2016,LOANS,LAA,STLLO,1000586,12060,***-**-0586,***-**-0007,abc-*d e-LAA,-30587274.52,30000000,INR,-61759247.44,7/11/2014,1/7/2015,,N,14000 007,50000007,56000005,1,FR25711,ACCNT,7/10/2014,3/2/2016,7/"...)

at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:720

...
#7 0x00007ffff7a8d869 in SQLload_parse_line (task=0x7fffd5ccf710, idx=1783) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1109 #8 0x00007ffff7a8db3c in SQLworker (arg=0x7fffd5ccf710) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1152 #9 0x00007ffff4d87555 in start_thread () from /lib64/libpthread.so.0 #10 0x00007ffff4ac1ded in clone () from /lib64/libc.so.6

The fix has not been ported to default? or a different issue?

Lefteris

On Mon, Mar 14, 2016 at 12:23 PM, Sjoerd Mullender mailto:sjoerd@acm.org> wrote:

On 14/03/16 11:14, Lefteris wrote:

...
Hi Souri,

...
I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

...
The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

...
while trying to load the data. And the trace reads

...
#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

...
So I suspect to be a parse error that is not treated as it is supposed to.

This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.

...
Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

...
Lefteris

...
On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com>> wrote:

...
Hello Team,

...
I had shared all the data with Lefteris. When database crashes we restore it from the backup.

...
Thank you

...
Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com http://www.usain.com

...
-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi mailto:users-list-bounces%2Bsouri.ratnaparkhi mailto:users-list-bounces%252Bsouri.ratnaparkhi>=usain.com@monetdb.o rg

mailto:usain.com@monetdb.org

...
...
mailto:usain.com@monetdb.org>] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

...
Dear Souri,

...
as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

...
We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

...
If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

...
If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

...
Best, Stefan

...
----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com> wrote:

...
...
Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com http://www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list

...
-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org mailto:users-list@monetdb.org> https://www.monetdb.org/mailman/listinfo/users-list

...
_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

- -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2

iQEcBAEBCAAGBQJW5qcfAAoJEISMxT6LrWYgTrkIAJIgt7A9HUR7PMLdyCQsQ2wl C82MqGTrNP8a8Jvxxq0uLQz7ykhILVtvXRphOX6nXjTHbw/+UFVbOAtqOPiCW8zw p1ogiaxpeMUpzdkbqPqVdC2fcYSEoD9DxlSLMfF98Fyp07C5/n8GLWdGGBLdrQk0 mdrbL+YSgak3BxB/B2aukhKEadWo8rQsPFVpZMnEGGy9sYrIfzop3BJdESPsggfk glkvTBDbuz051bw8X3jWCqOgdswpbkaytUMR5nwQAanbK8HBjcpHbEPiidK3U9Wc sMxoBzPfkra9EhSfDRRDB4clU423xrE+tnjtz48sTFnawLUqPnNYZTB5CMmt1/Y= =GTEk -----END PGP SIGNATURE----- _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

3226

Age (days ago)

3226

Last active (days ago)

List overview

Download

10 comments

4 participants

participants (4)

Lefteris
Sjoerd Mullender
Souri Ratnaparkhi
Stefan Manegold

Monetdb crashes.

Souri Ratnaparkhi

Stefan Manegold

Souri Ratnaparkhi

Lefteris

Souri Ratnaparkhi

Lefteris

Souri Ratnaparkhi

Sjoerd Mullender

Lefteris

Sjoerd Mullender

Lefteris

tags

participants (4)