Re: Monetdb crashes.

The latest default checkout gives me the following error:

mserver5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

#0 0x00007ffff49f39c8 in raise () from /lib64/libc.so.6 #1 0x00007ffff49f565a in abort () from /lib64/libc.so.6 #2 0x00007ffff49ec187 in __assert_fail_base () from /lib64/libc.so.6 #3 0x00007ffff49ec232 in __assert_fail () from /lib64/libc.so.6 #4 0x00007ffff72dcf12 in strPut (h=0x7fffc414b680, dst=0x7fffd4acbc80, v=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,100000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,56000005,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306 #5 0x00007ffff737c2c7 in BUNappend (b=0x7fffc414b3e0, t=0x7fffd4acbdd0, force=0 '\000') at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_bat.c:1059 #6 0x00007ffff7a8ab76 in tablet_error (task=0x7fffd5ccf710, row=1783, col=127, msg=0x7fffd4acbdd0 "Leftover data 'LOANS,LAA,STLLO,1000503,12060,***-**-0503,***-**-0007,abc-*de-LAA,0,100000000,INR,0,6/22/2015,6/30/2015,6/30/2015,Y,14000007,50000007,56000005,1,FR25884,ACCNT,7/13/2014,6/29/2015,7/14/2"..., fcn=0x7fff94003120 "3/2/2016,LOANS,LAA,STLLO,1000586,12060,***-**-0586,***-**-0007,abc-*de-LAA,-30587274.52,30000000,INR,-61759247.44,7/11/2014,1/7/2015,,N,14000007,50000007,56000005,1,FR25711,ACCNT,7/10/2014,3/2/2016,7/"...) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:720 #7 0x00007ffff7a8d869 in SQLload_parse_line (task=0x7fffd5ccf710, idx=1783) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1109 #8 0x00007ffff7a8db3c in SQLworker (arg=0x7fffd5ccf710) at /ufs/lsidir/monetdb/MonetDB/monetdb5/modules/mal/tablet.c:1152 #9 0x00007ffff4d87555 in start_thread () from /lib64/libpthread.so.0 #10 0x00007ffff4ac1ded in clone () from /lib64/libc.so.6 The fix has not been ported to default? or a different issue? Lefteris On Mon, Mar 14, 2016 at 12:23 PM, Sjoerd Mullender wrote:

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256

On 14/03/16 11:14, Lefteris wrote:

...

Hi Souri,

I checked the issue and I can confirm that something is happening with the copied data, and monetdb does not like it. This error occurs during the first copy into.

The error I get is server5: /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306: strPut: Assertion `(v[i] & 0x80) == 0' failed.

while trying to load the data. And the trace reads

#4 0x00007ffff72d4c8f in strPut (h=0x7fffbc14d640, dst=0x7fffd4aa3c80, v=0x7fffd4aa3dd0 "Leftover data '*data i am not sure i should share...(?)* "...) at /ufs/lsidir/monetdb/MonetDB/gdk/gdk_atoms.c:1306

So I suspect to be a parse error that is not treated as it is supposed to.

This indicates that there is a non-UTF-8 character in the input. Of course, there should not be an assertion error if wrong input is given, so that problem has been fixed in changeset c5460cc0b66b. What then remains is the bad input.

...

Can we use the main_schema, data, and queries you send me to open a bug report? or is it sensitive data? If we can use them, then I suggest you open a bug report for the correct person to see it and fix it.

Lefteris

On Mon, Mar 14, 2016 at 9:21 AM, Souri Ratnaparkhi mailto:souri.ratnaparkhi@usain.com> wrote:

Hello Team,

I had shared all the data with Lefteris. When database crashes we restore it from the backup.

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

-----Original Message----- From: users-list [mailto:users-list-bounces+souri.ratnaparkhi mailto:users-list-bounces%2Bsouri.ratnaparkhi=usain.com@monetdb.org mailto:usain.com@monetdb.org] On Behalf Of Stefan Manegold Sent: Monday, March 14, 2016 2:10 PM To: Communication channel for MonetDB users Subject: Re: Monetdb crashes.

Dear Souri,

as both Hannes and Lefteris already mentioned with their replies to your earlier messages, we need detailed instructions (and data) how to reproduce the problem, otherwise, we have no means to debug it.

We easily operate tables with thousands of columns and millions of rows in MonetDB; hence, neither is expected to be a problem in general.

If your server crashes, and then fails to restart, this should be reflected in the merovingian.log . Please re-consult the log and feel free to share the relevant snippets.

If the server fails to restart and you fail to reconnect, how could you test with inserting fewer records into the very same table or inserting all records into a new empty table?

Best, Stefan

----- On Mar 14, 2016, at 5:10 AM, Souri Ratnaparkhi souri.ratnaparkhi@usain.com mailto:souri.ratnaparkhi@usain.com wrote:

...

Hello, We have a main table with 126 columns and approx. 94000 rows. We are trying to load approx 2500 records from temporary table into main table using query “insert into select” query. The database crashes upon query execution. We get error “ monetdbd: internal error while starting mserver, please refer to the logs ” when to try to connect again.

No specific error is created in log file. 1500 records successfully loads from temp table to main table. We also created another main table with same DDL, that table is empty & inserted all the records from temp successfully without any issue.

What could be the reason? Is 126 cols an issue? Please help. We are stuck.

(btw: We have machine about 200GB of hard disk & 16 GB RAM (14 GB free))

OS - Ubuntu 14.04.2 LTS (GNU/Linux 3.13.0-55-generic x86_64)

Monetdb version - MonetDB v11.21.13 (Jul2015-SP2)

Thank you

Souri Ratnaparkhi United Software Associates Pvt. Ltd. Pune, India Mob: 8975677255 Phone (India Lines): (91) 020-25445550 www.usain.com http://www.usain.com

_______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ http://www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 tel:%2B31%20%280%2920%20592-4212 | 1098 XG Amsterdam (NL) | _______________________________________________ users-list mailing list users-list@monetdb.org mailto:users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list

- -- Sjoerd Mullender -----BEGIN PGP SIGNATURE----- Version: GnuPG v2

iQEcBAEBCAAGBQJW5p85AAoJEISMxT6LrWYgd0MIAKe8euGNGKLHRJhMoQgIZyIN tia/LGef1qlMtcobbzzCE4HW3jF+bwgdYWWJa/BgObpXpxmkpLeV1o0NiFuO0Ru9 wObPBp2m2UNTe1tpRYbLCZyxub52uZbux0DYCUMtSRDhrzvxpRkVMRJ/SMf48TW9 0YU9nW+SCtTtorq71oGG98oZVElHB80zuzydrKoa2mk/3bdQt+ZCepfmy7odmzEK mAxmBVSKh8RoXWCero6lbbd6RE9OVMMrrECw1P7rbPpvfzbCjEF1hTv+THAsEBP9 SfZBbk93P+aYJMN/SPDEtf5K2MeVW0C/AuXI8UOHqbiEn7p/1NNsm98R/qRWDBs= =6DB/ -----END PGP SIGNATURE----- _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list