[MonetDB-users] Segmentation fault

newer
[MonetDB-users] using MonetDB for...

Sten Hjelmqvist

4 Sep 2009 4 Sep '09

12:29 p.m.

Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space. I import a large database, ~1.5Gbyte , using \Segmentation fault" Can I reconfigure the database to avoid this? --------------------------------------- Sten Hjelmqvist DataKonsult MERdata AB Sveavägen 33, 111 34 Stockholm Mobil : 0708 305616 E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se Webb : www.merdata.se http://www.main.se/ ---------------------------------------

Attachments:

attachment.html (text/html — 3.4 KB)

Show replies by date

Martin Kersten

4 Sep 4 Sep

2:15 p.m.

Sten Hjelmqvist wrote:

...

Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: “>Segmentation fault” This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Sten Hjelmqvist

3:15 p.m.

Thank you for your fast reply. I have attached a file with the first 100 lines. The entire file is 1.5 GBytes, the zip is 260 Mbytes. /Sten -----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 16:16 Till: Communication channel for MonetDB users Ämne: Re: [MonetDB-users] Segmentation fault Sten Hjelmqvist wrote:

...

Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: ">Segmentation fault" This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Martin Kersten

4:50 p.m.

...

Thank you for your fast reply. I have attached a file with the first 100 lines. The entire file is 1.5 GBytes, the zip is 260 Mbytes. THank you for the snippet. One issue is already clear. You use quoted string input without telling the system to respect quote character. If you don't specify that,

Sten Hjelmqvist wrote: the value between two field separators is interpreted as the complete string value. The following applied to your script works. COPY 2 RECORDS INTO "dim_store" FROM stdin USING DELIMITERS '\t','\n','"';

...

/Sten

-----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 16:16 Till: Communication channel for MonetDB users Ämne: Re: [MonetDB-users] Segmentation fault

Sten Hjelmqvist wrote:

...
Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: ">Segmentation fault" This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Stefan Manegold

5:33 p.m.

On Fri, Sep 04, 2009 at 06:50:12PM +0200, Martin Kersten wrote:

...

...
Thank you for your fast reply. I have attached a file with the first 100 lines. The entire file is 1.5 GBytes, the zip is 260 Mbytes. THank you for the snippet. One issue is already clear. You use quoted string input without telling the system to respect quote character. If you don't specify that,

Sten Hjelmqvist wrote: the value between two field separators is interpreted as the complete string value.

Was/is that also already the case in the "old" bulk loader in the Aug2009 release?

...

The following applied to your script works. COPY 2 RECORDS INTO "dim_store" FROM stdin USING DELIMITERS '\t','\n','"';

...
/Sten

-----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 16:16 Till: Communication channel for MonetDB users Ämne: Re: [MonetDB-users] Segmentation fault

Sten Hjelmqvist wrote:

...
Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: ">Segmentation fault" This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Martin Kersten

6:24 p.m.

Stefan Manegold wrote:

...

On Fri, Sep 04, 2009 at 06:50:12PM +0200, Martin Kersten wrote:

...
...
Thank you for your fast reply. I have attached a file with the first 100 lines. The entire file is 1.5 GBytes, the zip is 260 Mbytes. THank you for the snippet. One issue is already clear. You use quoted string input without telling the system to respect quote character. If you don't specify that,

Sten Hjelmqvist wrote: the value between two field separators is interpreted as the complete string value.

Was/is that also already the case in the "old" bulk loader in the Aug2009 release? Indeed, in the august09 version it is not yet needed. # MonetDB/SQL module v2.32.0 loaded .... &3 &2 2 -1 &1 0 2 3 2 % sys.dim_store, sys.dim_store, sys.dim_store # table_name % id, storenumber, name # name % smallint, smallint, char # type % 1, 1, 50 # length [ 1, 3, "Butik #3 " ] [ 2, 5, "Matpressen

...
The following applied to your script works. COPY 2 RECORDS INTO "dim_store" FROM stdin USING DELIMITERS '\t','\n','"';

...
/Sten

-----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 16:16 Till: Communication channel for MonetDB users Ämne: Re: [MonetDB-users] Segmentation fault

Sten Hjelmqvist wrote:

...
Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: ">Segmentation fault" This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

Sten Hjelmqvist

7 Sep 7 Sep

9:48 a.m.

I'm loading a dump-file on a Ubuntu-machine running Aug2009 version. The file was created on a Windows-machine using the Aug2009 version. It has not been changed. I'm afraid I don't understand the answers. Should I make any changes to the dump-file? Below You find a copy of the server as well as the client consoles: ----------- Server --------------

...

ubuntu@EMMA:~$ sudo mserver5 --dbinit="include sql;" [sudo] password for ubuntu: # MonetDB server v5.12.4, based on kernel v1.30.4 # Serving database 'demo', using 2 threads # Compiled for i486-pc-linux-gnu/32bit with 32bit OIDs dynamically linked # Copyright (c) 1993-July 2008 CWI. # Copyright (c) August 2008-2009 MonetDB B.V., all rights reserved # Visit http://monetdb.cwi.nl/ for further information #warning: please don't forget to set your vault key! #(see /etc/monetdb5.conf) # Listening for connection requests on mapi:monetdb://EMMA:50000/ # MonetDB/SQL module v2.30.4 loaded Segmentation fault ubuntu@EMMA:~$

-------------------- Client ----------------------- ubuntu@EMMA:~$ sudo mclient -lsql --time sql>\ -----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 20:24 Till: monetdb-users@lists.sourceforge.net Ämne: Re: [MonetDB-users] Segmentation fault Stefan Manegold wrote:

...

On Fri, Sep 04, 2009 at 06:50:12PM +0200, Martin Kersten wrote:

...
...
Thank you for your fast reply. I have attached a file with the first 100 lines. The entire file is 1.5 GBytes, the zip is 260 Mbytes. THank you for the snippet. One issue is already clear. You use quoted string input without telling the system to respect quote character. If you don't specify that,

Sten Hjelmqvist wrote: the value between two field separators is interpreted as the complete string value.

Was/is that also already the case in the "old" bulk loader in the Aug2009 release? Indeed, in the august09 version it is not yet needed. # MonetDB/SQL module v2.32.0 loaded .... &3 &2 2 -1 &1 0 2 3 2 % sys.dim_store, sys.dim_store, sys.dim_store # table_name % id, storenumber, name # name % smallint, smallint, char # type % 1, 1, 50 # length [ 1, 3, "Butik #3 " ] [ 2, 5, "Matpressen

...
The following applied to your script works. COPY 2 RECORDS INTO "dim_store" FROM stdin USING DELIMITERS '\t','\n','"';

...
/Sten

-----Ursprungligt meddelande----- Från: Martin Kersten [mailto:Martin.Kersten@cwi.nl] Skickat: den 4 september 2009 16:16 Till: Communication channel for MonetDB users Ämne: Re: [MonetDB-users] Segmentation fault

Sten Hjelmqvist wrote:

...
Using MonetDB Aug 2009 on a Ubuntu Server 9.04 with 4Gbyte memory and 60Gbyte free disk space.

I import a large database, ~1.5Gbyte , using \
After a while the database exits with msg: ">Segmentation fault" This is a message that should not have happened. What is in that file? MonetDB SQL statements or csv tuples? Can you sent a snippet (first part). regards, Martin

Can I reconfigure the database to avoid this?

---------------------------------------

Sten Hjelmqvist

DataKonsult

MERdata AB

Sveavägen 33, 111 34 Stockholm

Mobil : 0708 305616

E-mejl : sten.hjelmqvist@merdata.se mailto:sten.hjelmqist@merdata.se

Webb : www.merdata.se http://www.main.se/

---------------------------------------

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july

------------------------------------------------------------------------

_______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

5548

Age (days ago)

5551

Last active (days ago)

List overview

Download

6 comments

3 participants

participants (3)

Martin Kersten
Stefan Manegold
Sten Hjelmqvist