Re: Re: failed to import record too long: Loading 1.5 Terabyte table
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message --------From: Mahmoud Mohsen
In fact, the record delimier must be pipe plus newline, i.e., '|\n' . Hence, your copy into command should look as follows: COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', '|\n' LOCKED; Best, Stefan ----- On Aug 18, 2017, at 8:18 PM, Stefan Manegold stefan.manegold@cwi.nl wrote:
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message -------- From: Mahmoud Mohsen
Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table Dear Stefan ,
Thank you very much for your quick reply,
so this is the first line of the file "lineitem.tbl", so no need to use an offset I think
1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the|
as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5).
So can this may be the cause of the error... an old version?
I am looking forward hearing from you,
Best regards,
Mahmoud Mohsen
_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
-- | Stefan.Manegold@CWI.nl | DB Architectures (DA) | | www.CWI.nl/~manegold/ | Science Park 123 (L321) | | +31 (0)20 592-4212 | 1098 XG Amsterdam (NL) |
Unfortunately input files often contain errors. They are collected in a predefined table that contains a copy of the failed line and line number in the source file. The rejects table should be explicitly cleared before you load a new file. Just issue the following instructions after your bulk load. SELECT * from sys.rejects; CALL sys.clearrejects(); On 18/08/2017 21:28, Stefan Manegold wrote:
In fact, the record delimier must be pipe plus newline, i.e., '|\n' .
Hence, your copy into command should look as follows:
COPY INTO lineitem FROM '/vol1/tpch-dbgen/2000/lineitem.tbl' USING DELIMITERS '|', '|\n' LOCKED;
Best, Stefan
----- On Aug 18, 2017, at 8:18 PM, Stefan Manegold stefan.manegold@cwi.nl wrote:
You need to use the correct record delimiter i.e. newline instead of space.
-------- Original message -------- From: Mahmoud Mohsen
Date: 8/18/17 19:40 (GMT+01:00) To: users-list@monetdb.org Subject: Re: Re: failed to import record too long: Loading 1.5 Terabyte table Dear Stefan ,
Thank you very much for your quick reply,
so this is the first line of the file "lineitem.tbl", so no need to use an offset I think
1|310378689|15378705|1|17|29786.89|0.04|0.02|N|O|1996-03-13|1996-02-12|1996-03-22|DELIVER IN PERSON|TRUCK|egular courts above the|
as for the version, I am using: MonetDB Database Server Toolkit v1.1 (Dec2016-SP5).
So can this may be the cause of the error... an old version?
I am looking forward hearing from you,
Best regards,
Mahmoud Mohsen
_______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
Martin Kersten
-
Stefan Manegold