On Jan 22, 2008 3:21 AM, Bob Ippolito
On Jan 22, 2008 12:28 AM, Niels Nes
wrote: ... About The slow loading problem, we would need to know your db schema ie a snippet of your sql create table statement would be needed. Also ETL involves more then just loading, ie COPY into, so could it be the transformation part or isn't that part of MonetDB's task?
monetdb is *only* doing COPY INTO, all of the other ETL work is done by PostgreSQL and Python. Mostly it's Python asking PostgreSQL to COPY its data into a file in a format that MonetDB can read.
Bob- I've a python script (SQLAlchemy) that dumps Oracle data into a delimited file. I've used that file to load into monetdb, postgres and mysql (using the native bulk loader for the respective dbs, ie COPY INTO not sqlalchemy). Let me know if you are interested in comparing dump formats. -matt
I have sent you a copy of our schema off-list.