Bulk load from memory
Hello I became very interested in MonetDB during my research, and I am considering developing my own MAL compiler for a system based on a data model my research group is working on in the future. For now, I've been trying to understand MAL and how the COPY INTO command works in MonetDB Initially, I wish to do a large bulk load from an array in memory directly into MonetDB. My first "closed box" approach was to do the following: -Create a binary integer file containing milions of integers in /dev/shm/ named teste.bin. It is a memory based device, so the data is expected to be in main memory. -Create a table in MonetDB: CREATE TABLE teste (val INT); -Try to do BINARY COPY FROM: COPY BINARY INTO teste FROM ('/dev/shm/teste.bin'). When I try to this I get the error: Failed to attach file /dev/shm/teste.bin BATattach: cannot rename heapfile !OS: Invalid cross-device link After that I understood that monetdb basically moves the entire file around, which can't be done with data from another device. I wish to know if there is any sort of functionality in MonetDB or even a MAL module that would allow me to read from some sort of shared memory buffer (kind vague I know) directly into a BAT file. The MAL program for the COPY command has an sql.importTable and sql.append calls, so I wonder if there is some variant of those that would allow me to load binary data from a memory buffer? Thanks in Advance
participants (1)
-
Hermano ...