Re: Creation of a remote table overhead

10 Jul 2020


      maybe you can prefix the queries with TRACE to look deeper into the execution of these queries to see where the time was spent?
...
On 10 Jul 2020, at 16:22, Ioannis Foufoulas  wrote:
Probably not, but I ‘m trying to figure out why in versions prior to Aug.2018  I ‘m getting this:
sql>CREATE REMOTE TABLE rmt_tbl (c1 int) ON 'mapi:monetdb://127.0.0.1:50000/voc3/sys/data' monetdb://127.0.0.1:50000/voc3/sys/data';
operation successful
sql:0.000 opt:0.359 run:0.473 clk:4.634 ms
While in versions after Aug. 2018 I have:
sql>CREATE REMOTE TABLE rmt_tbl (c1 int) ON 'mapi:monetdb://127.0.0.1:50000/voc3/sys/data' monetdb://127.0.0.1:50000/voc3/sys/data';
operation successful
sql:0.000 opt:0.068 run:0.057 clk:87.766 ms
...
On 10 Jul 2020, at 4:51 PM, Ying Zhang mailto:Y.Zhang@cwi.nl> wrote:
...
On 10 Jul 2020, at 15:26, Ioannis Foufoulas mailto:johnfouf@di.uoa.gr> wrote:
Hi,
I am trying to develop a Python client which sends queries to different Monetdb servers and transfers the results between them using the remote tables functionalities.
I’ve seen than my main overhead is execution of CREATE REMOTE TABLE statement. It requires 70-90msec  so in cases with many transfers and fast and small queries this
makes a difference. After looking at some older versions I’ve seen that the creation of a remote table was very fast before August 2018 (this is when authentication added).
Is there any hint on this? Could the. authentication strategy change in someway so that it runs faster or is it possible to select among different authentication methods for the remote tables?
Not sure if that’s the cause of the overhead, but better authentication was indeed added since Aug2018 (https://www.monetdb.org/blog/remote-tables-auth https://www.monetdb.org/blog/remote-tables-auth)
Jennie
...
Best,
Yannis
_______________________________________________
users-list mailing list
users-list@monetdb.org mailto:users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list https://www.monetdb.org/mailman/listinfo/users-list
_______________________________________________
users-list mailing list
users-list@monetdb.org mailto:users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list
_______________________________________________
users-list mailing list
users-list@monetdb.org
https://www.monetdb.org/mailman/listinfo/users-list