Thread safety in python UDFs
Hi, One question on python udfs. What about thread safety? In case of concurrent execution of numpy UDFs should the UDF developer use thread-safe structures or Monetdb handles this in some way? For example, pandas is not thread safe. This means that it should not be used in a UDF? Best, Yannis
Hello Yannis, Mapped Python UDFs will run in parallel, which may cause thread issues. However non mapped ones are blocking operations, so only one thread will execute them. You can look at more details in the blogpost here: https://www.monetdb.org/blog/embedded-pythonnumpy-monetdb Best regards, Pedro On 9/29/20 1:04 PM, Ioannis Foufoulas wrote:
Hi, One question on python udfs. What about thread safety? In case of concurrent execution of numpy UDFs should the UDF developer use thread-safe structures or Monetdb handles this in some way? For example, pandas is not thread safe. This means that it should not be used in a UDF? Best, Yannis _______________________________________________ users-list mailing list users-list@monetdb.org https://www.monetdb.org/mailman/listinfo/users-list
participants (2)
-
ferreira
-
Ioannis Foufoulas