[MonetDB-users] too deep recursion
Hi all, We are trying to annotate some XML data with MonetDB/XQuery. For this I run some big queries, that contain unions of many Xpath expressions (say 100). I get the following error: ERROR = !fatal error: aborted too deep recursion Tried to use the option declare option pf:recursion-depth "<number>"; I see no difference in bahaviour. I also call mclient with -G, though I don't know if it's needed. MonetDB Server is v4.26.2 and default back-end is 'algebra'. Any help with this? Thank you, Lazaros. -- http://www.ics.forth.gr/~koromil
Hi,
It looks like you have hit the limit of the query size that the
MonetDB/XQuery compiler can handle (i.e., optimize and compile a
plan). What platform are you using? Windows or Linux? Can you share
with us the query that you are trying to run?
The -G option does not make any difference because by default the
algebra is enabled.
Also I would suggest to upgrade Monet as soon as the new release is
out, because there were some fixes regarding this issue.
Kind regards,
lefteris
On Sat, Feb 28, 2009 at 3:23 PM, Lazaros Koromilas
Hi all,
We are trying to annotate some XML data with MonetDB/XQuery. For this I run some big queries, that contain unions of many Xpath expressions (say 100).
I get the following error: ERROR = !fatal error: aborted too deep recursion
Tried to use the option declare option pf:recursion-depth "<number>"; I see no difference in bahaviour. I also call mclient with -G, though I don't know if it's needed.
MonetDB Server is v4.26.2 and default back-end is 'algebra'.
Any help with this?
Thank you, Lazaros.
-- http://www.ics.forth.gr/~koromil
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
First of all thank you for the quick reply, I have compiled MonetDB on FreeBSD 7.0. An xquery code snipet is here: http://pastebin.com/m50d9c7fb where <xpath> are very simple auto-generated xpath queries using only child axes; one could see them as unix paths. What about the `pf:recursion-depth' option? Thanx again, Lazaros. On Sun, Mar 01, 2009 at 12:03:50PM +0100, Lefteris wrote:
Hi,
It looks like you have hit the limit of the query size that the MonetDB/XQuery compiler can handle (i.e., optimize and compile a plan). What platform are you using? Windows or Linux? Can you share with us the query that you are trying to run?
The -G option does not make any difference because by default the algebra is enabled.
Also I would suggest to upgrade Monet as soon as the new release is out, because there were some fixes regarding this issue.
Kind regards,
lefteris
On Sat, Feb 28, 2009 at 3:23 PM, Lazaros Koromilas
wrote: Hi all,
We are trying to annotate some XML data with MonetDB/XQuery. For this I run some big queries, that contain unions of many Xpath expressions (say 100).
I get the following error: ERROR = !fatal error: aborted too deep recursion
Tried to use the option declare option pf:recursion-depth "<number>"; I see no difference in bahaviour. I also call mclient with -G, though I don't know if it's needed.
MonetDB Server is v4.26.2 and default back-end is 'algebra'.
Any help with this?
Thank you, Lazaros.
-- http://www.ics.forth.gr/~koromil
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Hi,
the pf:recursion-depth function has nothing to do with the errors you
are getting. The problem is that your query is too long with too many
operators and the compiler runs out of space for recursive calling the
function that creates the algebraic tree.
lefteris
On Sun, Mar 1, 2009 at 9:09 PM, Lazaros Koromilas
First of all thank you for the quick reply,
I have compiled MonetDB on FreeBSD 7.0.
An xquery code snipet is here: http://pastebin.com/m50d9c7fb
where <xpath> are very simple auto-generated xpath queries using only child axes; one could see them as unix paths.
What about the `pf:recursion-depth' option?
Thanx again, Lazaros.
On Sun, Mar 01, 2009 at 12:03:50PM +0100, Lefteris wrote:
Hi,
It looks like you have hit the limit of the query size that the MonetDB/XQuery compiler can handle (i.e., optimize and compile a plan). What platform are you using? Windows or Linux? Can you share with us the query that you are trying to run?
The -G option does not make any difference because by default the algebra is enabled.
Also I would suggest to upgrade Monet as soon as the new release is out, because there were some fixes regarding this issue.
Kind regards,
lefteris
On Sat, Feb 28, 2009 at 3:23 PM, Lazaros Koromilas
wrote: Hi all,
We are trying to annotate some XML data with MonetDB/XQuery. For this I run some big queries, that contain unions of many Xpath expressions (say 100).
I get the following error: ERROR = !fatal error: aborted too deep recursion
Tried to use the option declare option pf:recursion-depth "<number>"; I see no difference in bahaviour. I also call mclient with -G, though I don't know if it's needed.
MonetDB Server is v4.26.2 and default back-end is 'algebra'.
Any help with this?
Thank you, Lazaros.
-- http://www.ics.forth.gr/~koromil
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
-- http://www.ics.forth.gr/~koromil
------------------------------------------------------------------------------ Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise -Strategies to boost innovation and cut costs with open source participation -Receive a $600 discount off the registration fee with the source code: SFAD http://p.sf.net/sfu/XcvMzF8H _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users
Lazaros, I don't know how the paths you are generating look like. But you should know that in MonetDB/XQuery it is often much more efficient to, e.g., use the XPath descendant axis rather than "helping" the system by enumerating all possible paths explicitly. If it is possible to express your full problem in XQuery (and not through auto generation outside the database engine), you should consider doing that. Best regards, Jens -- Jens Teubner ETH Zurich, Systems Group Haldeneggsteig 4, 8092 Zurich, Switzerland jens.teubner@inf.ethz.ch
participants (3)
-
Jens Teubner
-
Lazaros Koromilas
-
Lefteris