Thanks Matt for reporting this... we'll have a look into the issue shortly. regards/ m h wrote:

Am also getting the following error (trying to run my sqlalchemy monetdb backend):

*** glibc detected *** python: munmap_chunk(): invalid pointer: 0x081a0f78 *** ======= Backtrace: ========= /lib/libc.so.6[0xb7d0aa00] /usr/lib/libMapi.so.0(mapi_destroy+0x77)[0xb7a2940f] /home/matt/work/vpython/lib/python2.4/site-packages/MonetDB/_MapiLib.so[0xb78085a5] /usr/lib/libpython2.4.so.1.0(PyCFunction_Call+0x10d)[0xb7f1b420] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3259)[0xb7f487b5] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f4a17a] /usr/lib/libpython2.4.so.1.0[0xb7f0dd0c]

Not sure if it's related....

On Nov 15, 2007 2:58 PM, m h wrote:

...

Hello-

The simple python example from the website is crashing [0]. I get the following output when I try to run it:

matt@r52 ~/work/II/svn/trunk/2MonetDB $ python testmdb.py (981, 'schemas', 980, None, '0', True, '0', '0') *** glibc detected *** python: free(): invalid pointer: 0x080cf8d8 *** ======= Backtrace: ========= /lib/libc.so.6[0xb7cdea00] /lib/libc.so.6(cfree+0x89)[0xb7ce06f9] /usr/lib/libMapi.so.0(mapi_destroy+0x77)[0xb7b4a40f] /home/matt/work/vpython/lib/python2.4/site-packages/MonetDB/_MapiLib.so[0xb7fa25a5] /usr/lib/libpython2.4.so.1.0(PyCFunction_Call+0x10d)[0xb7eef420] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3259)[0xb7f1c7b5] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0(PyDict_DelItem+0xc8)[0xb7eee29a] /usr/lib/libpython2.4.so.1.0[0xb7ed5755] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x23b5)[0xb7f1b911] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0[0xb7ed579f] /usr/lib/libpython2.4.so.1.0(PyObject_SetAttr+0xbc)[0xb7ef098b] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x2372)[0xb7f1b8ce] /usr/lib/libpython2.4.so.1.0(PyEval_EvalFrame+0x3390)[0xb7f1c8ec] /usr/lib/libpython2.4.so.1.0(PyEval_EvalCodeEx+0x62e)[0xb7f1e17a] /usr/lib/libpython2.4.so.1.0[0xb7ee1d0c] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0[0xb7ed378e] /usr/lib/libpython2.4.so.1.0(PyObject_Call+0x27)[0xb7ece52e] /usr/lib/libpython2.4.so.1.0(PyEval_CallObjectWithKeywords+0xcc)[0xb7f18c55] /usr/lib/libpython2.4.so.1.0[0xb7ed60b5] /usr/lib/libpython2.4.so.1.0[0xb7eec587] /usr/lib/libpython2.4.so.1.0(PyDict_SetItem+0xb0)[0xb7eee75d] /usr/lib/libpython2.4.so.1.0(_PyModule_Clear+0x148)[0xb7eef9c3] /usr/lib/libpython2.4.so.1.0(PyImport_Cleanup+0x1ee)[0xb7f2fc18] /usr/lib/libpython2.4.so.1.0(Py_Finalize+0xf9)[0xb7f35261] /usr/lib/libpython2.4.so.1.0(Py_Main+0x9ad)[0xb7f3b1e9] python(main+0x1a)[0x804866e] /lib/libc.so.6(__libc_start_main+0xdc)[0xb7c8efdc] python[0x80485b1] ======= Memory map: ======== 08048000-08049000 r-xp 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 08049000-0804a000 rw-p 00000000 08:03 1772622 /home/matt/work/vpython/bin/python 0804a000-080f5000 rw-p 0804a000 00:00 0 [heap] b7800000-b7821000 rw-p b7800000 00:00 0 b7821000-b7900000 ---p b7821000 00:00 0 b79e1000-b79e9000 r-xp 00000000 08:03 4735072 /lib/libnss_files-2.6.1.so b79e9000-b79ea000 r--p 00007000 08:03 4735072 /lib/libnss_files-2.6.1.so b79ea000-b79eb000 rw-p 00008000 08:03 4735072 /lib/libnss_files-2.6.1.so b79eb000-b79f6000 r-xp 00000000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f6000-b79f7000 r--p 0000a000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f7000-b79f8000 rw-p 0000b000 08:03 4669940 /lib/libbz2.so.1.0.4 b79f8000-b7a06000 r-xp 00000000 08:03 2621464 /lib/libz.so.1.2.3 b7a06000-b7a07000 rw-p 0000d000 08:03 2621464 /lib/libz.so.1.2.3 b7a07000-b7a0d000 r-xp 00000000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0d000-b7a0e000 r--p 00005000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0e000-b7a0f000 rw-p 00006000 08:03 541522 /usr/lib/libstream.so.0.0.0 b7a0f000-b7af6000 r-xp 00000000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7af6000-b7b0b000 rw-p 000e6000 08:03 3432882 /usr/lib/libcrypto.so.0.9.8 b7b0b000-b7b0e000 rw-p b7b0b000 00:00 0 b7b0e000-b7b3d000 r-xp 00000000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b3d000-b7b41000 rw-p 0002e000 08:03 3432885 /usr/lib/libssl.so.0.9.8 b7b41000-b7b4c000 r-xp 00000000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4c000-b7b4d000 r--p 0000a000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b4d000-b7b4e000 rw-p 0000b000 08:03 541530 /usr/lib/libMapi.so.0.0.0 b7b73000-b7c79000 rw-p b7b73000 00:00 0 b7c79000-b7da3000 r-xp 00000000 08:03 4735105 /lib/libc-2.6.1.so b7da3000-b7da5000 r--p 0012a000 08:03 4735105 /lib/libc-2.6.1.so b7da5000-b7da6000 rw-p 0012c000 08:03 4735105 /lib/libc-2.6.1.so b7da6000-b7da9000 rw-p b7da6000 00:00 0 b7da9000-b7db2000 r-xp 00000000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db2000-b7db3000 rw-p 00009000 08:03 1492902 /usr/lib/gcc/i686-pc-linux-gnu/4.1.2/libgcc_s.so.1 b7db3000-b7db4000 rw-p b7db3000 00:00 0 b7db4000-b7dd8000 r-xp 00000000 08:03 4735063 /lib/libm-2.6.1.so b7dd8000-b7dd9000 r--p 00023000 08:03 4735063 /lib/libm-2.6.1.so b7dd9000-b7dda000 rw-p 00024000 08:03 4735063 /lib/libm-2.6.1.so b7dda000-b7e85000 r-xp 00000000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e85000-b7e8a000 rw-p 000aa000 08:03 1712627 /usr/lib/gcc-lib/i686-pc-linux-gnu/3.3.6/libstdc++.so.5.0.7 b7e8a000-b7e8f000 rw-p b7e8a000 00:00 0 b7e8f000-b7e91000 r-xp 00000000 08:03 4735083 /lib/libutil-2.6.1.so b7e91000-b7e92000 r--p 00001000 08:03 4735083 /lib/libutil-2.6.1.so b7e92000-b7e93000 rw-p 00002000 08:03 4735083 /lib/libutil-2.6.1.so b7e93000-b7e95000 r-xp 00000000 08:03 4735065 /lib/libdl-2.6.1.so b7e95000-b7e96000 r--p 00001000 08:03 4735065 /lib/libdl-2.6.1.so b7e96000-b7e97000 rw-p 00002000 08:03 4735065 /lib/libdl-2.6.1.so b7e97000-b7eaa000 r-xp 00000000 08:03 4735068 /lib/libpthread-2.6.1.so b7eaa000-b7eab000 r--p 00013000 08:03 4735068 /lib/libpthread-2.6.1.so b7eab000-b7eac000 rw-p 00014000 08:03 4735068 /lib/libpthread-2.6.1.so b7eac000-b7eae000 rw-p b7eac000 00:00 0 b7eae000-b7f62000 r-xp 00000000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f62000-b7f63000 r--p 000b3000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f63000-b7f85000 rw-p 000b4000 08:03 2050159 /usr/lib/libpython2.4.so.1.0 b7f85000-b7f8b000 rw-p b7f85000 00:00 0 b7f8b000-b7f8f000 r-xp 00000000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f8f000-b7f90000 r--p 00003000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f90000-b7f92000 rw-p 00004000 08:03 4166255 /usr/lib/python2.4/lib-dynload/strop.so b7f92000-b7f94000 r-xp 00000000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f94000-b7f95000 r--p 00001000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f95000-b7f96000 rw-p 00002000 08:03 541562 /usr/lib/libmutils.so.0.0.0 b7f96000-b7fab000 r-xp 00000000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fab000-b7fac000 r--p 00014000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fac000-b7fad000 rw-p 00015000 08:03 606460 /usr/lib/python2.4/site-packages/MonetDB/_MapiLib.so.0.0.0 b7fad000-b7fae000 rw-p b7fad000 00:00 0 b7fb1000-b7fb2000 r-xp b7fb1000 00:00 0 [vdso] b7fb2000-b7fcc000 r-xp 00000000 08:03 4735086 /lib/ld-2.6.1.so b7fcc000-b7fcd000 r--p 00019000 08:03 4735086 /lib/ld-2.6.1.so b7fcd000-b7fce000 rw-p 0001a000 08:03 4735086 /lib/ld-2.6.1.so bff36000-bff58000 rw-p bff36000 00:00 0 [stack] Aborted matt@r52 ~/work/II/svn/trunk/2MonetDB $

I'm running the latest ebuild for gentoo.

Any suggestions to remove crashing would be great.

thanks much,

matt

0 -http://monetdb.cwi.nl/projects/monetdb/SQL/Documentation/The-Python-Library....

------------------------------------------------------------------------- This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2005. http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/ _______________________________________________ MonetDB-users mailing list MonetDB-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/monetdb-users

On Fri, Nov 16, 2007 at 10:06:02AM +0100, Fabian Groffen wrote:

On 16-11-2007 09:36:44 +0100, Niels Nes wrote:

...

On Thu, Nov 15, 2007 at 02:58:05PM -0700, m h wrote:

...

Hello-

The simple python example from the website is crashing [0]. I get the following output when I try to run it:

Matt

On which version of MonetDB are you trying this?

ebuild == 5.2.0 (latest release)

with the correct PYTHONPATH, the released ("-0") version also works for me (on FC6; both with Python 2.4.4 & 2.5) Stefan -- | Dr. Stefan Manegold | mailto:Stefan.Manegold@cwi.nl | | CWI, P.O.Box 94079 | http://www.cwi.nl/~manegold/ | | 1090 GB Amsterdam | Tel.: +31 (20) 592-4212 | | The Netherlands | Fax : +31 (20) 592-4312 |

On 16-11-2007 10:33:29 -0700, m h wrote:

...

with the correct PYTHONPATH, the released ("-0") version also works for me (on FC6; both with Python 2.4.4 & 2.5)

Arghhh! Hmmmm, well I'm definitely crashing... Since this looks like a double free, perhaps this is a swig issue. (Ie, it's happening in the C not the python). What version of swig are you using? I'm on 1.3.31 (gentoo)....

Niels has had some fun on our Gentoo box and said he fixed it http://monetdb.cvs.sourceforge.net/monetdb/clients/src/mapilib/Mapi.mx?view=log&pathrev=Clients_1-20#rev1.24.2.2 Unfortunately that is in code which you cannot easily patch and recompile.

ps - If I can get around these crashes I think I'll have a SQLAlchemy backend for monetdb fairly soon. (Don't worry python folks, I'll set the code free whether or not I finish it. From the mailing list there appears to be at least 2 other SA attempts for monetdb, but I've yet to see any code from them).

The easiest thing you can do now, is to wait an hour or 12 from now and use the monetdb-install.sh script with --nightly=stable --enable-sql to install a MonetDB/SQL from nightly source snapshots.

On 16-11-2007 11:36:53 -0700, m h wrote:

On Nov 16, 2007 11:25 AM, Fabian Groffen wrote:

...

On 16-11-2007 10:33:29 -0700, m h wrote:

...

...

with the correct PYTHONPATH, the released ("-0") version also works for me (on FC6; both with Python 2.4.4 & 2.5)

Arghhh! Hmmmm, well I'm definitely crashing... Since this looks like a double free, perhaps this is a swig issue. (Ie, it's happening in the C not the python). What version of swig are you using? I'm on 1.3.31 (gentoo)....

Niels has had some fun on our Gentoo box and said he fixed it

http://monetdb.cvs.sourceforge.net/monetdb/clients/src/mapilib/Mapi.mx?view=log&pathrev=Clients_1-20#rev1.24.2.2

Wow, quick turnaround! Thanks!

So can Nels please elaborate on the issue? Why is this a Gentoo issue? Did he replicate the crash? Shouldn't other linuxes crash if there's a double free (that's what I grokked the error to be)?

I'm not sure if Fedora has glibc installed such that it makes double free detected messages.

I'm assumming no one else on the list is using the ebuild, hence no one else crashed?

Because our releases are always behind from the day they are released, most people here don't use any "packaged" versions, no ;)

...

Unfortunately that is in code which you cannot easily patch and recompile.

Well if I get motivated maybe I'll patch the file through the ebuild.... :)

That's the point. The patch is made to a .mx file, which is expanded into a .c and .h file. The ebuild only uses the .c and .h files, such that you don't need the "buildtools", which include a tool called "mx" which does extraction of .mx files. The only patch you could attempt, is to apply the patch to the corresponding .c file and hope patch will be able to match the hunks on the .c file code.

...

The easiest thing you can do now, is to wait an hour or 12 from now and use the monetdb-install.sh script with --nightly=stable --enable-sql to install a MonetDB/SQL from nightly source snapshots.

Doesn't the install script have a cvs pull option?

That too, but only for the cvs HEAD, as the script cannot know what the current stable branch is called.

On 16-11-2007 20:14:01 +0100, Niels Nes wrote:

...

Wow, quick turnaround! Thanks!

So can Nels please elaborate on the issue? Why is this a Gentoo niels ;-) issue? Did he replicate the crash? Shouldn't other linuxes crash if there's a double free (that's what I grokked the error to be)?

I'm assumming no one else on the list is using the ebuild, hence no one else crashed?

Indeed it was a double free. But then in code which is relatively new (database redirection) and not yet tested correctly.

Stefan didn't get the issue simply because he doesn't use Merovingian, which means he never gets any redirections.

On 17-11-2007 08:57:57 -0700, m h wrote:

...

...

Indeed it was a double free. But then in code which is relatively new (database redirection) and not yet tested correctly.

Stefan didn't get the issue simply because he doesn't use Merovingian, which means he never gets any redirections.

So should some tests be repeated/automated on the build machines using Merovingian?

Yes, and this is nearly impossible given the way nightly testing works.