Date: 2014-06-18 10:52:53 +0200
From: Pete Hollobon <>
To: Merovingian devs <>
Version: 11.21.19 (Jul2015-SP4)

Last updated: 2016-04-11 11:24:37 +0200

Comment 19845

Date: 2014-06-18 10:52:53 +0200
From: Pete Hollobon <>

User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.153 Safari/537.36
Build Identifier:

MonetDB becomes unresponsive and upon restarting merovingian.log contains many "unknown state: 4" entries. This is happening once or twice a day on a ~3GB database.

We're running Jan2014-SP2 (official binaries) on Ubuntu server 14.04.

We had the same database on Jan2014-SP1 / Ubuntu 12.10 for several months and didn't see this issue.

Example:

2014-06-15 23:10:56 MSG example[36117]: MonetDB 5 server v11.17.17 "Jan2014-SP2"
2014-06-15 23:10:56 MSG example[36117]: Serving database 'example', using 16 threads
2014-06-15 23:10:56 MSG example[36117]: Compiled for x86_64-pc-linux-gnu/64bit with 64bit OIDs dynamically linked
2014-06-15 23:10:56 MSG example[36117]: Found 22.987 GiB available main-memory.
2014-06-15 23:10:56 MSG example[36117]: Copyright (c) 1993-July 2008 CWI.
2014-06-15 23:10:56 MSG example[36117]: Copyright (c) August 2008-2014 MonetDB B.V., all rights reserved
2014-06-15 23:10:56 MSG example[36117]: Visit http://www.monetdb.org/ for further information
2014-06-15 23:10:56 MSG example[36117]: Listening for UNIX domain connection requests on mapi:monetdb:///var/monetdb5/dbfarm/prod/example/.mapi.s
ock
2014-06-15 23:10:56 MSG example[36117]: MonetDB/SQL module loaded
2014-06-16 15:11:10 MSG merovingian[36104]: caught SIGTERM, starting shutdown sequence
2014-06-16 15:11:11 MSG control[36104]: control channel closed
2014-06-16 15:11:12 MSG merovingian[36104]: sending process 36117 (database 'example') the TERM signal
2014-06-16 15:11:13 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:13 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:14 ERR merov
ingian[36104]: unknown state: 42014-06-16 15:11:14 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:15 ERR merovingian[36104]: unknown state:
42014-06-16 15:11:16 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:16 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:17 ERR mer
ovingian[36104]: unknown state: 42014-06-16 15:11:17 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:18 ERR merovingian[36104]: unknown stat
e: 42014-06-16 15:11:18 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:19 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:19 ERR m
erovingian[36104]: unknown state: 42014-06-16 15:11:20 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:20 ERR merovingian[36104]: unknown st
ate: 42014-06-16 15:11:21 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:21 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:22 ERR
merovingian[36104]: unknown state: 42014-06-16 15:11:22 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:23 ERR merovingian[36104]: unknown
state: 42014-06-16 15:11:23 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:24 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:24 E
RR merovingian[36104]: unknown state: 42014-06-16 15:11:25 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:25 ERR merovingian[36104]: unknow
n state: 42014-06-16 15:11:26 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:26 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:27
ERR merovingian[36104]: unknown state: 42014-06-16 15:11:27 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:28 ERR merovingian[36104]: unkn
own state: 42014-06-16 15:11:28 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:29 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:
29 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:30 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:30 ERR merovingian[36104]: un
known state: 42014-06-16 15:11:31 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:31 ERR merovingian[36104]: unknown state: 42014-06-16 15:1
1:32 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:32 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:33 ERR merovingian[36104]:
unknown state: 42014-06-16 15:11:33 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:34 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:34 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:35 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:35 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:36 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:36 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:37 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:37 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:38 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:38 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:39 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:39 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:40 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:40 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:41 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:41 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:42 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:42 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:43 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:43 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:44 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:44 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:45 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:45 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:46 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:46 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:47 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:48 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:48 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:49 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:49 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:50 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:50 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:51 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:51 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:52 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:52 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:53 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:53 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:54 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:54 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:55 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:55 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:56 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:56 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:57 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:57 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:58 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:58 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:59 ERR merovingian[36104]: unknown state: 42014-06-16 15:11:59 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:00 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:00 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:01 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:01 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:02 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:02 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:03 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:03 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:04 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:04 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:05 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:05 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:06 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:06 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:07 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:07 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:08 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:08 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:09 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:09 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:10 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:10 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:11 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:11 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:12 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:12 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:13 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:13 ERR merovingian[36104]: unknown state: 42014-06-16 15:12:13 ERR merovingian[36104]: timeout of 60 seconds expired, sending process 36117 (database 'example') the KILL signal
2014-06-16 15:12:13 MSG merovingian[36104]: Merovingian 1.7 stopped
2014-06-16 15:12:13 MSG merovingian[36104]: database 'example' (36117) was killed by signal SIGKILL

Reproducible: Sometimes