ctl_cyrusdb using 99& CPU

[Steinar Bang]

I finally succeeded in starting it again.  I kill -9'd the ctl_cyrusdb
process.

On shutdown it wrote this in the syslog:
 Nov 15 22:30:20 doohan cyrus/master[12843]: process 12844 exited, signaled to death by 9 
 Nov 15 22:30:21 doohan cyrus/master[12980]: about to exec /usr/sbin/ctl_deliver
 Nov 15 22:30:21 doohan cyrus/ctl_deliver[12980]: duplicate_prune: pruning back 3 days
 Nov 15 22:30:21 doohan cyrus/ctl_deliver[12980]: duplicate_prune: purged 0 out of 56 entries
 Nov 15 22:30:21 doohan cyrus/master[12981]: about to exec /usr/sbin/tls_prune
 Nov 15 22:30:21 doohan cyrus/tls_prune[12981]: mydelete: starting txn 2147483653
 Nov 15 22:30:21 doohan cyrus/tls_prune[12981]: mydelete: committing txn 2147483653
 Nov 15 22:30:21 doohan cyrus/tls_prune[12981]: mydelete: starting txn 2147483654
 Nov 15 22:30:21 doohan cyrus/tls_prune[12981]: mydelete: committing txn 2147483654
 Nov 15 22:30:21 doohan cyrus/tls_prune[12981]: tls_prune: purged 2 out of 2 entries
 Nov 15 22:30:21 doohan cyrus/master[12843]: WARNING: cannot find executable for service 'pop3' -- ignored
 Nov 15 22:30:21 doohan cyrus/master[12843]: ready for work
 Nov 15 22:30:21 doohan cyrus/master[12982]: about to exec /usr/sbin/ctl_cyrusdb
 Nov 15 22:30:21 doohan cyrus/ctl_cyrusdb[12982]: checkpointing cyrus databases
 Nov 15 22:30:21 doohan cyrus/master[12983]: about to exec /usr/lib/cyrus/bin/notifyd
 Nov 15 22:30:22 doohan cyrus/notify[12983]: executed
 Nov 15 22:30:22 doohan cyrus/ctl_cyrusdb[12982]: archiving log file: /var/lib/cyrus/db/log.0000000006
 Nov 15 22:30:27 doohan cyrus/ctl_cyrusdb[12982]: archiving database file: /var/lib/cyrus/mailboxes.db
 Nov 15 22:30:27 doohan cyrus/ctl_cyrusdb[12982]: done checkpointing cyrus databases
 Nov 15 22:30:27 doohan cyrus/master[12843]: process 12982 exited, status 0

I then did an
 /etc/init.d/cyrus21 stop
for good measures, and got the following in syslog:
 Nov 15 22:31:40 doohan cyrus/master[12843]: exiting on SIGTERM/SIGINT
 Nov 15 22:31:40 doohan cyrus/notifyd[12983]: got SIGTERM/SIGINT, trying to exit cleanly...

I then started again with
 /etc/init.d/cyrus21 stop
and got the following syslog messages:
 Nov 15 22:31:59 doohan cyrus/master[13013]: process started
 Nov 15 22:31:59 doohan cyrus/master[13014]: about to exec /usr/sbin/ctl_cyrusdb
 Nov 15 22:31:59 doohan cyrus/ctl_cyrusdb[13014]: recovering cyrus databases
 Nov 15 22:32:01 doohan cyrus/ctl_cyrusdb[13014]: skiplist: recovered /var/lib/cyrus/mailboxes.db (29 records, 2804 bytes) in 0 seconds
 Nov 15 22:32:01 doohan cyrus/ctl_cyrusdb[13014]: done recovering cyrus databases
 Nov 15 22:32:01 doohan cyrus/master[13015]: about to exec /usr/sbin/ctl_deliver
 Nov 15 22:32:01 doohan cyrus/ctl_deliver[13015]: duplicate_prune: pruning back 3 days
 Nov 15 22:32:01 doohan cyrus/ctl_deliver[13015]: duplicate_prune: purged 0 out of 56 entries
 Nov 15 22:32:01 doohan cyrus/master[13016]: about to exec /usr/sbin/tls_prune
 Nov 15 22:32:02 doohan cyrus/tls_prune[13016]: tls_prune: purged 0 out of 0 entries
 Nov 15 22:32:02 doohan cyrus/master[13013]: WARNING: cannot find executable for service 'pop3' -- ignored
 Nov 15 22:32:02 doohan cyrus/master[13013]: ready for work
 Nov 15 22:32:02 doohan cyrus/master[13017]: about to exec /usr/sbin/ctl_cyrusdb
 Nov 15 22:32:02 doohan cyrus/ctl_cyrusdb[13017]: checkpointing cyrus databases
 Nov 15 22:32:02 doohan cyrus/master[13018]: about to exec /usr/lib/cyrus/bin/notifyd
 Nov 15 22:32:02 doohan cyrus/notify[13018]: executed
 Nov 15 22:32:02 doohan cyrus/ctl_cyrusdb[13017]: archiving log file: /var/lib/cyrus/db/log.0000000006
 Nov 15 22:32:06 doohan cyrus/ctl_cyrusdb[13017]: archiving database file: /var/lib/cyrus/mailboxes.db
 Nov 15 22:32:06 doohan cyrus/ctl_cyrusdb[13017]: done checkpointing cyrus databases
 Nov 15 22:32:06 doohan cyrus/master[13013]: process 13017 exited, status 0

When I checked processes I found that cyrmaster was running.  So I tried
connecting to the imap server and it worked.

So now it runs... but I have no idea what kept it from running and what
made it run again... and worry about whether it will happen again...:-)


- Steinar