Bug or feature: (Too) Many imapd processes hanging around?

[Matthew Schumacher]

On 10/08/2012 12:48 PM, Matthew Schumacher wrote:
> I have exactly the same issue:
> 
> I found on my system that this file:
> 
> /cyrus/mailboxes/e/user/escalations/cyrus.index
> 
> Was being held open by 6423 children processes which all reported:
> 
> fcntl(17, F_SETLKW, {type=F_WRLCK, whence=SEEK_SET, start=0, len=0}
> 
> The process that was holding the lock reported:
> 
> futex(0x7f6d86e0f720, FUTEX_WAIT_PRIVATE, 2, NULL
> 
> After I killed it, everything else seems to be closing out, but slowly.
> 
> As a data point I'm running a fairly different config as Andreas:
> 
> Ext4 file system on native partition (though it's a vmware disk) so no drdb
> 
> Cyrus 2.4.16 with the following patches:
> 
> cyrus-imapd-2.4.4-autocreate-0.10-0.patch
> cyrus-imapd-2.4.12-autosieve-0.6.0.patch
> 

This just happened to me again:


root at mail:/home/schu# lsof | grep
/cyrus/mailboxes/s/user/support/cyrus.index | head
imapd      2013      cyrus  mem       REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      2013      cyrus   17u      REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      2929      cyrus  mem       REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      2929      cyrus   17u      REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      3180      cyrus  mem       REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      3180      cyrus   17u      REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      3444      cyrus  mem       REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      3444      cyrus   17u      REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      4600      cyrus  mem       REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index
imapd      4600      cyrus   17u      REG                8,8     26432
  4034886 /cyrus/mailboxes/s/user/support/cyrus.index


A total of 282 processes are hung on this file

This process has the lock:

root at mail:/home/schu# strace -p 27029
Process 27029 attached - interrupt to quit
futex(0x7f6ff0a7a720, FUTEX_WAIT_PRIVATE, 2, NULL

When I kill it with TERM I get:

) = ? ERESTARTSYS (To be restarted)
--- SIGTERM (Terminated) @ 0 (0) ---
Process 27029 detached

Then my process list starts shrinking as the other 281 processes close out.

I should note that the mailboxes this happens on are being monitored by
multiple users so there are multiple connections to this mailbox and the
others that have had this problem.

schu