[RFC PATCH v2] imapd.c: imapoptions: implement idle timeout
Andy Dorman
adorman at ironicdesign.com
Wed Sep 21 08:42:14 EDT 2016
On 09/20/2016 01:20 PM, Andy Dorman wrote:
>> Ellie, I agree a "crack" exists that idled processes may be slipping
>> through but so far I have little data to prove it.
>>
>> Empirically I have one server with two clients (I have moved everyone
>> else to other servers to decrease the number of variables), and the
>> process count in the IDLED state for those two clients grows apparently
>> without bound (at least I haven't found an upper limit yet). I have
>> been increasing the point at which I am alerted for "excess imapd
>> processes" and it is up to 100 processes now. After about 24 hours
>> these two clients reach that point and every process in
>> /var/run/cyrus/proc/ is attributed to them like this.
>>
>> imap hermione.ironicdesign.com [192.168.0.17] b2b at cogift.co
>> cogift.co!user.b2b Idle
>>
>> hermione is our nginx load balancer on an internal network.
>>
>> As far as we have been able to tell, no other client has this problem.
>>
>> Another data point...these are very low traffic accounts (6 emails for
>> one and 0 for the other in the last week).
>>
>> I am going to contact the owner of these two accounts today and ask her
>> what client she is using and how often she has it set up to check email.
>>
>
> OK, the client that appears to be causing our problem with apparently
> abandoned imapd idled processes is an old (possibly more than 5 years
> old) BlackBerry. Our client has it set to check all her mailboxes every
> 10-15 minutes. I have no idea how reliable the connectivity is for this
> BB, but given how active she is I would not be surprised to hear that
> the BB regularly loses connectivity when she is driving (which she does
> a lot).
FWIW, I have more empirical data to report on the above server with only
2 accounts that are being checked by an old BlackBerry (along with
Thunderbird an hour or two each day...but the BB is the only device
checking 24/7)
It has been ~24 hr since the last cyrus-imapd restart.
There are now 123 imapd processes, all idled, and all of course for
those two accounts. Looking at the proc file times in the time-sorted
list below they span from when the restart happened (Sep 20 0734) to
just a few minutes ago.
root at dorcas:~# ls -alt /run/cyrus/proc/
total 492
drwx------ 2 cyrus mail 2500 Sep 21 07:19 .
-rw------- 1 cyrus mail 84 Sep 21 07:10 20204
-rw------- 1 cyrus mail 96 Sep 21 07:10 20152
-rw------- 1 cyrus mail 96 Sep 21 06:52 19799
-rw------- 1 cyrus mail 84 Sep 21 06:52 19063
-rw------- 1 cyrus mail 84 Sep 21 06:44 18774
-rw------- 1 cyrus mail 96 Sep 21 06:44 18561
-rw------- 1 cyrus mail 84 Sep 21 06:21 18121
-rw------- 1 cyrus mail 96 Sep 21 06:21 18175
-rw------- 1 cyrus mail 84 Sep 21 06:15 18022
-rw------- 1 cyrus mail 96 Sep 21 06:15 17888
-rw------- 1 cyrus mail 96 Sep 21 04:53 15008
-rw------- 1 cyrus mail 84 Sep 21 04:53 14951
-rw------- 1 cyrus mail 96 Sep 21 04:45 14791
-rw------- 1 cyrus mail 84 Sep 21 04:45 14650
-rw------- 1 cyrus mail 96 Sep 21 04:34 14111
-rw------- 1 cyrus mail 84 Sep 21 04:34 14065
-rw------- 1 cyrus mail 84 Sep 21 04:19 13428
-rw------- 1 cyrus mail 96 Sep 21 04:19 13708
-rw------- 1 cyrus mail 84 Sep 21 04:04 13358
-rw------- 1 cyrus mail 96 Sep 21 04:02 13120
-rw------- 1 cyrus mail 96 Sep 21 03:49 12369
-rw------- 1 cyrus mail 84 Sep 21 03:48 12186
-rw------- 1 cyrus mail 96 Sep 21 03:31 11798
-rw------- 1 cyrus mail 84 Sep 21 03:31 11744
-rw------- 1 cyrus mail 84 Sep 21 03:14 11339
-rw------- 1 cyrus mail 96 Sep 21 03:13 11303
-rw------- 1 cyrus mail 84 Sep 21 02:56 10747
-rw------- 1 cyrus mail 96 Sep 21 02:56 10686
-rw------- 1 cyrus mail 84 Sep 21 02:44 10357
-rw------- 1 cyrus mail 96 Sep 21 02:44 10407
-rw------- 1 cyrus mail 84 Sep 21 02:32 9588
-rw------- 1 cyrus mail 96 Sep 21 02:32 9646
-rw------- 1 cyrus mail 84 Sep 21 02:19 9308
-rw------- 1 cyrus mail 96 Sep 21 02:19 9257
-rw------- 1 cyrus mail 96 Sep 21 02:07 8712
-rw------- 1 cyrus mail 84 Sep 21 02:07 8767
-rw------- 1 cyrus mail 84 Sep 21 01:49 7935
-rw------- 1 cyrus mail 96 Sep 21 01:49 7873
-rw------- 1 cyrus mail 84 Sep 21 01:34 7418
-rw------- 1 cyrus mail 96 Sep 21 01:34 7480
-rw------- 1 cyrus mail 96 Sep 21 01:18 6862
-rw------- 1 cyrus mail 84 Sep 21 01:18 7104
-rw------- 1 cyrus mail 84 Sep 21 01:04 6556
-rw------- 1 cyrus mail 96 Sep 21 01:04 6509
-rw------- 1 cyrus mail 84 Sep 21 00:47 5517
-rw------- 1 cyrus mail 96 Sep 21 00:47 5675
-rw------- 1 cyrus mail 96 Sep 21 00:36 5317
-rw------- 1 cyrus mail 84 Sep 21 00:36 5257
-rw------- 1 cyrus mail 84 Sep 21 00:22 4874
-rw------- 1 cyrus mail 96 Sep 21 00:22 4893
-rw------- 1 cyrus mail 84 Sep 21 00:14 4598
-rw------- 1 cyrus mail 96 Sep 21 00:14 4779
-rw------- 1 cyrus mail 84 Sep 20 23:59 4345
-rw------- 1 cyrus mail 96 Sep 20 23:59 4091
-rw------- 1 cyrus mail 96 Sep 20 23:49 3987
-rw------- 1 cyrus mail 84 Sep 20 23:49 3943
-rw------- 1 cyrus mail 84 Sep 20 23:36 3245
-rw------- 1 cyrus mail 96 Sep 20 23:36 3163
-rw------- 1 cyrus mail 84 Sep 20 23:34 2887
-rw------- 1 cyrus mail 96 Sep 20 23:34 2940
-rw------- 1 cyrus mail 84 Sep 20 23:19 2622
-rw------- 1 cyrus mail 96 Sep 20 23:19 2575
-rw------- 1 cyrus mail 84 Sep 20 23:03 2135
-rw------- 1 cyrus mail 96 Sep 20 23:02 2181
-rw------- 1 cyrus mail 84 Sep 20 22:52 1745
-rw------- 1 cyrus mail 96 Sep 20 22:52 1651
-rw------- 1 cyrus mail 96 Sep 20 22:39 1194
-rw------- 1 cyrus mail 84 Sep 20 22:39 1315
-rw------- 1 cyrus mail 84 Sep 20 22:27 879
-rw------- 1 cyrus mail 96 Sep 20 22:27 830
-rw------- 1 cyrus mail 84 Sep 20 22:07 32249
-rw------- 1 cyrus mail 96 Sep 20 22:07 413
-rw------- 1 cyrus mail 96 Sep 20 21:52 32104
-rw------- 1 cyrus mail 84 Sep 20 21:52 32068
-rw------- 1 cyrus mail 84 Sep 20 21:49 31857
-rw------- 1 cyrus mail 96 Sep 20 21:49 31990
-rw------- 1 cyrus mail 96 Sep 20 21:44 31670
-rw------- 1 cyrus mail 84 Sep 20 21:44 31622
-rw------- 1 cyrus mail 96 Sep 20 21:26 31202
-rw------- 1 cyrus mail 84 Sep 20 21:26 31191
-rw------- 1 cyrus mail 96 Sep 20 20:38 28554
-rw------- 1 cyrus mail 84 Sep 20 20:38 28441
-rw------- 1 cyrus mail 84 Sep 20 19:49 27037
-rw------- 1 cyrus mail 96 Sep 20 19:49 27086
-rw------- 1 cyrus mail 84 Sep 20 19:32 26567
-rw------- 1 cyrus mail 96 Sep 20 19:32 26517
-rw------- 1 cyrus mail 84 Sep 20 19:20 5333
-rw------- 1 cyrus mail 84 Sep 20 19:18 26200
-rw------- 1 cyrus mail 96 Sep 20 19:18 25941
-rw------- 1 cyrus mail 84 Sep 20 18:52 24665
-rw------- 1 cyrus mail 96 Sep 20 18:52 24524
-rw------- 1 cyrus mail 84 Sep 20 18:16 20635
-rw------- 1 cyrus mail 96 Sep 20 18:16 20515
-rw------- 1 cyrus mail 84 Sep 20 16:17 19196
-rw------- 1 cyrus mail 96 Sep 20 16:17 19195
-rw------- 1 cyrus mail 96 Sep 20 16:16 19194
-rw------- 1 cyrus mail 84 Sep 20 16:16 19241
-rw------- 1 cyrus mail 84 Sep 20 16:08 18934
-rw------- 1 cyrus mail 96 Sep 20 16:08 18941
-rw------- 1 cyrus mail 96 Sep 20 16:07 18732
-rw------- 1 cyrus mail 84 Sep 20 15:38 9424
-rw------- 1 cyrus mail 96 Sep 20 15:38 9743
-rw------- 1 cyrus mail 96 Sep 20 10:30 5590
-rw------- 1 cyrus mail 84 Sep 20 10:30 5543
-rw------- 1 cyrus mail 96 Sep 20 10:16 5391
-rw------- 1 cyrus mail 84 Sep 20 10:16 5015
-rw------- 1 cyrus mail 84 Sep 20 10:08 30606
-rw------- 1 cyrus mail 84 Sep 20 09:35 3326
-rw------- 1 cyrus mail 96 Sep 20 09:35 3239
-rw------- 1 cyrus mail 84 Sep 20 09:02 2038
-rw------- 1 cyrus mail 96 Sep 20 09:02 2139
-rw------- 1 cyrus mail 84 Sep 20 08:49 1693
-rw------- 1 cyrus mail 96 Sep 20 08:49 1739
-rw------- 1 cyrus mail 84 Sep 20 08:31 534
-rw------- 1 cyrus mail 96 Sep 20 08:31 541
-rw------- 1 cyrus mail 84 Sep 20 08:11 32419
-rw------- 1 cyrus mail 96 Sep 20 08:11 32317
-rw------- 1 cyrus mail 96 Sep 20 07:59 32040
-rw------- 1 cyrus mail 84 Sep 20 07:59 31985
-rw------- 1 cyrus mail 84 Sep 20 07:47 31626
-rw------- 1 cyrus mail 96 Sep 20 07:47 31006
-rw------- 1 cyrus mail 84 Sep 20 07:34 30732
-rw------- 1 cyrus mail 96 Sep 20 07:34 30675
and the contents of all the proc files look like one of these lines:
imap hermione.ironicdesign.com [192.168.0.17] b2b at cogift.co
cogift.co!user.b2b Idle
imap hermione.ironicdesign.com [192.168.0.17] donations at cogift.co
cogift.co!user.donations Idle
Sincere regards,
--
Andy Dorman
Ironic Design, Inc.
AnteSpam.com
More information about the Cyrus-devel
mailing list