Problems with Cyrus IMAP 2.2.5 on Solaris 9 on production server

[Shawn Sivy]

I wasn't able to get 2.2.3 to work eventhough I used the same build 
options.  Kept getting messages like ...

Jun  2 13:10:09 cyrus imap[3080]: [ID 884154 local6.error] unable to 
tell master 1: Broken pipe
Jun  2 13:10:09 cyrus imap[3080]: [ID 884154 local6.error] unable to 
tell master 2: Broken pipe

Since it was the middle of the day, I quickly put 2.2.5 back in place.  
The 2.2.5 version seems stable at the moment.

The weird thing is that I haven't seen the System I/O, too many files or 
signaled to death by 11 messages after I played around with the quota_db 
setting last night.  I went from quotalegacy to skiplist then back to 
quotalegacy.

When upgrading from 2.0.x (2.0.16 in my case) was it a requirement to 
run quota -f user to rebuild that?  I just copied the /var/imap/quota 
structure over from the old server, set "quota_db: quotalegacy" in 
/etc/imapd.conf, but didn't run the quota -f command.  When I was 
playing last night and gave up on skiplist for quota_db, I created an 
empty /var/imap/quota structure (with the requisite a thru z 
subdirectories) and started imap.  Then, I shutdown imap and copied over 
the quota files from the old system before restarting.  After that, I 
think everything has been fine.  I'm running "quota -f user" now and 
keeping my fingers crossed.

  -Shawn

Ken Murchison wrote:

> Shawn Sivy wrote:
>
>> I want to say that it takes a little while since I tried a couple 
>> things that seemed to work, but the errors creep back in after a 
>> bit.  I recompiled with gcc instead of Sun's cc, which I thought 
>> fixed the problem, but it didn't.
>> Off hand, could you tell whether the memory leak would most likely be 
>> in the cyrus code or in the underlying libraries.  I'll start looking 
>> for Solaris patches.  Suggestion what library/subsystem I should be 
>> targeting?
>
>
> My guess would be its a problem in the Cyrus code, specifically the 
> rewritten quota code.  Do you have code that is creating a lot of 
> users and setting a new quota on them?  I just fixed a bug 
> specifically for this problem.
>
>> Thanks for the reply, I've been pulling spending many hours ignoring 
>> my family trying to the this thing stable.  I may try to go back to 
>> Solaris 8 if I can't get it working by the end of the week.
>
>
> Did this problem start with 2.2.5 or with Solaris 9, or did you 
> upgrade both at the same time?  Does 2.2.3 work on Solaris 9?
>
>
>>
>>  -Shawn
>>
>> Ken Murchison wrote:
>>
>>> Shawn Sivy wrote:
>>>
>>>> I'm having all kinds of problems with Cyrus IMAP 2.2.5 on Solaris 
>>>> 9.  System I/O errors, imap processing dying, IOERRORs.
>>>>
>>>> Does anyone have suggestions on what could be the cause?  Has 
>>>> anyone gotten version 2.2.5 working on Solaris (SPARC) 9?
>>>>
>>>>  -Shawn
>>>>
>>>> May 30 17:52:57 cyrus lmtpunix[14954]: [ID 240394 local6.error] 
>>>> IOERROR: opening quota file /var/imap/quota/m/user.macey2: Too many 
>>>> open files
>>>> May 30 17:52:57 cyrus lmtpunix[14954]: [ID 335833 local6.error] 
>>>> DBERROR: error fetching user.macey2: cyrusdb error
>>>> May 30 17:52:57 cyrus lmtpunix[14954]: [ID 860734 local6.debug] 
>>>> verify_user(user.macey2) failed: System I/O error
>>>> May 30 17:53:20 cyrus lmtpunix[14954]: [ID 240394 local6.error] 
>>>> IOERROR: opening quota file /var/imap/quota/s/user.sdhugg: Too many 
>>>> open files
>>>> May 30 17:53:20 cyrus lmtpunix[14954]: [ID 335833 local6.error] 
>>>> DBERROR: error fetching user.sdhugg: cyrusdb error
>>>> May 30 17:53:20 cyrus lmtpunix[14954]: [ID 860734 local6.debug] 
>>>> verify_user(user.sdhugg) failed: System I/O error
>>>> May 30 17:53:40 cyrus lmtpunix[14954]: [ID 240394 local6.error] 
>>>> IOERROR: opening quota file /var/imap/quota/s/user.samuel2: Too 
>>>> many open files
>>>> May 30 17:53:40 cyrus lmtpunix[14954]: [ID 335833 local6.error] 
>>>> DBERROR: error fetching user.samuel2: cyrusdb error
>>>> May 30 17:53:40 cyrus lmtpunix[14954]: [ID 860734 local6.debug] 
>>>> verify_user(user.samuel2) failed: System I/O error
>>>> May 30 17:54:05 cyrus lmtpunix[14954]: [ID 240394 local6.error] 
>>>> IOERROR: opening quota file /var/imap/quota/b/user.balaisi2: Too 
>>>> many open files
>>>> May 30 17:54:05 cyrus lmtpunix[14954]: [ID 335833 local6.error] 
>>>> DBERROR: error fetching user.balaisi2: cyrusdb error
>>>> May 30 17:54:05 cyrus lmtpunix[14954]: [ID 860734 local6.debug] 
>>>> verify_user(user.balaisi2) failed: System I/O error
>>>
>>>
>>>
>>>
>>> Looks like a file descriptor leak, but I haven't seen this myself.  
>>> Does this happen immediately when you start up the master process, 
>>> or does it take a while?
>>>
>>
>> ---
>> Cyrus Home Page: http://asg.web.cmu.edu/cyrus
>> Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>
>


---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html