Cyrus questions, lost emails, reconstruct

[Alain Spineux]

On Thu, May 15, 2008 at 3:49 PM, Derrick Seymour <seymourdh at yahoo.com> wrote:
> On Wed, May 14, 2008 at 11:44 PM, Derrick Seymour
> <seymourdh at yahoo.com> wrote:
>> Blake,
>>
>> --- Blake Hudson <blake at ispn.net> wrote:
>>
>>>
>>>
>>> -------- Original Message  --------
>>> Subject: Cyrus questions, lost emails, reconstruct
>>> From: Derrick Seymour <seymourdh at yahoo.com>
>>> To: info-cyrus at lists.andrew.cmu.edu
>>> Date: Wednesday, May 14, 2008 10:20:28 AM
>>> > I have been having a few problems as of late.
>>> >
>>> > First, lost emails.  Well they aren't really
> lost,
>>> i
>>> > have located them in the imap mail store under
> the
>>> > users name, kind of hidden i guess you would say.
>>> not
>>> > sure why that is.
>>> >
>>> > This happens randomly with incoming emails, maybe
>>> one
>>> > out of a couple thousand.
>>> >
>>> > My fix to this was to reconstruct the user box.
>>> >
>>> ...
>>> > while this works, it seems to corrupt the inbox,
>>> only
>>> > the inbox all other folders stay intack.
>>> >
>>> ...
>>> > sudo -u cyrus /usr/bin/cyrus/bin/reconstruct -i
>>> >
>>> > and of course this fixes the problem of the mail
>>> box
>>> > does not exist but i always seems to lose some
>>> emails
>>> > in the process, usually one or two users at
> random
>>> >
>>> > You can probably see a very bad cycle here.
>>> >
>>> ...
>>>
>>> Sounds like bad RAM maybe corrupting the cyrus
>>> databases... Any other
>>> indication of file corruption or system
>>> locking/freezing/rebooting
>>> (things associated with bad memory) ?
>>>
>>> In a PC I'd run memtest86, dunno if that option is
>>> available to you.
>>>
>>> -Blake
>>> ----
>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>> List Archives/Info:
>>> http://asg.web.cmu.edu/cyrus/mailing-list.html
>>>
>>
>> No signs of bad memory, the server operates off a
>> fiber channel RAID and there are no warnings or
>> failures with that either.  There are a couple of
>> utilities i can try to test the memory, but i will
> not
>> have an answer on that until this weekend.
>>
>> Why would reconstruct -i work (minus the few
>> disappearing emails) and reconstruct -r user/short
>> name corrupt the inbox?
>
> What is the -i for ?
> The -r was broken until last last 2.3.12 ! You must
> use
> $ reconstruct -r user/shortname/*
> to take care of subdirectories and add -f to discover
> unknown directories.
>
>
> Can you give more information about your system ? OS,
> cyrus version ?
> How long did it operate without problems ? Did you
> change anything ? Even
> something you thing is unreleated ?
>
>
>> I have to assume if the inbox
>> didn't get corrupted that the missing emails in
>> question would be there.  I have tried to copy
> emails
>> from inbox to a folder in side the usernames folder,
>> upon a reconstruct -r those emails are now viewable,
>> but the main inbox is still corrupt.
>
> Try to reset the cyrus.index file before to
> reconstruct, because cyreconstruct
> could try to reuse it.
> something like
> # echo > cyrus.index
> or just delete it
>
>
> Regards
>
>>
>> Just a few things I tried if any of this helps.
>>
>> Thanks again for you help in advance
>>
>> Derrick
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info:
> http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>
>
>
>
>
> I am on a mac os x server 10.3.9
>
> not sure how to find the cyrus version, naive i
> know...

I dont know anything to os x packaging

>
> the -i is from one of apples documents on how to
> reconstruct the entire database for cyrus.  the -r is
> for a single user, knowing now that it is broken makes
> a lot of sense with the problems i am having
> reconstructing.

-r is for "recursive" (on usual cyrus install)

>
> latest system changes was the installation of
> spamassassin with procmail for the relay.  This i
> believe this caused my initial problem with the
> disappearing emails.  Not to concerned about that
> right now, though i will be very happy to receive
> suggestions on that.

cyrus users use SIEVE instead of procmail.
Of course sieve is not as flexible as procmail, but a lot lot
faster, more secure, and part of cyrus

Read this, to be sure your procmail configuration is compatible with cyrus
http://www.oreilly.com/catalog/mimap/chapter/ch09.html

Is your mail store on a networked disk ?

>
> Main problem is to get reconstruct working, I will
> deal with the disappearing emails later on, need to
> get them back now and be able to get them back
> reliably in the future until i fix the core problem
> with the disappearing emails.
>
> updated info that i found:
>
> when i take a look at the mailbox.db for the user that
> has a corrupted in box i get this....
>
> myserver2:/var/imap user# sudo -u cyrus
> /usr/bin/cyrus/bin/ctl_mboxlist -d | grep brokenuser
> user.brokenuser   default BROKENUSER        lrswipcda
> user.brokenuser.INBOX^Drafts      default brokenuser
>     lrswipcda
> user.brokenuser.INBOX^Sent        default brokenuser
>     lrswipcda
> user.brokenuser.INBOX^Trash       default brokenuser
>     lrswipcda
>
> as you can see the inbox has the user in all caps,
> makes sense now why they can't get into there inbox, i
> believe this is case sensitive, so now how do i change
> this back to lowercase and or which reconstruct
> command (i know -r is broken) will work.  I don't mind
> the broken construct if i can edit the mailbox.db
> successfully to fix the one issue with the caps.  can
> always do up a script.

use cyradm to change ACL, using "sam" command

>
> i've checked other users, all of there info is in
> lowercase....
>
> thanks
>
> Derrick
>
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>



-- 
Alain Spineux
aspineux gmail com
May the sources be with you