Cyrus questions, lost emails, reconstruct

[Derrick Seymour]

On Wed, May 14, 2008 at 11:44 PM, Derrick Seymour
<seymourdh at yahoo.com> wrote:
> Blake,
>
> --- Blake Hudson <blake at ispn.net> wrote:
>
>>
>>
>> -------- Original Message  --------
>> Subject: Cyrus questions, lost emails, reconstruct
>> From: Derrick Seymour <seymourdh at yahoo.com>
>> To: info-cyrus at lists.andrew.cmu.edu
>> Date: Wednesday, May 14, 2008 10:20:28 AM
>> > I have been having a few problems as of late.
>> >
>> > First, lost emails.  Well they aren't really
lost,
>> i
>> > have located them in the imap mail store under
the
>> > users name, kind of hidden i guess you would say.
>> not
>> > sure why that is.
>> >
>> > This happens randomly with incoming emails, maybe
>> one
>> > out of a couple thousand.
>> >
>> > My fix to this was to reconstruct the user box.
>> >
>> ...
>> > while this works, it seems to corrupt the inbox,
>> only
>> > the inbox all other folders stay intack.
>> >
>> ...
>> > sudo -u cyrus /usr/bin/cyrus/bin/reconstruct -i
>> >
>> > and of course this fixes the problem of the mail
>> box
>> > does not exist but i always seems to lose some
>> emails
>> > in the process, usually one or two users at
random
>> >
>> > You can probably see a very bad cycle here.
>> >
>> ...
>>
>> Sounds like bad RAM maybe corrupting the cyrus
>> databases... Any other
>> indication of file corruption or system
>> locking/freezing/rebooting
>> (things associated with bad memory) ?
>>
>> In a PC I'd run memtest86, dunno if that option is
>> available to you.
>>
>> -Blake
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info:
>> http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>
> No signs of bad memory, the server operates off a
> fiber channel RAID and there are no warnings or
> failures with that either.  There are a couple of
> utilities i can try to test the memory, but i will
not
> have an answer on that until this weekend.
>
> Why would reconstruct -i work (minus the few
> disappearing emails) and reconstruct -r user/short
> name corrupt the inbox?

What is the -i for ?
The -r was broken until last last 2.3.12 ! You must
use
$ reconstruct -r user/shortname/*
to take care of subdirectories and add -f to discover
unknown directories.


Can you give more information about your system ? OS,
cyrus version ?
How long did it operate without problems ? Did you
change anything ? Even
something you thing is unreleated ?


> I have to assume if the inbox
> didn't get corrupted that the missing emails in
> question would be there.  I have tried to copy
emails
> from inbox to a folder in side the usernames folder,
> upon a reconstruct -r those emails are now viewable,
> but the main inbox is still corrupt.

Try to reset the cyrus.index file before to
reconstruct, because cyreconstruct
could try to reuse it.
something like
# echo > cyrus.index
or just delete it


Regards

>
> Just a few things I tried if any of this helps.
>
> Thanks again for you help in advance
>
> Derrick
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info:
http://asg.web.cmu.edu/cyrus/mailing-list.html
>





I am on a mac os x server 10.3.9

not sure how to find the cyrus version, naive i
know...

the -i is from one of apples documents on how to
reconstruct the entire database for cyrus.  the -r is
for a single user, knowing now that it is broken makes
a lot of sense with the problems i am having
reconstructing.

latest system changes was the installation of
spamassassin with procmail for the relay.  This i
believe this caused my initial problem with the
disappearing emails.  Not to concerned about that
right now, though i will be very happy to receive
suggestions on that.

Main problem is to get reconstruct working, I will
deal with the disappearing emails later on, need to
get them back now and be able to get them back
reliably in the future until i fix the core problem
with the disappearing emails.

updated info that i found:

when i take a look at the mailbox.db for the user that
has a corrupted in box i get this....

myserver2:/var/imap user# sudo -u cyrus
/usr/bin/cyrus/bin/ctl_mboxlist -d | grep brokenuser
user.brokenuser   default BROKENUSER        lrswipcda
user.brokenuser.INBOX^Drafts      default brokenuser  
     lrswipcda
user.brokenuser.INBOX^Sent        default brokenuser  
     lrswipcda
user.brokenuser.INBOX^Trash       default brokenuser  
     lrswipcda

as you can see the inbox has the user in all caps,
makes sense now why they can't get into there inbox, i
believe this is case sensitive, so now how do i change
this back to lowercase and or which reconstruct
command (i know -r is broken) will work.  I don't mind
the broken construct if i can edit the mailbox.db
successfully to fix the one issue with the caps.  can
always do up a script.

i've checked other users, all of there info is in
lowercase....

thanks

Derrick