problematic upgrade 2.3.16 -> 2.4.3

[Bron Gondwana]

On Wed, Nov 10, 2010 at 09:17:02PM +0100, Paul Dekkers wrote:
> Hi,
> 
> Here is a specific example of a situation I don't know to solve.
> 
> The user "mm" is not logged in. The mailbox exists:
> 
> # sudo -u cyrus /usr/local/cyrus/bin/ctl_mboxlist -d | grep user.mm
> user.mm 0 default mm    lrswipcda
> user.mm.Drafts  0 default mm    lrswipcda
> user.mm.Junk    0 default mm    lrswipcda
> user.mm.Sent    0 default mm    lrswipcda
> user.mm.Trash   0 default mm    lrswipcda
> 
> The user fails to login (and lmtp fails):
> 
> imap[95676]: Failed to append cache to user.mm for 3568
> imap[95676]: Index upgrade failed: user.mm
> imap[95676]: IOERROR: locking index user.mm: No such file or directory
> 
> And a reconstruct fails, with -r and with -rf or -G:
> 
> reconstruct[95674]: reconstructing user.mm
> reconstruct[95674]: Failed to append cache to user.mm for 3568
> reconstruct[95674]: Index upgrade failed: user.mm
> reconstruct[95674]: IOERROR: locking index user.mm: No such file or
> directory
> 
> This file 3568 just exists on disk. Reconstruct dumps core.
> 
> Reconstruct tries to create the new index, but there's hardly anything
> in there, look at the .NEW size:
> 
> -rw-------   1 cyrus  cyrus  3929540 Nov 10 21:03 cyrus.cache
> -rw-------   1 cyrus  cyrus   175656 Nov 10 04:00 cyrus.expunge
> -rw-------   1 cyrus  cyrus      165 Feb 10  2010 cyrus.header
> -rw-------   1 cyrus  cyrus    45504 Nov 10 18:47 cyrus.index
> -rw-------   1 cyrus  cyrus      896 Nov 10 21:03 cyrus.index.NEW
> -rw-------   1 cyrus  cyrus  2365296 Nov 10 02:01 cyrus.squat
> 
> I can't really figure out from a truss reconstruct why it fails, it
> looks like it's just going through the messages with utimes and fstat.
> 
> If I move the metadata to UFS instead of ZFS, that didn't help, neither
> did moving the messages to UFS help. So it's not ZFS-related I suppose.
> It keeps dumping core.
> 
> Any idea?
> 
> (Can I downgrade? I just need to reconstruct everything, right, because
> the index format changed? :-S)

Yes, you will need to reconstruct anything which successfully upgraded.
This issue got reported last night, and I wrote a patch but haven't
yet tested it.  I can give it to you in about 2-3 hours if you'll still
be around then!

Bron.