IMAP not seeing old mail present on filesystem

[Chris Pepper]

On 10/4/10 11:36 AM, Bron Gondwana wrote:
> On Mon, Oct 04, 2010 at 11:17:59AM -0400, Chris Pepper wrote:
>> On 10/4/10 10:23 AM, Patrick Goetz wrote:
>>> I wasn't clear about whether the old install was completely gone or
>>> could still be booted.  If you can still start cyrus on the old server,
>>> you could try imapsync to transfer mail to the new one.
>>
>> 	Old system is not bootable, unfortunately.
>>
>> 	FYI: I have 943 directories&  298,409 mail files,
>> so manually fixing things isn't feasible.
>       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>
> Well, of course not.  It there were 5 directories and 20 mail
> files I wouldn't consider doing it manually - I'd write a script
> to automate it and then sit back and drink coffee.  Manually is
> how you do the first one to find out how it's done.
>
> And then the second one to make sure the process you settled on
> after stack of trial and error is repeatable.  Maybe a third one
> if you screwed up number 2.
>
> After that, you automate the process you've decided on and let
> the rest happen automatically.  It always amazes me to see
> admins repeating themselves manually over and over for a
> frequent task.
>
> I'd love to see the output of your reconstruct command (including
> syslog with the logging level turned up) to see why it's not
> finding the files.  And maybe an 'ls -la' of one of the imap
> directories with this issue as well.  I'm away on a "team building"
> exercise for the next couple of days Oslo time - but I can certainly
> look at it afterwards.  I've been travelling (from Australia) which
> is why I haven't been looking in on this earlier... it's a strange
> set of symptoms.
>
> If you have a small folder that you don't mind sharing, a tar.gz of
> the entire folder contents (including the metadata files) would be
> fantastic, because then I could check the contents of the .index
> and .cache files as well - and maybe even try a reconstruct on a
> testbed here.
>
> But file permissions are the most interesting - I'm wondering if
> reconstruct is unable to read the directory correctly or unable
> to read the old files.

Bron,

	Unfortunately I don't know how to write a script to do this.

	The old system was CentOS 5/x64, just like the new system. I believe it had the same cyrus-imapd & db4 RPMs, as I had patched a few weeks ago, but I cannot confirm.

	I will send you a tarball of this directory directly. I will try "reconstruct -rfx" with debug logging enabled in syslog tonight.

Thanks,

Chris

> [root at inspector ~]# ls -ltr /var/spool/imap/user/julia/
> total 1756
> -rw------- 1 cyrus mail   2931 May 20 12:56 158.
> -rw------- 1 cyrus mail   2052 Jun 21 08:33 159.
> -rw------- 1 cyrus mail   1536 Aug 11 17:15 162.
> -rw------- 1 cyrus mail   2221 Aug 13 08:15 163.
> -rw------- 1 cyrus mail 413395 Aug 14 18:40 164.
> -rw------- 1 cyrus mail  79756 Aug 21 13:57 165.
> -rw------- 1 cyrus mail 296759 Aug 22 15:18 166.
> -rw------- 1 cyrus mail 156064 Sep  4 09:43 167.
> -rw------- 1 cyrus mail  75003 Sep  4 10:06 168.
> -rw------- 1 cyrus mail 164035 Sep  6 09:51 169.
> -rw------- 1 cyrus mail 156853 Sep  7 12:24 170.
> -rw------- 1 cyrus mail 340068 Sep 16 17:44 171.
> drwx------ 2 cyrus mail   4096 Oct  1 21:31 Junk
> drwx------ 2 cyrus mail   4096 Oct  2 23:40 Drafts
> drwx------ 2 cyrus mail   4096 Oct  2 23:40 Sent
> drwx------ 2 cyrus mail   4096 Oct  2 23:40 Apple Mail To Do
> drwx------ 2 cyrus mail   4096 Oct  2 23:40 Deleted Messages
> -rw------- 1 cyrus mail   1148 Oct  2 23:44 1.
> drwx------ 2 cyrus mail   4096 Oct  3 00:09 Trash
> drwx------ 2 cyrus mail   4096 Oct  3 13:16 Sent Messages
> -rw------- 1 cyrus mail    179 Oct  3 13:39 cyrus.header
> -rw------- 1 cyrus mail    176 Oct  4 09:04 cyrus.index
> -rw------- 1 cyrus mail    640 Oct  4 09:04 cyrus.cache


-- 
Chris Pepper:                <http://cbio.mskcc.org/>
                              <http://www.extrapepperoni.com/>