files on disk but not in index?

[Ken Murchison]

You may have a bunch of messages that were marked as \Deleted (and not 
displayed by your client) but haven't been expunged.

How many of the messages shown by mbexamine have the \Deleted flag set?



On 5/6/20 8:32 AM, Brian J. Murrell wrote:
> On Wed, 2020-05-06 at 07:18 -0400, Ken Murchison wrote:
>> You can use 'mbexamine' and 'unexpunge -l'
> mbexamine looks interesting, but unexpunge -l returns nothing for my
> INBOX.  I think this is because expunge is immediate in 2.4.17 isn't
> it?
>
> mbexamine's output is pretty terse though.  Given this line from it's
> output:
>
> 000001> UID:00089183   INT_DATE:994114862 SENTDATE:994089600
> SIZE:1537
>
> is that "00089183" the name of a message file on the disk, minus the
> trailing dot?  It seems to be from a brief examination.
>
> But just as a first pass sanity check:
>
> # /usr/lib/cyrus-imapd/mbexamine user.brian | grep \>\ UID: | wc -l
> 317075
> # ls /var/spool/imap/b/user/brian/ | wc -l
> 10362
>
> Which is the opposite of what I was expecting and neither matches what
> my IMAP clients (2 different evolution instances) says about the number
> of messages, which is ~4K.  mutt also says there are only ~4K messages:
>
> [Msgs:3999 New:40 Old:2769 Del:34 Flag:54 Post:43 108M]
>
> How can 3 IMAP clients only see ~4K messages yet there be 10K on the
> disk?
>
>> I you think you have orphaned (not expunged) message files, you can
>> try
>> 'reconstruct -G' on the mailbox to restore them into the index.
> And so then "reconstruct -n -G" should report any orphan files?
>
> All I get for it is:
>
> user.brian uid 696911 mismatch: sentdate
> user.brian uid 696911 mismatch: gmtime
> user.brian uid 697146 mismatch: sentdate
> user.brian uid 697146 mismatch: gmtime
> user.brian uid 697917 mismatch: sentdate
> user.brian uid 697917 mismatch: gmtime
> user.brian
>
> So I created an orpan intentionally to see what reconstruct -G does:
>
> # pushd /var/spool/imap/b/user/brian/
> # ls -l 1.
> ls: cannot access 1.: No such file or directory
> # cp -a 1609386. 1.
> # ls -l 1.
> -rw-------. 1 cyrus mail 1187 Apr 14 20:57 1.
> # /usr/lib/cyrus-imapd/reconstruct -n -G user.brian
> ...
> user.brian uid 1 rediscovered - appending
> user.brian
>
> So that reconstruct -G seems to be doing what I am looking for, but
> it's also telling me there are no orphans.
>
> So while I have no orphans, I do have significant discrepancies between
> the number of files on disk and the number of messages imapd is
> reporting that are in a mailbox.
>
> Any idea how to reconcile that?
>
> Cheers,
> b.
>
>
> ----
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

-- 
Kenneth Murchison
Senior Software Developer
Fastmail US LLC

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20200506/48ce219f/attachment-0001.html>