Cyrus doesn't preserve hard-links on replication

[Adrien Remillieux]

By shuffling the keywords on my google searches I was able to find this:
https://lists.andrew.cmu.edu/pipermail/info-cyrus/2006-March/021405.html

Apparently there is a few settings to set to avoid copying the same message
multiple times. This would be a nice addition to the cyrus docs on
replication !

Le dim. 17 nov. 2019 à 18:00, <info-cyrus-request at lists.andrew.cmu.edu> a
écrit :

> Send Info-cyrus mailing list submissions to
>         info-cyrus at lists.andrew.cmu.edu
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> or, via email, send a message with subject or body 'help' to
>         info-cyrus-request at lists.andrew.cmu.edu
>
> You can reach the person managing the list at
>         info-cyrus-owner at lists.andrew.cmu.edu
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of Info-cyrus digest..."
>
>
> Today's Topics:
>
>    1. Cyrus doesn't preserve hard-links on replication
>       (Adrien Remillieux)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Sun, 17 Nov 2019 13:54:11 +0100
> From: Adrien Remillieux <adrien.remillieux at gmail.com>
> To: info-cyrus at lists.andrew.cmu.edu
> Subject: Cyrus doesn't preserve hard-links on replication
> Message-ID:
>         <CAG-vtN=-03QQWkXGrVGjY=
> ak+k8Ez8LiSz+cw83G1SMzU9qFFw at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hello,
>
> I set up replication between two cyrus servers (master runs 2.5.10 and
> slave 3.0.8) with plans to decommission the old server once everything is
> working. I noticed that the mail spool takes 950GB instead of ~300GB on the
> old server. I suspected the hardlinks for message deduplication weren't
> recreated so I ran rdfind on the mail spool and the tool found many
> identical files. Is there a cyrus tool to recreate the hardlinks ? I looked
> at the admin tools but I didn't find anything. Rdfind should work but it
> also matched metadata such as cyrus.annotations for example. So I need to
> go through the 600 mB dry-run log file to exclude unwanted files.
>
> 99% of the log file look like that : Are those safe to hardlink ?
>
> # duptype id depth size device inode priority name
> DUPTYPE_FIRST_OCCURRENCE 1030757 3 842 2065 330967752 3
> /var/spool/cyrus/mail/c/user/user1/15384.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 317750405 3
> /var/spool/cyrus/mail/m/user/user2/19262.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 323550741 3
> /var/spool/cyrus/mail/r/user/user3/96106.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 316733834 3
> /var/spool/cyrus/mail/m/user/user4/41168.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 314623377 3
> /var/spool/cyrus/mail/m/user/user5/25377.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 316201219 3
> /var/spool/cyrus/mail/m/user/user6/49119.
> DUPTYPE_WITHIN_SAME_TREE -1030757 3 842 2065 321991878 3
> /var/spool/cyrus/mail/q/user/user7/46487.
>
> Cheers,
> Adrien
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20191117/60161ca7/attachment-0001.html
> >
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> Info-cyrus mailing list
> Info-cyrus at lists.andrew.cmu.edu
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
>
>
> ------------------------------
>
> End of Info-cyrus Digest, Vol 172, Issue 14
> *******************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20191118/af20c111/attachment.html>