single instance message store problem.

[Ken Murchison]

On 05/29/2015 03:19 PM, John McMonagle wrote:
>
> On Friday 29 May 2015 2:08:58 PM you wrote:
>
> > On 05/29/2015 01:48 PM, John McMonagle wrote:
>
> > >
>
> > > Having trouble getting single instance message store to work.
>
> > >
>
> > > Running debian jessie with cyrus imap 2.4.17+caldav~beta10-18 postfix
>
> > > 2.11.3-1.
>
> > >
>
> > > Am following instructions in:
>
> > >
>
> > > https://cyrusimap.org/docs/cyrus-imapd/2.4.17/install-configure.php
>
> > >
>
> > > master.cf has:
>
> > >
>
> > > lmtp unix - - n - - lmtp
>
> > >
>
> > > main.cf has:
>
> > >
>
> > > mailbox_transport = lmtp:unix:/var/run/cyrus/socket/lmtp
>
> > >
>
> > > local_destination_recipient_limit = 200
>
> > >
>
> > > local_destination_concurrency_limit = 5
>
> > >
>
> > > imap.conf has
>
> > >
>
> > > singleinstancestore: 1
>
> > >
>
> > > lmtpsocket: /var/run/cyrus/socket/lmtp
>
> > >
>
> > > Delivery works but each is an independent file.
>
> > >
>
> > > Any suggestions?
>
> > >
>
> > > John
>
> > >
>
> > >
>
> >
>
> > John,
>
> > At the risk of sounding insulting, have you checked the link count (via
>
> > 'ls -l') on these duplicate copies? For example, here I have part of my
>
> > Inbox:
>
> >
>
> > -rw------- 1 cyrus cyrus 5821 2013-07-09 12:26 17201.
>
> > -rw------- 6 cyrus cyrus 36816 2013-07-09 14:22 17202.
>
> > -rw------- 1 cyrus cyrus 17305 2013-07-09 14:43 17203.
>
> > -rw------- 3 cyrus cyrus 44952 2013-07-09 14:53 17204.
>
> > -rw------- 3 cyrus cyrus 44942 2013-07-09 14:56 17205.
>
> > -rw------- 1 cyrus cyrus 1395 2013-07-09 15:00 17206.
>
> >
>
> > The 2nd, 4th & 5th messages have multiple hard-links (second column),
>
> > which is how singleinstancestore does its thing.
>
> >
>
> > Cheers,
>
> > -nic
>
> >
>
> >
>
> No problem
>
> Yes I checked.
>
> -rw------- 1 cyrus mail 3919 May 29 10:35 145026.
>
> -rw------- 1 cyrus mail 87189663 May 29 12:34 cyrus.squat
>
> drwx------ 2 cyrus mail 204800 May 29 13:15 Sent
>
> -rw------- 1 cyrus mail 2116 May 29 13:15 145027.
>
> The 2 mails should have had links.
>

Are the Message-IDs of both 145026 and 27 the same?  I doubt it given 
the 1k+ diff in size and the almost 3hr diff in delivery time.

Also, are you sure that your MTA isn't breaking up the recipients into 
separate LMTP transactions?  lmtpd can/will only do single instance 
store for recipients that are part of the same transaction (MAIL FROM, 
RCPT TO, DATA sequence).  If the recipients are sent one at a time with 
duplicate DATA commands, there are treated as distinct messages.

Finally, lmtpd can't do single instancestore for mailboxes on different 
filesystems, unless newer fs allow this now.


-- 
Kenneth Murchison
Principal Systems Software Engineer
Carnegie Mellon University

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20150529/6c04f75b/attachment.html