From delepine at u-picardie.fr Thu Oct 1 06:17:41 2020 From: delepine at u-picardie.fr (Jean Charles =?utf-8?B?RGVsw6lwaW5l?=) Date: Thu, 1 Oct 2020 12:17:41 +0200 Subject: Replication : IMAP_PROTOCOL_ERROR Protocol error In-Reply-To: <20200924133616.GC41724@u-picardie.fr> References: <20200923154438.GK6698@u-picardie.fr> <20200924133616.GC41724@u-picardie.fr> Message-ID: <20201001101741.GC432061@u-picardie.fr> Jean Charles Del?pine ?crivait (wrote) : > Jean Charles Del?pine ?crivait (wrote) : > > > Hello, > > > > I'm on the way to migrate one quite big murder config with Cyrus IMAP > > 3.0.8-Debian-3.0.8-6+deb10u4 > > to Cyrus IMAP 3.2.3-Debian-3.2.3-1~bpo10+1. > > > > My plan is to replicate 3.0.8's backends on 3.2.3 ones. This plan has work > > before for 2.5 > > to 3.0. migration. > > > > Il can replicate empty mailboxes. So the conf (attached) seems ok. > > But if the mailbox isn't empty here's the result (completes traces attached) : > > The conf might not be _that_ ok. > > If the option conversation is set to 1 and I create new mailboxes, ond > send mails to this mailboxes, no sync of these mailboxes is possible. > > If I remove the option 'conversation: 1', any new populated mailboxes can > be sync. > > So, the problem seems to be in this option. > > But even after removing "conversation: 1" and zeroed conversation indexes > (ctl_conversationsdb -z), the old "bad" mailboxes can't be synced. Even > removing their .conversations and .counters files doesn't help. > > Can I, and how can I, get rid of those conversation indexes in order to have > my mailboxes being "as if there never been conversation" ? After removing "conversations: 1" option AND restarted the serveur, ctl_conversationsdb -z did correctly remove conversations indexes and the replication finally works fine. I did have to revert xapian usage (which needs conversations) and switch back to squat indexes. Jean Charles Del?pine From ellie at fastmail.com Thu Oct 1 20:16:29 2020 From: ellie at fastmail.com (ellie timoney) Date: Fri, 02 Oct 2020 10:16:29 +1000 Subject: sync_clients bails out - failed to order folders correctly In-Reply-To: <1cb3-5f748200-47-5fd1cf00@104179022> References: <1cb3-5f748200-47-5fd1cf00@104179022> Message-ID: <0c14262f-5df9-4ed8-8e4e-767660da2eee@www.fastmail.com> Hi Konrad, > do_folders: failed to order folders correctly Do you have "improved_mboxlist_sort" enabled in your imapd.conf? My guess is you don't. > every time on a specific mailbox of a specific user. It sounds like this user has two mailboxes where one is an exact substring of another, and the difference starts with a character earlier than your hierarchy separator in ascii order (space and hyphen are the usual culprits). e.g. Something like this can cause a variety of problems: user.ellie.foo user.ellie.foo-etc user.ellie.foo.bar Note the "-" sorts earlier than the hierarchy separator, and so even though "bar" is a child of "foo" and should be processed right after "foo", "foo-etc" sorts earlier than it and gets in the way... I guess if this only started happening in the last days, then one of these folders must have been created recently. If this is the cause, the quick workaround is to find the offending folder pair and ask the user to rename one of them. They could replace the space or hyphen with an underscore ("_") and this will be fine. The proper fix is to turn on "improved_mboxlist_sort", but note that the documentation says this SHOULD NOT be turned on on a live system, and provides instructions for converting the mailboxes.db and subscription databases with the service down. I believe the most up to date documentation for this process is here: https://www.cyrusimap.org/imap/developer/thoughts/improved_mboxlist_sort.html Hope this helps, ellie On Wed, 30 Sep 2020, at 11:03 PM, Konrad Mauz wrote: > Hello list, > > I had a working replication between to cyrus 3.0 servers running. > > The sync_client is started once a day. > > In the last days the sync_client bails out with > > do_folders: failed to order folders correctly > > every time on a specific mailbox of a specific user. > > I can't see that there is a problem with the mailbox ( cyr_expire and > squatter are running correctly ). > > How can I get the sync_client work again? > > thanks in advance and kind regards, > > Konrad > -- > Konrad Mauz - Rechenzentrum HTWG Konstanz > Tel: +497531206472 - Fax: +497531206153 > E-Mail: kmauz at htwg-konstanz.de > Web: http://www.htwg-konstanz.de/rz.html > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > From ellie at fastmail.com Mon Oct 5 02:13:38 2020 From: ellie at fastmail.com (ellie timoney) Date: Mon, 05 Oct 2020 17:13:38 +1100 Subject: Cyrus IMAP 3.2.4 released Message-ID: <267f62e7-a4c6-44bb-9b97-255930fd82e2@www.fastmail.com> The Cyrus team is proud to announce the immediate availability of a new version of Cyrus IMAP: 3.2.4 Download URLs: https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.4/cyrus-imapd-3.2.4.tar.gz https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.4/cyrus-imapd-3.2.4.tar.gz.sig Please consult the release notes and upgrade documentation before upgrading to 3.2.4: https://www.cyrusimap.org/imap/download/release-notes/3.2/x/3.2.4.html https://www.cyrusimap.org/imap/download/upgrade.html And join us on Github at https://github.com/cyrusimap/cyrus-imapd to report issues, join in the deliberations of new features for the next Cyrus IMAP release, and to contribute to the documentation. On behalf of the Cyrus team, Kind regards, ellie timoney From delepine at u-picardie.fr Wed Oct 7 06:52:43 2020 From: delepine at u-picardie.fr (Jean Charles =?utf-8?B?RGVsw6lwaW5l?=) Date: Wed, 7 Oct 2020 12:52:43 +0200 Subject: sync_client: IOERROR: fetching subscriptions Message-ID: <20201006110045.Horde.THIHdLvouujqslb8-GPnWsS@webmail.u-picardie.fr> Hello, While replicating one 3.0.9 server to a 3.2.3 server 2 accounts failed to synchronise with this error : OK success cyrus/sync_client[2745008]: IOERROR: fetching subscriptions for user1 Error from sync_do_user(user1): bailing out! cyrus/sync_client[2745008]: Error in sync_do_user(user1): bailing out! > 1601973199>EXIT <1601973199 cyrus-3.2.3 2020-10-06T10:51:43.558342+02:00 cyrus-3.0.8 cyrus/imap[2714758]: XFER: initial sync of user user1 2020-10-06T10:51:43.558575+02:00 cyrus-3.0.8 cyrus/imap[2714758]: USER user1 2020-10-06T10:51:43.933958+02:00 cyrus-3.0.8 cyrus/imap[2714758]: LOCAL_MAILBOX user.user1 2020-10-06T10:51:44.714252+02:00 cyrus-3.0.8 cyrus/imap[2714758]: LOCAL_MAILBOX user.user1.Drafts [...] 2020-10-06T10:51:44.988079+02:00 cyrus-3.0.8 cyrus/imap[2714758]: LOCAL_MAILBOX user.user1.Trash 2020-10-06T10:51:45.070636+02:00 cyrus-3.0.8 cyrus/imap[2714758]: IOERROR: fetching subscriptions for user1 The user can list his subscriptions and change them : C: A01 AUTHENTICATE PLAIN ZGQtbGFyaWEAZGQtbGFyaWEARzRsYUZvdWkx S: A01 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxten QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SEARCH=FUZZY SORT SORT=MODSEQ SORT=DISPLAY SORT=UID THREAD=ORDEREDSUBJECT THREAD= REFERENCES THREAD=REFS ANNOTATEMORE ANNOTATE-EXPERIMENT-1 METADATA LIST-EXTENDED LIST-STATUS LIST-MYRIGHTS LIST-METADATA WITHIN QRESYNC SCAN XLIST XMOVE MOVE SPECIAL-USE CREATE-SPECIAL-USE DIGEST=SHA1 X-REPLICATION URLAUTH URLAUTH=BINARY MUPDATE=mupdate://cyrus-mupdate/ LOGINDISABLED COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STORAGE X-QUOTA=X-NUM-FOLDERS IDLE] Success (tls protection) SESSIONID= Authenticated. Security strength factor: 256 . LSUB "*" "*" * LSUB (\HasChildren) "." INBOX [...] * LSUB () "." INBOX.archives.2000-2019.2018 * LSUB () "." INBOX.archives.2000-2019.2019 . OK Completed (0.006 secs) . UNSUBSCRIBE INBOX.archives.2000-2019.2019 . OK Completed . LSUB "*" "*" * LSUB (\HasChildren) "." INBOX [...] * LSUB () "." INBOX.archives.2000-2019.2018 I don't understand. Where can be the problem ? Sincerly, Jean Charles Del?pine From delepine at u-picardie.fr Fri Oct 9 04:47:37 2020 From: delepine at u-picardie.fr (Jean Charles =?utf-8?B?RGVsw6lwaW5l?=) Date: Fri, 9 Oct 2020 10:47:37 +0200 Subject: sync_client: IOERROR: fetching subscriptions In-Reply-To: <20201006110045.Horde.THIHdLvouujqslb8-GPnWsS@webmail.u-picardie.fr> References: <20201006110045.Horde.THIHdLvouujqslb8-GPnWsS@webmail.u-picardie.fr> Message-ID: <20201009084737.GD5273@u-picardie.fr> Jean Charles Del?pine ?crivait (wrote) : > 2020-10-06T10:51:45.070636+02:00 cyrus-3.0.8 cyrus/imap[2714758]: IOERROR: fetching subscriptions for user1 user1.sub didn't have correct tab line termination. Certainly my fault sometime in the past. Jean Chales Del?pine From brong at fastmailteam.com Fri Oct 9 07:40:02 2020 From: brong at fastmailteam.com (Bron Gondwana) Date: Fri, 09 Oct 2020 22:40:02 +1100 Subject: Mailshare conversations In-Reply-To: <4029b2bdcb35a835f832a6e7c4112bf3@blue-mind.net> References: <4029b2bdcb35a835f832a6e7c4112bf3@blue-mind.net> Message-ID: Sorry for the delay. Yes, this does seem like the right thing to do. The conversation root being the user is a convenience for a ton of things to the point that we're basically using "fake users" for storing related things for a business. But doing the same thing for mailshare would be quite easy I think. There are only a few places where we convert mailbox name to conversations_db path. Bron. On Tue, Sep 22, 2020, at 01:00, Thomas Fricker wrote: > Hello, > > I noticed that Cyrus does not keep track of conversations in mailshare folders. > There is a code comment addressing this issue in conversations.c: > > /* only users have conversations. Later we may introduce the idea of > * "conversationroot" in the same way we have quotaroot, but for now > * it's hard-coded as the user */ > > Is it still imaginable adding this feature in a future Cyrus version? > Can you elaborate on a reasonable approach of implementing this on the current codebase? > My goal is to have 1 conversation.db per mailshare subtree (not per single folder). > > Any ideas? > > Thanks, > -- > Thomas Fricker > > > BlueMind LogoLinkedin Facebook Twitter > *Thomas Fricker * > DEVELOPPEUR > +33 (0)5 81 91 55 60 > www.bluemind.net / Blog > [*WEBINAR*] > *Migrer sa messagerie vers BlueMind depuis Exchange* > *24/09/20 - 11h* > *INSCRIPTION* > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > *Attachments:* > * x-disclaimer1569892563-0.png > * x-disclaimer1569892563-1.png > * x-disclaimer1569892563-2.png > * x-disclaimer1569892563-3.png > * x-disclaimer1569892563-4.png -- Bron Gondwana, CEO, Fastmail Pty Ltd brong at fastmailteam.com -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: x-disclaimer1569892563-0.png Type: image/png Size: 858 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: x-disclaimer1569892563-1.png Type: image/png Size: 432 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: x-disclaimer1569892563-2.png Type: image/png Size: 400 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: x-disclaimer1569892563-3.png Type: image/png Size: 407 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: x-disclaimer1569892563-4.png Type: image/png Size: 2333 bytes Desc: not available URL: From ezsra.mcdonald at gmail.com Wed Oct 14 15:30:31 2020 From: ezsra.mcdonald at gmail.com (Ezsra McDonald) Date: Wed, 14 Oct 2020 14:30:31 -0500 Subject: LMTP said: 550-Mailbox unknown or you do not have authorization to see it Message-ID: I am building a new mail server to replace an older EL6 server. The new server is Centos 8. I keep getting this response when trying to deliver email to a local account stored in LDAP. host mail.example.org[/var/lib/imap/socket/lmtp] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) I have tried replacing the new configs with my old working configs from the EL6 server but they get the same result. a postmap -q against the LDAP table config returns the appropriate information. I am wondering if the key is the 'or you do not have authorization to see it` part of the message. What exactly does LMTP need to authorize the delivery? Enabling verbose logging on LMTP and LDAP did not give any clues. Any assistance is appreciated. I have been googling and hitting my head on the desk for days. Thanks, -Ez -------------- next part -------------- An HTML attachment was scrubbed... URL: From Albert.Shih at obspm.fr Wed Oct 14 17:15:53 2020 From: Albert.Shih at obspm.fr (Albert Shih) Date: Wed, 14 Oct 2020 23:15:53 +0200 Subject: LMTP said: 550-Mailbox unknown or you do not have authorization to see it In-Reply-To: References: Message-ID: <20201014211553.GB1106@io.chezmoi.fr> Le 14/10/2020 ? 14:30:31-0500, Ezsra McDonald a ?crit > I am building a new mail server to replace an older EL6 server. The new server > is Centos 8. I keep getting this response when trying to deliver email to a > local account stored in LDAP. > > host mail.example.org[/var/lib/imap/socket/lmtp] said: > 550-Mailbox unknown.? Either there is no mailbox associated with this > 550-name or you do not have authorization to see it. > 550 5.1.1 User unknown (in reply to RCPT TO command)) > > I have tried replacing the new configs with my old working configs from the EL6 > server but they get the same result. > > a postmap -q against the LDAP table config returns the appropriate information. > I am wondering if the key is the 'or you do not have authorization to see it` > part of the message. What exactly does LMTP need to authorize the delivery? > > Enabling verbose logging on LMTP and LDAP did not give any clues. If you run getent passwd what you got ? Personnaly I don't run the lmtp against ldap, to risky IMHO, if you got any problem with the connection betwen your postfix/cyrus server and the ldap server your are going to loose email. So for me I'm using a script who dump the ldap inside the /etc/passwd, so the all account are local. Regards -- Albert SHIH Observatoire de Paris xmpp: jas at obspm.fr Heure local/Local time: Wed Oct 14 11:13:14 PM CEST 2020 From ezsra.mcdonald at gmail.com Thu Oct 15 09:49:20 2020 From: ezsra.mcdonald at gmail.com (Ezsra McDonald) Date: Thu, 15 Oct 2020 08:49:20 -0500 Subject: LMTP said: 550-Mailbox unknown or you do not have authorization to see it In-Reply-To: <20201014211553.GB1106@io.chezmoi.fr> References: <20201014211553.GB1106@io.chezmoi.fr> Message-ID: Albert, Thank you for your response. LDAP is only used for the Postfix/Imap servers. We do not configure Pam to use LDAP. We are using saslauthd. I wonder if there is a way to test LMTP manually to verify LMTP can see the imap accounts? I have not done much with LMTP because it always worked for us in the past. ldapsearch, testsaslauthd and imtest all tested successfully. I deleted and recreated my test user's imap account cm user.testuser sam user.testuser testuser write sq user.testuser 1000000 -Ez On Wed, Oct 14, 2020 at 4:15 PM Albert Shih wrote: > Le 14/10/2020 ? 14:30:31-0500, Ezsra McDonald a ?crit > > I am building a new mail server to replace an older EL6 server. The new > server > > is Centos 8. I keep getting this response when trying to deliver email > to a > > local account stored in LDAP. > > > > host mail.example.org[/var/lib/imap/socket/lmtp] said: > > 550-Mailbox unknown. Either there is no mailbox associated with this > > 550-name or you do not have authorization to see it. > > 550 5.1.1 User unknown (in reply to RCPT TO command)) > > > > I have tried replacing the new configs with my old working configs from > the EL6 > > server but they get the same result. > > > > a postmap -q against the LDAP table config returns the appropriate > information. > > I am wondering if the key is the 'or you do not have authorization to > see it` > > part of the message. What exactly does LMTP need to authorize the > delivery? > > > > Enabling verbose logging on LMTP and LDAP did not give any clues. > > If you run > > getent passwd > > what you got ? > > Personnaly I don't run the lmtp against ldap, to risky IMHO, if you got any > problem with the connection betwen your postfix/cyrus server and the ldap > server your are going to loose email. > > So for me I'm using a script who dump the ldap inside the /etc/passwd, so > the all account are local. > > Regards > > -- > Albert SHIH > Observatoire de Paris > xmpp: jas at obspm.fr > Heure local/Local time: > Wed Oct 14 11:13:14 PM CEST 2020 > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Hagedorn at uni-koeln.de Thu Oct 15 10:28:33 2020 From: Hagedorn at uni-koeln.de (Sebastian Hagedorn) Date: Thu, 15 Oct 2020 16:28:33 +0200 Subject: LMTP said: 550-Mailbox unknown or you do not have authorization to see it In-Reply-To: References: <20201014211553.GB1106@io.chezmoi.fr> Message-ID: <370fd29c-99aa-02a1-44d7-90a2339c4975@uni-koeln.de> Am 15.10.20 um 15:49 schrieb Ezsra McDonald: > I wonder if there is a way to test LMTP manually to verify LMTP can see > the imap accounts? I have not done much with LMTP because it always > worked for us in the past. My favorite tool for mail delivery testing is swaks. You can test LMTP this way: swaks --to YOUR-TEST-USER --socket /var/lib/imap/socket/lmtp --protocol LMTP -- .:.Sebastian Hagedorn - Weyertal 121 (Geb?ude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universit?t zu K?ln / Cologne University - ? +49-221-470-89578.:. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5365 bytes Desc: S/MIME Cryptographic Signature URL: From ezsra.mcdonald at gmail.com Thu Oct 15 10:32:46 2020 From: ezsra.mcdonald at gmail.com (Ezsra McDonald) Date: Thu, 15 Oct 2020 09:32:46 -0500 Subject: LMTP said: 550-Mailbox unknown or you do not have authorization to see it In-Reply-To: <370fd29c-99aa-02a1-44d7-90a2339c4975@uni-koeln.de> References: <20201014211553.GB1106@io.chezmoi.fr> <370fd29c-99aa-02a1-44d7-90a2339c4975@uni-koeln.de> Message-ID: Sebastian, Thank you for the response. I have never heard of this tool but it looks interesting. I will give it a try. Will let you all know if I find anything. -Ez On Thu, Oct 15, 2020 at 9:28 AM Sebastian Hagedorn wrote: > > Am 15.10.20 um 15:49 schrieb Ezsra McDonald: > > I wonder if there is a way to test LMTP manually to verify LMTP can see > > the imap accounts? I have not done much with LMTP because it always > > worked for us in the past. > > My favorite tool for mail delivery testing is swaks. You can test LMTP > this way: > > swaks --to YOUR-TEST-USER --socket /var/lib/imap/socket/lmtp --protocol > LMTP > > -- > .:.Sebastian Hagedorn - Weyertal 121 (Geb?ude 133), Zimmer 2.02.:. > .:.Regionales Rechenzentrum (RRZK).:. > .:.Universit?t zu K?ln / Cologne University - ? +49-221-470-89578.:. > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dave64 at andrew.cmu.edu Thu Oct 15 12:42:26 2020 From: dave64 at andrew.cmu.edu (Dave McMurtrie) Date: Thu, 15 Oct 2020 12:42:26 -0400 (EDT) Subject: Moving Cyrus mailing lists to Topicbox Message-ID: <6ec7e4f-78be-dbc8-5463-b4b589be9dc3@andrew.cmu.edu> Hi, I'm working with Fastmail to transition the Cyrus mailing lists from lists.andrew.cmu.edu over to cyrus.topicbox.com. Our plan is to transition the active mailing lists as follows: cyrus-announce at lists.andrew.cmu.edu -> announce at cyrus.topicbox.com cyrus-devel at lists.andrew.cmu.edu -> devel at cyrus.topicbox.com info-cyrus at lists.andrew.cmu.edu -> info at cyrus.topicbox.com cyrus-sasl at lists.andrew.cmu.edu -> sasl at cyrus.topicbox.com We have already copied over subscriber information and list archives to Topicbox for these lists. You should begin using Topicbox immediately. If you have questions about using Topicbox, please see: http://www.topicbox.com/helpspot I will unsubscribe everyone from the lists.andrew.cmu.edu mailing lists later today. I will be deleting the following mailing lists which are no longer in use: cyrus-bugzilla at lists.andrew.cmu.edu cyrus-cvs at lists.andrew.cmu.edu cyrus-project at lists.andrew.cmu.edu Thanks! Dave