From marty at maui-systems.co.uk Thu Nov 1 17:25:43 2018 From: marty at maui-systems.co.uk (Marty Lee) Date: Thu, 1 Nov 2018 21:25:43 +0000 Subject: Cyrus IMAP 'CAPABILITIES' and 'AUTH=PLAIN' Message-ID: <5F50E3F2-8F17-4B1F-9D77-88511E6D6A7C@maui-systems.co.uk> Forgive me asking this question, we?ve just had a server disk that?s starting to die in a remote location, and I?m frantically trying to clone some IMAP users onto another server - along with a number of other things. Despite imapd.conf having 'allowplaintext: yes? (it?s an internal server) when logging in, ?AUTH=LOGIN? isn?t advertised, yet it works if I manually try to login. ?imapsync? is complaining as it can?t see the LOGIN capability. I?m about to start looking at the code, but if anyone can let me know if a setting needs changed, that would be great - clearly, I?ve got a number of things to try to get off this server ASAP, so any advice would be greatly appreciated. Server version is 3.0.4: [root at imapserver /opt/local/etc/cyrus]# nc localhost 143 * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE] imapserver Cyrus IMAP 3.0.4 server ready 0 CAPABILITY * CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxten QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SEARCH=FUZZY SORT SORT=MODSEQ SORT=DISPLAY SORT=UID THREAD=ORDEREDSUBJECT THREAD=REFERENCES THREAD=REFS ANNOTATEMORE ANNOTATE-EXPERIMENT-1 METADATA LIST-EXTENDED LIST-STATUS LIST-MYRIGHTS LIST-METADATA WITHIN QRESYNC SCAN XLIST XMOVE MOVE SPECIAL-USE CREATE-SPECIAL-USE DIGEST=SHA1 X-REPLICATION URLAUTH URLAUTH=BINARY COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STORAGE X-QUOTA=X-NUM-FOLDERS IDLE Many regards Marty From dwhite at olp.net Thu Nov 1 17:33:04 2018 From: dwhite at olp.net (Dan White) Date: Thu, 1 Nov 2018 16:33:04 -0500 Subject: Cyrus IMAP 'CAPABILITIES' and 'AUTH=PLAIN' In-Reply-To: <5F50E3F2-8F17-4B1F-9D77-88511E6D6A7C@maui-systems.co.uk> References: <5F50E3F2-8F17-4B1F-9D77-88511E6D6A7C@maui-systems.co.uk> Message-ID: <20181101213304.GF29035@dan.olp.net> On 11/01/18?21:25?+0000, Marty Lee wrote: >Forgive me asking this question, we?ve just had a server disk that?s starting >to die in a remote location, and I?m frantically trying to clone some IMAP >users onto another server - along with a number of other things. > >Despite imapd.conf having 'allowplaintext: yes? (it?s an internal server) >when logging in, ?AUTH=LOGIN? isn?t advertised, yet it works if I manually >try to login. ?imapsync? is complaining as it can?t see the LOGIN capability. > >I?m about to start looking at the code, but if anyone can let me know if a >setting needs changed, that would be great - clearly, I?ve got a number of >things to try to get off this server ASAP, so any advice would be greatly >appreciated. > >Server version is 3.0.4: > >[root at imapserver /opt/local/etc/cyrus]# nc localhost 143 >* OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE] imapserver Cyrus IMAP 3.0.4 server ready >0 CAPABILITY >* CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL RIGHTS=kxten QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY CATENATE CONDSTORE ESEARCH SEARCH=FUZZY SORT SORT=MODSEQ SORT=DISPLAY SORT=UID THREAD=ORDEREDSUBJECT THREAD=REFERENCES THREAD=REFS ANNOTATEMORE ANNOTATE-EXPERIMENT-1 METADATA LIST-EXTENDED LIST-STATUS LIST-MYRIGHTS LIST-METADATA WITHIN QRESYNC SCAN XLIST XMOVE MOVE SPECIAL-USE CREATE-SPECIAL-USE DIGEST=SHA1 X-REPLICATION URLAUTH URLAUTH=BINARY COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STORAGE X-QUOTA=X-NUM-FOLDERS IDLE I would guess you are missing libsasl2 modules for authentication, which your OS probably has packaged in a separate package. You can use pluginviewer/saslpluginviewer to view existing plugins. From marty at maui-systems.co.uk Thu Nov 1 18:01:02 2018 From: marty at maui-systems.co.uk (Marty Lee) Date: Thu, 1 Nov 2018 22:01:02 +0000 Subject: Cyrus IMAP 'CAPABILITIES' and 'AUTH=PLAIN' In-Reply-To: <20181101213304.GF29035@dan.olp.net> References: <5F50E3F2-8F17-4B1F-9D77-88511E6D6A7C@maui-systems.co.uk> <20181101213304.GF29035@dan.olp.net> Message-ID: <1263DC99-D99D-4707-BD90-C4A1518CED4D@maui-systems.co.uk> > > I would guess you are missing libsasl2 modules for authentication, which > your OS probably has packaged in a separate package. You can use > pluginviewer/saslpluginviewer to view existing plugins. Awesome - was looking in entirely the wrong location (assumed it was a Cyrus thing) and never even contemplated it might be a SASL thing; especially as users could authenticate against it, even without the CAPABILITY being shown. Accounts now syncing, so hopefully we can get this system out of service by tomorrow? Thanks again? marty From rcovell at rolet.com Tue Nov 6 15:06:33 2018 From: rcovell at rolet.com (Robert Covell) Date: Tue, 6 Nov 2018 14:06:33 -0600 Subject: Missing Email & Folders Message-ID: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> Hello All, Have a few weird situations that I have been unable to find solutions to. Server: CentOS release 6.x cyrus-imapd-2.4.17-6.el5.src.rpm (Simon Matter) Client: Outlook 2013 Our client is using Cyrus to store related emails for their clients. The server does not actually receive mail, it is placed (copied) there. Approximately eight clients connect to "one" Cyrus account. When an email comes in for client X the user will find the appropriate imap folder and copy it to it. If the folder does exist it is created. Issue One: Randomly the server side imap folder is empty. Client imap folder has what was supposed to be on the server but it is not. The copy of the email appears to have been successful. Issue Two: Randomly computers will not see newly created imap folders from other users. Regardless of how we attempt to get the folder in the imap list we have to recreate the account. My assumption is that this is most likely due to imap support in Outlook and not Cyrus. Wanting to know if anyone has seen anything like this and if a solution was found. Thanks in advance. -Bob PS Have been on this mailing list for almost 20 years (since v1.6 I believe). Can say it is one of the best mailing lists I have been on. Never ceases to amaze me the quality of feedback and support provided. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwhite at olp.net Tue Nov 6 15:51:44 2018 From: dwhite at olp.net (Dan White) Date: Tue, 6 Nov 2018 14:51:44 -0600 Subject: Missing Email & Folders In-Reply-To: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> References: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> Message-ID: <20181106205144.GB8433@dan.olp.net> On 11/06/18?14:06?-0600, Robert Covell wrote: >Hello All, > >Have a few weird situations that I have been unable to find solutions to. > >Server: >CentOS release 6.x >cyrus-imapd-2.4.17-6.el5.src.rpm (Simon Matter) > >Client: >Outlook 2013 > >Our client is using Cyrus to store related emails for their clients. The >server does not actually receive mail, it is placed (copied) there. >Approximately eight clients connect to "one" Cyrus account. When an email >comes in for client X the user will find the appropriate imap folder and >copy it to it. If the folder does exist it is created. > >Issue One: > >Randomly the server side imap folder is empty. Client imap folder has what >was supposed to be on the server but it is not. The copy of the email >appears to have been successful. Mouse slip? If you suspect this is due to a client related problem, you could enable telemetry logging to find out who/what is causeing the emails to go missing. https://www.cyrusimap.org/imap/reference/faqs/o-telemetry.html If the purpose is to (mostly) copy emails into the folder and rarely delete, you could restrict delete access to a specific account via ACL. https://www.cyrusimap.org/imap/reference/admin/access-control/rights-reference.html >Issue Two: > >Randomly computers will not see newly created imap folders from other users. >Regardless of how we attempt to get the folder in the imap list we have to >recreate the account. > >My assumption is that this is most likely due to imap support in Outlook and >not Cyrus. Wanting to know if anyone has seen anything like this and if a >solution was found. From rcovell at rolet.com Tue Nov 6 18:14:21 2018 From: rcovell at rolet.com (Robert Covell) Date: Tue, 6 Nov 2018 17:14:21 -0600 Subject: Missing Email & Folders In-Reply-To: <20181106205144.GB8433@dan.olp.net> References: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> <20181106205144.GB8433@dan.olp.net> Message-ID: <0f1001d47626$73768910$5a639b30$@rolet.com> > If you suspect this is due to a client related problem, you could > enable telemetry logging to find out who/what is causeing the emails to go missing. > > https://www.cyrusimap.org/imap/reference/faqs/o-telemetry.html Good idea will turn this on. > > If the purpose is to (mostly) copy emails into the folder and rarely > delete, you could restrict delete access to a specific account via ACL. > > https://www.cyrusimap.org/imap/reference/admin/access-control/rights- > reference.html Believe it is setup like this, been awhile since I did it. Will confirm. Also forgot to say the one account is ~90GB if that makes any difference... -Bob (sent twice) From michael.menge at zdv.uni-tuebingen.de Wed Nov 7 03:16:12 2018 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Wed, 07 Nov 2018 09:16:12 +0100 Subject: Missing Email & Folders In-Reply-To: <0f1001d47626$73768910$5a639b30$@rolet.com> References: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> <20181106205144.GB8433@dan.olp.net> <0f1001d47626$73768910$5a639b30$@rolet.com> Message-ID: <20181107091612.Horde.tYa6sMTRD21LC9ZdCUzeFUV@webmail.uni-tuebingen.de> Hi, Quoting Robert Covell : >> If you suspect this is due to a client related problem, you could >> enable telemetry logging to find out who/what is causeing the emails to go > missing. >> >> https://www.cyrusimap.org/imap/reference/faqs/o-telemetry.html > > Good idea will turn this on. > >> >> If the purpose is to (mostly) copy emails into the folder and rarely >> delete, you could restrict delete access to a specific account via ACL. >> >> https://www.cyrusimap.org/imap/reference/admin/access-control/rights- >> reference.html > > Believe it is setup like this, been awhile since I did it. Will confirm. > > Also forgot to say the one account is ~90GB if that makes any difference... > > -Bob > > (sent twice) > We have seen the same kind of problems with Outlook with much smaller mailboxes. I didn't have the time to debug it. So fare I suspected that some Data in the Outlook profile got somehow corrupted. Regards, Michael Menge -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universit?t T?bingen Fax.: (49) 7071/29-5912 Zentrum f?r Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de W?chterstra?e 76 72074 T?bingen From byrnejb at harte-lyne.ca Wed Nov 7 08:52:20 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Wed, 7 Nov 2018 08:52:20 -0500 Subject: Quotas Message-ID: Cyrus-IMAPD-3.0.7 on FreeBSD-11.2p4 We have users who, having deleted email, evidently do not recover the quota allocated to those messages. We do not believe that we have enabled delayed deletion. All the user mailboxes previous had been upgraded using: sudo -u cyrus /usr/local/cyrus/sbin/reconstruct -f -r -G -V max user We have also run reconstruct. None-the-less some users show that they have exceeded their quota even when most of their email has been deleted. Why? -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From Albert.Shih at obspm.fr Wed Nov 7 10:42:29 2018 From: Albert.Shih at obspm.fr (Albert Shih) Date: Wed, 7 Nov 2018 16:42:29 +0100 Subject: Quotas In-Reply-To: References: Message-ID: <20181107154229.GG1792@io.chezmoi.fr> Le 07/11/2018 ? 08:52:20-0500, James B. Byrne via Info-cyrus a ?crit > Cyrus-IMAPD-3.0.7 on FreeBSD-11.2p4 > > We have users who, having deleted email, evidently do not recover the > quota allocated to those messages. We do not believe that we have Well...I don't think so. With my configuration (same as you cyrus + FreeBSD 11) when someone delete a mail the quota is recover. > enabled delayed deletion. All the user mailboxes previous had been with delayed deletion. For example : [root /usr/local/cyrus/sbin]# ./quota user.zog Quota % Used Used Resource Root 20971520 13 2889569 STORAGE user.zog 137037 MESSAGE user.zog 0 X-ANNOTATION-STORAGE user.zog 299 X-NUM-FOLDERS user.zog [root /usr/local/cyrus/sbin]# cd /bals/user/zog [root /bals/user/zog]# du -s -h . 3.9G . [root /bals/user/zog]# find . -type f|wc 179261 179264 2760840 [root /bals/user/zog]# So you can see the quota show with cyrus command say I use 2889569 (~2.7 Go) and 137037 messages, but on the filesystem (ZFS) I use 3.9Go and 179000 files (event It's not precise because I didn't exclude cyrus*) Regards -- Albert SHIH DIO b?timent 15 Observatoire de Paris xmpp: jas at obspm.fr Heure local/Local time: Wed Nov 7 16:25:13 CET 2018 From merlin at mrc-mbu.cam.ac.uk Wed Nov 7 10:44:01 2018 From: merlin at mrc-mbu.cam.ac.uk (Merlin Hartley) Date: Wed, 7 Nov 2018 15:44:01 +0000 Subject: Quotas In-Reply-To: References: Message-ID: <184B9067-5D7E-47F1-887E-1B9DDBB2D2C8@mrc-mbu.cam.ac.uk> When you say ?delete? do you mean a client software that may actually be moving the messages to a Trash folder? This could have the effect you mention ? M -- Merlin Hartley Computer Officer MRC Mitochondrial Biology Unit University of Cambridge Cambridge, CB2 0XY United Kingdom > On 7 Nov 2018, at 13:52, James B. Byrne via Info-cyrus wrote: > > Cyrus-IMAPD-3.0.7 on FreeBSD-11.2p4 > > We have users who, having deleted email, evidently do not recover the > quota allocated to those messages. We do not believe that we have > enabled delayed deletion. All the user mailboxes previous had been > upgraded using: > > sudo -u cyrus /usr/local/cyrus/sbin/reconstruct -f -r -G -V max user > > We have also run reconstruct. None-the-less some users show that they > have exceeded their quota even when most of their email has been > deleted. Why? > > > > > -- > *** e-Mail is NOT a SECURE channel *** > Do NOT transmit sensitive data via e-Mail > Do NOT open attachments nor follow links sent by e-Mail > > James B. Byrne mailto:ByrneJB at Harte-Lyne.ca > Harte & Lyne Limited http://www.harte-lyne.ca > 9 Brockley Drive vox: +1 905 561 1241 > Hamilton, Ontario fax: +1 905 561 0757 > Canada L8E 3C3 > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From a_s_y at sama.ru Sat Nov 10 03:54:15 2018 From: a_s_y at sama.ru (Sergey) Date: Sat, 10 Nov 2018 12:54:15 +0400 Subject: imapd and count of deleted messages Message-ID: <201811101254.15198.a_s_y@sama.ru> Hello Can I see number of deleted messages per IMAP sessions? This is useful when communicating with the user sometimes. For imap I can see only this: cyrus/imap[862231]: login: .... User logged in SESSIONID= cyrus/imap[862231]: USAGE .... user: 0.228965 sys: 0.244962 And much more for pop: cyrus/pop3[19165]: .... User logged in SESSIONID= cyrus/pop3[19165]: Expunged 160 messages from .... cyrus/pop3[19165]: USAGE .... user: 0.564000 sys: 0.516000 cyrus/pop3[19165]: counts: retr=<160> top=<0> dele=<160> -- Regards, Sergey From lists at localguru.de Sat Nov 10 16:22:55 2018 From: lists at localguru.de (Marcus Schopen) Date: Sat, 10 Nov 2018 22:22:55 +0100 Subject: Missing Email & Folders In-Reply-To: <20181107091612.Horde.tYa6sMTRD21LC9ZdCUzeFUV@webmail.uni-tuebingen.de> References: <0de401d4760c$370ed0f0$a52c72d0$@rolet.com> <20181106205144.GB8433@dan.olp.net> <0f1001d47626$73768910$5a639b30$@rolet.com> <20181107091612.Horde.tYa6sMTRD21LC9ZdCUzeFUV@webmail.uni-tuebingen.de> Message-ID: Am Mittwoch, den 07.11.2018, 09:16 +0100 schrieb Michael Menge: > Hi, > > Quoting Robert Covell : > > > > If you suspect this is due to a client related problem, you could > > > enable telemetry logging to find out who/what is causeing the > > > emails to go > > > > missing. > > > > > > https://www.cyrusimap.org/imap/reference/faqs/o-telemetry.html > > > > Good idea will turn this on. > > > > > > > > If the purpose is to (mostly) copy emails into the folder and > > > rarely > > > delete, you could restrict delete access to a specific account > > > via ACL. > > > > > > https://www.cyrusimap.org/imap/reference/admin/access-control/rights > > > - > > > reference.html > > > > Believe it is setup like this, been awhile since I did it. Will > > confirm. > > > > Also forgot to say the one account is ~90GB if that makes any > > difference... > > > > -Bob > > > > (sent twice) > > > > We have seen the same kind of problems with Outlook with much > smaller > mailboxes. > I didn't have the time to debug it. So fare I suspected that some > Data > in the Outlook > profile got somehow corrupted. Isn't this the known bug that Outlook 2013 doesn't really work well if it is only used via IMAP and not with Exchange? There have been similar cases with IMAP accounts that have been completely compromised. On the IMAP there were whole folders missing, but they still existed locally. From Albert.Shih at obspm.fr Mon Nov 12 04:19:11 2018 From: Albert.Shih at obspm.fr (Albert Shih) Date: Mon, 12 Nov 2018 10:19:11 +0100 Subject: What's sync. folder ? Message-ID: <20181112091911.GA1981@chezmoi.fr> Hi, I would like to know what's the folder inside {partition-default}/sync. I've got some folder and have no idea what's. I understand it's related to synchro between server, but my concerne is I've got some very old folder with lot of email inside. Regards -- Albert SHIH DIO b?timent 15 Observatoire de Paris xmpp: jas at obspm.fr Heure local/Local time: Mon Nov 12 10:16:00 CET 2018 From michael.menge at zdv.uni-tuebingen.de Mon Nov 12 05:56:25 2018 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Mon, 12 Nov 2018 11:56:25 +0100 Subject: imapd and count of deleted messages In-Reply-To: <201811101254.15198.a_s_y@sama.ru> Message-ID: <20181112115625.Horde.6f1i9yCqaiLWsRcojYjq3me@webmail.uni-tuebingen.de> Hi, Quoting Sergey : > Hello > > Can I see number of deleted messages per IMAP sessions? > This is useful when communicating with the user sometimes. > > For imap I can see only this: > > cyrus/imap[862231]: login: .... User logged in > SESSIONID= > cyrus/imap[862231]: USAGE .... user: 0.228965 sys: 0.244962 > > And much more for pop: > > cyrus/pop3[19165]: .... User logged in > SESSIONID= > cyrus/pop3[19165]: Expunged 160 messages from .... > cyrus/pop3[19165]: USAGE .... user: 0.564000 sys: 0.516000 > cyrus/pop3[19165]: counts: retr=<160> top=<0> dele=<160> > Are you sure messages have been "Deleted" via IMAP EXPUNGE command? To clarify this: Deleting mails is a 2 or 3 stage process depending on your configuration. 1. the mails are marked as deleted. ===== Example from RFC 3501 ===== C: A003 STORE 2:4 +FLAGS (\Deleted) S: * 2 FETCH (FLAGS (\Deleted \Seen)) S: * 3 FETCH (FLAGS (\Deleted)) S: * 4 FETCH (FLAGS (\Deleted \Flagged \Seen)) S: A003 OK STORE completed =================================== This is normally not logged by cyrus but you can see the number of Messages with the Deleted Flag with mbexamine user/userID | grep "^ Deleted:" The Client can still see these messages. Some Clients use this to allow the user to "undelete" Mails other kopie/move the mails to a trash folder and use the second step to remove the mails form the original folder. You can try enable the "auditlog" option in your imapd.conf if you really need to know this. 2. the mails marked as deleted are removed form the mailbox with the expunge command. ==== Quoting RFC 3501 ========= Example: C: A202 EXPUNGE S: * 3 EXPUNGE S: * 3 EXPUNGE S: * 5 EXPUNGE S: * 8 EXPUNGE S: A202 OK EXPUNGE completed Note: In this example, messages 3, 4, 7, and 11 had the \Deleted flag set. See the description of the EXPUNGE response for further explanation. =============================== This is logged by cyrus in the same way you have seen for pop3 But can happen multiple times in the same imap session. 3. depending of your "expunge_mode" setting in imapd.conf the mails deleted in step 2 are still on your disk and are deleted by cyr_expire at a later time. you can see and restore the mails that have been EXPUNGE by the client, but not deleted by cyr_expire with the "unexpung" command see man page for more details Deleting mails form disk by cyr_expire was logged for each mailbox in cyrus 2.3 and 2.4 in cyrus 3.0 it is logged only once per cyr_expire run. restoring mails with unexpung is also logged by cyrus. unexpunge[363]: restored 1 expunged messages in mailbox 'user/userID' Regarding POP3 the messages Deleted in the Session are marked as deleted and are expunged automatically with the quit command by the client at the end of the session. -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universit?t T?bingen Fax.: (49) 7071/29-5912 Zentrum f?r Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de W?chterstra?e 76 72074 T?bingen From michael.menge at zdv.uni-tuebingen.de Tue Nov 13 08:22:45 2018 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Tue, 13 Nov 2018 14:22:45 +0100 Subject: bug renameing/deliting special use folders in murder setup. Message-ID: <20181113142245.Horde.QnHdD6ZHeLubJq2HCtTxi4P@webmail.uni-tuebingen.de> Hi, we discovered a bug in cyrus imapd 3.0.8 in murder/aggregator configuration. We have the following default stucture: a LIST "" "*" * LIST (\HasNoChildren) "/" INBOX * LIST (\HasChildren) "/" Mail * LIST (\HasNoChildren \Drafts) "/" Mail/drafts * LIST (\HasNoChildren) "/" Mail/s-spam * LIST (\HasNoChildren \Sent) "/" Mail/sent * LIST (\HasNoChildren \Trash) "/" Mail/trash * LIST (\HasNoChildren \Junk) "/" Mail/v-spam a OK Completed (0.000 secs 7 calls) ctl_mboxlist -d | grep ^user.zrstes1 user.zrstes1 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.drafts 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.s-spam 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.sent 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.trash 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.v-spam 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan Renaming/Deleting a Mailbox with Special-Use Flag fails b RENAME Mail/v-spam Mail/spam b NO SPECIAL-USE flag conflict c DELETE Mail/v-spam c NO SPECIAL-USE flag conflict but Renaming/Deleting the Folder above will succeed d RENAME Mail Test * OK rename Mail Test * OK rename Mail/drafts Test/drafts * OK rename Mail/s-spam Test/s-spam * OK rename Mail/sent Test/sent * OK rename Mail/trash Test/trash * OK rename Mail/v-spam Test/v-spam d OK Completed but results in broken entries in the mailboxdb on mupdate master and frontends ctl_mboxlist -C /etc/imapd_fe.conf -d | grep ^user.zrstes1 user.zrstes1 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Mail.drafts 1 ma05.mail.localhost! user.zrstes1.Mail.sent 1 ma05.mail.localhost! user.zrstes1.Mail.trash 1 ma05.mail.localhost! user.zrstes1.Mail.v-spam 1 ma05.mail.localhost! user.zrstes1.Test 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Test.drafts 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Test.s-spam 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Test.sent 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Test.trash 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan user.zrstes1.Test.v-spam 1 ma05.mail.localhost!ssd zrstes1 lrswipkxtecdan see the missing partition for old names of the special use folders. it seams that the sepecial use annotation was moved with the folders without a problem e LIST (SPECIAL-USE) "" "*" * LIST (\HasNoChildren \Drafts) "/" Test/drafts * LIST (\HasNoChildren \Sent) "/" Test/sent * LIST (\HasNoChildren \Trash) "/" Test/trash * LIST (\HasNoChildren \Junk) "/" Test/v-spam e OK Completed (0.000 secs 7 calls) On the backend the mailboxdb entries look fine. But the user is unable to rename/move the folders back, or create the new folders with the old name because the folder are still reserved on the mupdate server. f RENAME Test Mail * OK rename Test Mail * NO rename Test/drafts Mail/drafts: unable to reserve mailbox on mupdate server f NO unable to reserve mailbox on mupdate server g LIST "" "*" * LIST (\HasNoChildren) "/" INBOX * LIST (\HasNoChildren) "/" Mail * LIST (\HasNoChildren \Drafts) "/" Test/drafts * LIST (\HasNoChildren) "/" Test/s-spam * LIST (\HasNoChildren \Sent) "/" Test/sent * LIST (\HasNoChildren \Trash) "/" Test/trash * LIST (\HasNoChildren \Junk) "/" Test/v-spam g OK Completed (0.010 secs 7 calls) a "ctl_mboxlist -m -a" on the backend will fix the mailboxdb on the mupdate master/frontend I am not sure if moving a special use folder should work or not this should be consistent to renaming a top folder. At the moment our users are unable to restore their folder structure if they renamed/moved their folders unintended. Regards Michael Menge -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universit?t T?bingen Fax.: (49) 7071/29-5912 Zentrum f?r Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de W?chterstra?e 76 72074 T?bingen From me at anatoli.ws Tue Nov 13 22:15:28 2018 From: me at anatoli.ws (Anatoli) Date: Wed, 14 Nov 2018 00:15:28 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files Message-ID: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> Hi, I'm not sure this is due to some configuration option, bug or feature, but I'm observing some folders on Cyrus HTTP WebDAV server having hundreds (995 at this moment to be precise) internal files in the format "NNN." that correspond to the same file but different versions in time. There are 2-3 files (xls) in the folder that are edited constantly during the day and it looks like each save operation creates a new file. The files are of some 3-5Mb each. In the explorer/web view there are only a couple of files with a total size of 17.5Mb, but the reported disk usage for the folder is of 1.6Gb. Could someone please shed some light on what's going on and how to make each file visible to the users to be stored in only one internal file? Thanks, Anatoli -------------- next part -------------- An HTML attachment was scrubbed... URL: From jpilfold-bagwell at bordengrammar.kent.sch.uk Wed Nov 14 06:31:20 2018 From: jpilfold-bagwell at bordengrammar.kent.sch.uk (J Pilfold-Bagwell) Date: Wed, 14 Nov 2018 11:31:20 +0000 Subject: Phantom Folders Message-ID: Hi All, I have a cyrus server that appears to have phantom folders that appear in everyone's? IMAP folder subscription preferences on Roundcube, but can't be accessed. We searched the /var/spool/imap partition and found several folders that are not meant to be there, for example,? there's a /var/spool/imap/f/user/ folder, that contains the mailboxes of every user starting with "f",? but there's also a /var/spool/imap/f/users folder that contains one of the phantom mailboxes.? In another phantom folder, there's a phantom mailbox that appears as user,. My question is, how do I delete these without upsetting cyrus. I've tried using various permutations of dm but with no joy.? Is it worth deleting them manually and reindexing the whole imap store? Thanks in advance, Julian PB From murch at fastmail.com Wed Nov 14 08:54:01 2018 From: murch at fastmail.com (Ken Murchison) Date: Wed, 14 Nov 2018 08:54:01 -0500 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> Message-ID: On 11/13/18 10:15 PM, Anatoli wrote: > Hi, > > I'm not sure this is due to some configuration option, bug or feature, > but I'm observing some folders on Cyrus HTTP WebDAV server having > hundreds (995 at this moment to be precise) internal files in the > format "NNN." that correspond to the same file but different versions > in time. > > There are 2-3 files (xls) in the folder that are edited constantly > during the day and it looks like each save operation creates a new > file. The files are of some 3-5Mb each. In the explorer/web view there > are only a couple of files with a total size of 17.5Mb, but the > reported disk usage for the folder is of 1.6Gb. > > Could someone please shed some light on what's going on and how to > make each file visible to the users to be stored in only one internal > file? > > Thanks, > Anatoli Because *DAV is layered on top of an IMAP store, we have to abide by IMAP semantics in which messages (in this case DAV resources) are immutable.? Therefore, we can NOT overwrite an existing message in the mailbox.? Each change MUST result in a new message.? However, the server does mark the previous version(s) as deleted and expunged, which means that they will eventually be removed by cyr_expire.? If you aren't running cyr_expire, you should consider adding an event to cyrus.conf to remove expunged messages (see -X option). -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From me at anatoli.ws Thu Nov 15 01:48:27 2018 From: me at anatoli.ws (Anatoli) Date: Thu, 15 Nov 2018 03:48:27 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> Message-ID: <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> Hi Ken, Thanks a lot for the clarification, everything makes sense now. How can I list the files marked for deletion and those that are not marked? unexpunge can provide the list of files marked for deletion, is there any better way to list them, directly reading the DB? How to list those that are not marked? One more question, related: we got a client who's PC was crashing exactly during the modify operation (some issue with the PC hardware triggered by Excel save operation, probably a RAM spike touching some bad blocks). As a result, the file in Cyrus was becoming damaged, i.e. partially saved. Is it expected? Shouldn't Cyrus update the db with the pointer to the new file (a new message in the store) only if the operation completes successfully (e.g. the WebDAV messages exchange completes and the connection is closed at the right time or something similar)? Regards, Anatoli *From:* Ken Murchison *Sent:* Wednesday, November 14, 2018 10:54 *To:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files On 11/13/18 10:15 PM, Anatoli wrote: > Hi, > > I'm not sure this is due to some configuration option, bug or feature, > but I'm observing some folders on Cyrus HTTP WebDAV server having > hundreds (995 at this moment to be precise) internal files in the > format "NNN." that correspond to the same file but different versions > in time. > > There are 2-3 files (xls) in the folder that are edited constantly > during the day and it looks like each save operation creates a new > file. The files are of some 3-5Mb each. In the explorer/web view there > are only a couple of files with a total size of 17.5Mb, but the > reported disk usage for the folder is of 1.6Gb. > > Could someone please shed some light on what's going on and how to > make each file visible to the users to be stored in only one internal > file? > > Thanks, > Anatoli Because *DAV is layered on top of an IMAP store, we have to abide by IMAP semantics in which messages (in this case DAV resources) are immutable.? Therefore, we can NOT overwrite an existing message in the mailbox.? Each change MUST result in a new message.? However, the server does mark the previous version(s) as deleted and expunged, which means that they will eventually be removed by cyr_expire.? If you aren't running cyr_expire, you should consider adding an event to cyrus.conf to remove expunged messages (see -X option). -- Ken Murchison Cyrus Development Team FastMail US LLC ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From zorg at probesys.com Thu Nov 15 03:16:13 2018 From: zorg at probesys.com (Zorg) Date: Thu, 15 Nov 2018 09:16:13 +0100 Subject: Simple replication question Message-ID: <3bd63cd7-8e5c-97d6-e433-5c9d06d75e66@probesys.com> Hello I ve one cyrus imap server I want to create a replicated one I have read the documentation but nothing? explain how two start the first replication If my slave master is empty how can i synchronise them the first time Thanks From nic at onlight.com Thu Nov 15 08:52:12 2018 From: nic at onlight.com (Nic Bernstein) Date: Thu, 15 Nov 2018 07:52:12 -0600 Subject: Simple replication question In-Reply-To: <3bd63cd7-8e5c-97d6-e433-5c9d06d75e66@probesys.com> References: <3bd63cd7-8e5c-97d6-e433-5c9d06d75e66@probesys.com> Message-ID: On 11/15/18 2:16 AM, Zorg wrote: > I ve one cyrus imap server I want to create a replicated one > > I have read the documentation but nothing? explain how two start the > first replication > > If my slave master is empty how can i synchronise them the first time Once you've got replication configured, simply follow the instructions in the Standard Operating Procedures for "Manual Replication" here: https://cyrusimap.org/imap/reference/admin/sop/replication.html?highlight=replication#manual-replication To be clear, the "sync_client" command is run on the replica master,? The "sync_server" on the replica will be automatically started up by the 'cyr_master' process (may be called 'cyrmaster' or simply 'master', depending on version and distro).? The arguments and options in the sample command will sync a given user, but you may use any of the various options to sync the entire mail store, or parts of it. Cheers, ??? -nic -- Nic Bernstein nic at onlight.com Onlight Inc. www.onlight.com 6525 W Bluemound Rd., Ste 24 v. 414.272.4477 Milwaukee, Wisconsin 53213-4073 f. 414.290.0335 From murch at fastmail.com Thu Nov 15 12:09:40 2018 From: murch at fastmail.com (Ken Murchison) Date: Thu, 15 Nov 2018 12:09:40 -0500 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> Message-ID: On 11/15/18 1:48 AM, Anatoli wrote: > Hi Ken, > > Thanks a lot for the clarification, everything makes sense now. How > can I list the files marked for deletion and those that are not > marked? unexpunge can provide the list of files marked for deletion, > is there any better way to list them, directly reading the DB? How to > list those that are not marked? If you login as an admin, you should be able to SELECT the mailbox and use normal IMAP commands.? Alternatively, if you add "+DAV" to a regular userid, this will also allow SELECTing of DAV collection mailboxes. > One more question, related: we got a client who's PC was crashing > exactly during the modify operation (some issue with the PC hardware > triggered by Excel save operation, probably a RAM spike touching some > bad blocks). As a result, the file in Cyrus was becoming damaged, i.e. > partially saved. Is it expected? > > Shouldn't Cyrus update the db with the pointer to the new file (a new > message in the store) only if the operation completes successfully > (e.g. the WebDAV messages exchange completes and the connection is > closed at the right time or something similar)? If the append of the resource into the mailbox, or updating the DAV db entry fails, the operation should be reverted, with partial saving done.? Which version of Cyrus are you using? > *From:* Ken Murchison > *Sent:* Wednesday, November 14, 2018 10:54 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/13/18 10:15 PM, Anatoli wrote: >> Hi, >> >> I'm not sure this is due to some configuration option, bug or >> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >> having hundreds (995 at this moment to be precise) internal files in >> the format "NNN." that correspond to the same file but different >> versions in time. >> >> There are 2-3 files (xls) in the folder that are edited constantly >> during the day and it looks like each save operation creates a new >> file. The files are of some 3-5Mb each. In the explorer/web view >> there are only a couple of files with a total size of 17.5Mb, but the >> reported disk usage for the folder is of 1.6Gb. >> >> Could someone please shed some light on what's going on and how to >> make each file visible to the users to be stored in only one internal >> file? >> >> Thanks, >> Anatoli > > > Because *DAV is layered on top of an IMAP store, we have to abide by > IMAP semantics in which messages (in this case DAV resources) are > immutable.? Therefore, we can NOT overwrite an existing message in the > mailbox.? Each change MUST result in a new message.? However, the > server does mark the previous version(s) as deleted and expunged, > which means that they will eventually be removed by cyr_expire.? If > you aren't running cyr_expire, you should consider adding an event to > cyrus.conf to remove expunged messages (see -X option). > > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From me at anatoli.ws Fri Nov 16 01:19:03 2018 From: me at anatoli.ws (Anatoli) Date: Fri, 16 Nov 2018 03:19:03 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> Message-ID: <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> Ken, > If you login as an admin, you should be able to SELECT the mailbox and use normal IMAP commands.? Alternatively, if you add "+DAV" to a regular userid, this will also allow SELECTing of DAV collection mailboxes. When I do imtest -a mailadmin and then issue a002 select #drive/folder, I get: a002 NO Invalid mailbox type When I do imtest -a mailadmin+DAV, I get (XX replaces the real auth value): C: A01 AUTHENTICATE PLAIN XXXXXXXXXXXXXXXXXXX S: A01 NO authentication failure Authentication failed. generic failure I've also tried these combinations with the same result: "user at domain.tld+DAV" and "user+DAV at domain.tld". Am I doing it wrong? Independently of this, is there a way to obtain the details about the flags for each message in a folder directly from the db files? My idea is to rsync the Cyrus store where the WebDAV is located to some other folder (probably on another server), purge there the files marked as deleted and backup the remaining files, all this without altering the Cyrus store. Is it possible? > If the append of the resource into the mailbox, or updating the DAV db entry fails, the operation should be reverted, with partial saving done.? Which version of Cyrus are you using? Currently it is 3.0.5, but I can upgrade if there were any related changes in the later versions. What I was observing is that if a PC (LibreOffice Calc on Ubuntu 16.04, the folder mounted with davfs2) crashes in the middle of saving a file on the server, the result was a damaged file: some 400 bytes instead of 3-4Mb of a real file. I was thinking that maybe when the TCP stream hangs in the middle, Cyrus would interpret it as an end of data and write a file, but I've just tried to make some tests killing mount.davfs2 process and/or blocking the stream with iptables in the middle of file transmission and Cyrus responded correctly. For killing mount.davfs2 it showed in the corresponding log file the bytestream followed by: HTTP/1.1 400 Bad Request Unable to read body data And for blocking the stream with iptables it was showing the bytestream ending where the transmission stopped, without the 400 Bad Request, but in both cases the original file was not modified by the partial upload. So it appears the problem is elsewhere. Regards, Anatoli *From:* Ken Murchison *Sent:* Thursday, November 15, 2018 14:09 *To:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files On 11/15/18 1:48 AM, Anatoli wrote: > Hi Ken, > > Thanks a lot for the clarification, everything makes sense now. How > can I list the files marked for deletion and those that are not > marked? unexpunge can provide the list of files marked for deletion, > is there any better way to list them, directly reading the DB? How to > list those that are not marked? If you login as an admin, you should be able to SELECT the mailbox and use normal IMAP commands.? Alternatively, if you add "+DAV" to a regular userid, this will also allow SELECTing of DAV collection mailboxes. > One more question, related: we got a client who's PC was crashing > exactly during the modify operation (some issue with the PC hardware > triggered by Excel save operation, probably a RAM spike touching some > bad blocks). As a result, the file in Cyrus was becoming damaged, i.e. > partially saved. Is it expected? > > Shouldn't Cyrus update the db with the pointer to the new file (a new > message in the store) only if the operation completes successfully > (e.g. the WebDAV messages exchange completes and the connection is > closed at the right time or something similar)? If the append of the resource into the mailbox, or updating the DAV db entry fails, the operation should be reverted, with partial saving done.? Which version of Cyrus are you using? > *From:* Ken Murchison > *Sent:* Wednesday, November 14, 2018 10:54 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/13/18 10:15 PM, Anatoli wrote: >> Hi, >> >> I'm not sure this is due to some configuration option, bug or >> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >> having hundreds (995 at this moment to be precise) internal files in >> the format "NNN." that correspond to the same file but different >> versions in time. >> >> There are 2-3 files (xls) in the folder that are edited constantly >> during the day and it looks like each save operation creates a new >> file. The files are of some 3-5Mb each. In the explorer/web view >> there are only a couple of files with a total size of 17.5Mb, but the >> reported disk usage for the folder is of 1.6Gb. >> >> Could someone please shed some light on what's going on and how to >> make each file visible to the users to be stored in only one internal >> file? >> >> Thanks, >> Anatoli > > > Because *DAV is layered on top of an IMAP store, we have to abide by > IMAP semantics in which messages (in this case DAV resources) are > immutable.? Therefore, we can NOT overwrite an existing message in the > mailbox.? Each change MUST result in a new message.? However, the > server does mark the previous version(s) as deleted and expunged, > which means that they will eventually be removed by cyr_expire.? If > you aren't running cyr_expire, you should consider adding an event to > cyrus.conf to remove expunged messages (see -X option). > > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From Hagedorn at uni-koeln.de Fri Nov 16 01:53:02 2018 From: Hagedorn at uni-koeln.de (Sebastian Hagedorn) Date: Fri, 16 Nov 2018 07:53:02 +0100 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> Message-ID: <91AB2C983442A12EB2FCD813@Sebbis-iMac.local> Hi, > Independently of this, is there a way to obtain the details about the > flags for each message in a folder directly from the db files? you could try mbexamine for that. -- Sebastian Hagedorn - Weyertal 121, Zimmer 2.02 Regionales Rechenzentrum (RRZK) Universit?t zu K?ln / Cologne University - Tel. +49-221-470-89578 -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 262 bytes Desc: not available URL: From me at anatoli.ws Fri Nov 16 10:59:01 2018 From: me at anatoli.ws (Anatoli) Date: Fri, 16 Nov 2018 12:59:01 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <91AB2C983442A12EB2FCD813@Sebbis-iMac.local> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> <91AB2C983442A12EB2FCD813@Sebbis-iMac.local> Message-ID: Hi Sebastian. I've already tried it but it looks like it can't examine the structure of a folder that is a copy of the Cyrus store outside of it. Though maybe I could create a custom config file pointing to the new dir and instruct mbexamine to use it with -C param? On the other hand, I could just copy the relevant files without rsync'ing and then processing the entire spool. Thanks for the tip! *From:* Sebastian Hagedorn *Sent:* Friday, November 16, 2018 03:53 *To:* Anatoli *Cc:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files Hi, > Independently of this, is there a way to obtain the details about the > flags for each message in a folder directly from the db files? you could try mbexamine for that. -- Sebastian Hagedorn - Weyertal 121, Zimmer 2.02 Regionales Rechenzentrum (RRZK) Universit?t zu K?ln / Cologne University - Tel. +49-221-470-89578 -------------- next part -------------- An HTML attachment was scrubbed... URL: From murch at fastmail.com Fri Nov 16 11:17:31 2018 From: murch at fastmail.com (Ken Murchison) Date: Fri, 16 Nov 2018 11:17:31 -0500 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> Message-ID: <56b3ce01-19a5-31f7-a4cb-d965410aeb7c@fastmail.com> On 11/16/18 1:19 AM, Anatoli wrote: > Ken, > > > If you login as an admin, you should be able to SELECT the mailbox > and use normal IMAP commands.? Alternatively, if you add "+DAV" to a > regular userid, this will also allow SELECTing of DAV collection > mailboxes. > > When I do imtest -a mailadmin and then issue a002 select > #drive/folder, I get: > > a002 NO Invalid mailbox type It appears that just logging in as an admin won't do the trick. > > When I do imtest -a mailadmin+DAV, I get (XX replaces the real auth > value): > > C: A01 AUTHENTICATE PLAIN XXXXXXXXXXXXXXXXXXX > S: A01 NO authentication failure > Authentication failed. generic failure > > I've also tried these combinations with the same result: > "user at domain.tld+DAV" and "user+DAV at domain.tld". Am I doing it wrong? Enable the imapmagicplus option in imapd.conf > > Independently of this, is there a way to obtain the details about the > flags for each message in a folder directly from the db files? My idea > is to rsync the Cyrus store where the WebDAV is located to some other > folder (probably on another server), purge there the files marked as > deleted and backup the remaining files, all this without altering the > Cyrus store. Is it possible? > > > > If the append of the resource into the mailbox, or updating the DAV > db entry fails, the operation should be reverted, with partial saving > done.? Which version of Cyrus are you using? > > Currently it is 3.0.5, but I can upgrade if there were any related > changes in the later versions. What I was observing is that if a PC > (LibreOffice Calc on Ubuntu 16.04, the folder mounted with davfs2) > crashes in the middle of saving a file on the server, the result was a > damaged file: some 400 bytes instead of 3-4Mb of a real file. > > I was thinking that maybe when the TCP stream hangs in the middle, > Cyrus would interpret it as an end of data and write a file, but I've > just tried to make some tests killing mount.davfs2 process and/or > blocking the stream with iptables in the middle of file transmission > and Cyrus responded correctly. For killing mount.davfs2 it showed in > the corresponding log file the bytestream followed by: > > HTTP/1.1 400 Bad Request > > Unable to read body data > > And for blocking the stream with iptables it was showing the > bytestream ending where the transmission stopped, without the 400 Bad > Request, but in both cases the original file was not modified by the > partial upload. So it appears the problem is elsewhere. > > > Regards, > Anatoli > > *From:* Ken Murchison > *Sent:* Thursday, November 15, 2018 14:09 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/15/18 1:48 AM, Anatoli wrote: >> Hi Ken, >> >> Thanks a lot for the clarification, everything makes sense now. How >> can I list the files marked for deletion and those that are not >> marked? unexpunge can provide the list of files marked for deletion, >> is there any better way to list them, directly reading the DB? How to >> list those that are not marked? > > > If you login as an admin, you should be able to SELECT the mailbox and > use normal IMAP commands.? Alternatively, if you add "+DAV" to a > regular userid, this will also allow SELECTing of DAV collection > mailboxes. > > >> One more question, related: we got a client who's PC was crashing >> exactly during the modify operation (some issue with the PC hardware >> triggered by Excel save operation, probably a RAM spike touching some >> bad blocks). As a result, the file in Cyrus was becoming damaged, >> i.e. partially saved. Is it expected? >> >> Shouldn't Cyrus update the db with the pointer to the new file (a new >> message in the store) only if the operation completes successfully >> (e.g. the WebDAV messages exchange completes and the connection is >> closed at the right time or something similar)? > > > If the append of the resource into the mailbox, or updating the DAV db > entry fails, the operation should be reverted, with partial saving > done.? Which version of Cyrus are you using? > > > >> *From:* Ken Murchison >> *Sent:* Wednesday, November 14, 2018 10:54 >> *To:* Info-cyrus >> *Subject:* Re: WebDAV folders internally have hundreds of copies of >> the same few files >> >> >> On 11/13/18 10:15 PM, Anatoli wrote: >>> Hi, >>> >>> I'm not sure this is due to some configuration option, bug or >>> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >>> having hundreds (995 at this moment to be precise) internal files in >>> the format "NNN." that correspond to the same file but different >>> versions in time. >>> >>> There are 2-3 files (xls) in the folder that are edited constantly >>> during the day and it looks like each save operation creates a new >>> file. The files are of some 3-5Mb each. In the explorer/web view >>> there are only a couple of files with a total size of 17.5Mb, but >>> the reported disk usage for the folder is of 1.6Gb. >>> >>> Could someone please shed some light on what's going on and how to >>> make each file visible to the users to be stored in only one >>> internal file? >>> >>> Thanks, >>> Anatoli >> >> >> Because *DAV is layered on top of an IMAP store, we have to abide by >> IMAP semantics in which messages (in this case DAV resources) are >> immutable.? Therefore, we can NOT overwrite an existing message in >> the mailbox.? Each change MUST result in a new message.? However, the >> server does mark the previous version(s) as deleted and expunged, >> which means that they will eventually be removed by cyr_expire.? If >> you aren't running cyr_expire, you should consider adding an event to >> cyrus.conf to remove expunged messages (see -X option). >> >> -- >> Ken Murchison >> Cyrus Development Team >> FastMail US LLC >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From vladislav.kurz at webstep.net Mon Nov 19 03:50:34 2018 From: vladislav.kurz at webstep.net (Vladislav Kurz) Date: Mon, 19 Nov 2018 09:50:34 +0100 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> Message-ID: <613aff4a-966e-a787-a415-8ddb1cf79814@webstep.net> On 11/14/18 2:54 PM, Ken Murchison wrote: > > On 11/13/18 10:15 PM, Anatoli wrote: >> Hi, >> >> I'm not sure this is due to some configuration option, bug or feature, >> but I'm observing some folders on Cyrus HTTP WebDAV server having >> hundreds (995 at this moment to be precise) internal files in the >> format "NNN." that correspond to the same file but different versions >> in time. >> >> There are 2-3 files (xls) in the folder that are edited constantly >> during the day and it looks like each save operation creates a new >> file. The files are of some 3-5Mb each. In the explorer/web view there >> are only a couple of files with a total size of 17.5Mb, but the >> reported disk usage for the folder is of 1.6Gb. >> >> Could someone please shed some light on what's going on and how to >> make each file visible to the users to be stored in only one internal >> file? >> >> Thanks, >> Anatoli > > > Because *DAV is layered on top of an IMAP store, we have to abide by > IMAP semantics in which messages (in this case DAV resources) are > immutable.? Therefore, we can NOT overwrite an existing message in the > mailbox.? Each change MUST result in a new message.? However, the server > does mark the previous version(s) as deleted and expunged, which means > that they will eventually be removed by cyr_expire.? If you aren't > running cyr_expire, you should consider adding an event to cyrus.conf to > remove expunged messages (see -X option). Hello, you probably have "expunge_mode: delayed". That's why deleted mails (and *dav files) stay in place, until cleaned by cyr_expire as mentioned above. -- Best Regards Vladislav Kurz From me at anatoli.ws Tue Nov 20 01:01:02 2018 From: me at anatoli.ws (Anatoli) Date: Tue, 20 Nov 2018 03:01:02 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <56b3ce01-19a5-31f7-a4cb-d965410aeb7c@fastmail.com> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> <56b3ce01-19a5-31f7-a4cb-d965410aeb7c@fastmail.com> Message-ID: <26ed7011-e26f-2aa0-77bc-c53cabc9b773@anatoli.ws> > Enable the imapmagicplus option in imapd.conf With this option I could login with imtest specifying "+DAV" for the user, both as the admin and as a regular user, but then when trying to select a folder, I got "NO Permission denied" for the admin and "NO Mailbox does not exist" for a common user. This looks like undocumented magic and mbexamine actually provides all needed information, so I will get file details with it. Thanks for you help, Ken. *From:* Ken Murchison *Sent:* Friday, November 16, 2018 13:17 *To:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files On 11/16/18 1:19 AM, Anatoli wrote: > Ken, > > > If you login as an admin, you should be able to SELECT the mailbox > and use normal IMAP commands.? Alternatively, if you add "+DAV" to a > regular userid, this will also allow SELECTing of DAV collection > mailboxes. > > When I do imtest -a mailadmin and then issue a002 select > #drive/folder, I get: > > a002 NO Invalid mailbox type It appears that just logging in as an admin won't do the trick. > > When I do imtest -a mailadmin+DAV, I get (XX replaces the real auth > value): > > C: A01 AUTHENTICATE PLAIN XXXXXXXXXXXXXXXXXXX > S: A01 NO authentication failure > Authentication failed. generic failure > > I've also tried these combinations with the same result: > "user at domain.tld+DAV" and "user+DAV at domain.tld". Am I doing it wrong? Enable the imapmagicplus option in imapd.conf > > Independently of this, is there a way to obtain the details about the > flags for each message in a folder directly from the db files? My idea > is to rsync the Cyrus store where the WebDAV is located to some other > folder (probably on another server), purge there the files marked as > deleted and backup the remaining files, all this without altering the > Cyrus store. Is it possible? > > > > If the append of the resource into the mailbox, or updating the DAV > db entry fails, the operation should be reverted, with partial saving > done.? Which version of Cyrus are you using? > > Currently it is 3.0.5, but I can upgrade if there were any related > changes in the later versions. What I was observing is that if a PC > (LibreOffice Calc on Ubuntu 16.04, the folder mounted with davfs2) > crashes in the middle of saving a file on the server, the result was a > damaged file: some 400 bytes instead of 3-4Mb of a real file. > > I was thinking that maybe when the TCP stream hangs in the middle, > Cyrus would interpret it as an end of data and write a file, but I've > just tried to make some tests killing mount.davfs2 process and/or > blocking the stream with iptables in the middle of file transmission > and Cyrus responded correctly. For killing mount.davfs2 it showed in > the corresponding log file the bytestream followed by: > > HTTP/1.1 400 Bad Request > > Unable to read body data > > And for blocking the stream with iptables it was showing the > bytestream ending where the transmission stopped, without the 400 Bad > Request, but in both cases the original file was not modified by the > partial upload. So it appears the problem is elsewhere. > > > Regards, > Anatoli > > *From:* Ken Murchison > *Sent:* Thursday, November 15, 2018 14:09 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/15/18 1:48 AM, Anatoli wrote: >> Hi Ken, >> >> Thanks a lot for the clarification, everything makes sense now. How >> can I list the files marked for deletion and those that are not >> marked? unexpunge can provide the list of files marked for deletion, >> is there any better way to list them, directly reading the DB? How to >> list those that are not marked? > > > If you login as an admin, you should be able to SELECT the mailbox and > use normal IMAP commands.? Alternatively, if you add "+DAV" to a > regular userid, this will also allow SELECTing of DAV collection > mailboxes. > > >> One more question, related: we got a client who's PC was crashing >> exactly during the modify operation (some issue with the PC hardware >> triggered by Excel save operation, probably a RAM spike touching some >> bad blocks). As a result, the file in Cyrus was becoming damaged, >> i.e. partially saved. Is it expected? >> >> Shouldn't Cyrus update the db with the pointer to the new file (a new >> message in the store) only if the operation completes successfully >> (e.g. the WebDAV messages exchange completes and the connection is >> closed at the right time or something similar)? > > > If the append of the resource into the mailbox, or updating the DAV db > entry fails, the operation should be reverted, with partial saving > done.? Which version of Cyrus are you using? > > > >> *From:* Ken Murchison >> *Sent:* Wednesday, November 14, 2018 10:54 >> *To:* Info-cyrus >> *Subject:* Re: WebDAV folders internally have hundreds of copies of >> the same few files >> >> >> On 11/13/18 10:15 PM, Anatoli wrote: >>> Hi, >>> >>> I'm not sure this is due to some configuration option, bug or >>> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >>> having hundreds (995 at this moment to be precise) internal files in >>> the format "NNN." that correspond to the same file but different >>> versions in time. >>> >>> There are 2-3 files (xls) in the folder that are edited constantly >>> during the day and it looks like each save operation creates a new >>> file. The files are of some 3-5Mb each. In the explorer/web view >>> there are only a couple of files with a total size of 17.5Mb, but >>> the reported disk usage for the folder is of 1.6Gb. >>> >>> Could someone please shed some light on what's going on and how to >>> make each file visible to the users to be stored in only one >>> internal file? >>> >>> Thanks, >>> Anatoli >> >> >> Because *DAV is layered on top of an IMAP store, we have to abide by >> IMAP semantics in which messages (in this case DAV resources) are >> immutable.? Therefore, we can NOT overwrite an existing message in >> the mailbox.? Each change MUST result in a new message.? However, the >> server does mark the previous version(s) as deleted and expunged, >> which means that they will eventually be removed by cyr_expire.? If >> you aren't running cyr_expire, you should consider adding an event to >> cyrus.conf to remove expunged messages (see -X option). >> >> -- >> Ken Murchison >> Cyrus Development Team >> FastMail US LLC >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From me at anatoli.ws Tue Nov 20 02:04:17 2018 From: me at anatoli.ws (Anatoli) Date: Tue, 20 Nov 2018 04:04:17 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <613aff4a-966e-a787-a415-8ddb1cf79814@webstep.net> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <613aff4a-966e-a787-a415-8ddb1cf79814@webstep.net> Message-ID: <138ec15a-b260-8e11-f994-e4eac61fbaef@anatoli.ws> Hi Vladislav, Yes, I don't actually have the expunge_mode option in the configs, so the default "delayed" is applied. I've just tried some experiments with cyr_expire, the -X n option alone clears everything, including the shared DAV folders, but I can't find how to clear only some shared DAV folder. The -p and -u options seem not to work as intented on the shared DAV folders (user-owned DAV folders are cleared with -p param). Any idea how to accomplish this? Regards, Anatoli *From:* Vladislav Kurz *Sent:* Monday, November 19, 2018 05:50 *To:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files On 11/14/18 2:54 PM, Ken Murchison wrote: > On 11/13/18 10:15 PM, Anatoli wrote: >> Hi, >> >> I'm not sure this is due to some configuration option, bug or feature, >> but I'm observing some folders on Cyrus HTTP WebDAV server having >> hundreds (995 at this moment to be precise) internal files in the >> format "NNN." that correspond to the same file but different versions >> in time. >> >> There are 2-3 files (xls) in the folder that are edited constantly >> during the day and it looks like each save operation creates a new >> file. The files are of some 3-5Mb each. In the explorer/web view there >> are only a couple of files with a total size of 17.5Mb, but the >> reported disk usage for the folder is of 1.6Gb. >> >> Could someone please shed some light on what's going on and how to >> make each file visible to the users to be stored in only one internal >> file? >> >> Thanks, >> Anatoli > > Because *DAV is layered on top of an IMAP store, we have to abide by > IMAP semantics in which messages (in this case DAV resources) are > immutable.? Therefore, we can NOT overwrite an existing message in the > mailbox.? Each change MUST result in a new message.? However, the server > does mark the previous version(s) as deleted and expunged, which means > that they will eventually be removed by cyr_expire.? If you aren't > running cyr_expire, you should consider adding an event to cyrus.conf to > remove expunged messages (see -X option). Hello, you probably have "expunge_mode: delayed". That's why deleted mails (and *dav files) stay in place, until cleaned by cyr_expire as mentioned above. -------------- next part -------------- An HTML attachment was scrubbed... URL: From murch at fastmail.com Tue Nov 20 08:22:41 2018 From: murch at fastmail.com (Ken Murchison) Date: Tue, 20 Nov 2018 08:22:41 -0500 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <26ed7011-e26f-2aa0-77bc-c53cabc9b773@anatoli.ws> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> <56b3ce01-19a5-31f7-a4cb-d965410aeb7c@fastmail.com> <26ed7011-e26f-2aa0-77bc-c53cabc9b773@anatoli.ws> Message-ID: <81d8bebd-8cb6-51e6-222a-2bc677e9d8b9@fastmail.com> What are you using as the mailbox name? On 11/20/18 1:01 AM, Anatoli wrote: > > Enable the imapmagicplus option in imapd.conf > > With this option I could login with imtest specifying "+DAV" for the > user, both as the admin and as a regular user, but then when trying to > select a folder, I got "NO Permission denied" for the admin and "NO > Mailbox does not exist" for a common user. This looks like > undocumented magic and mbexamine actually provides all needed > information, so I will get file details with it. > > Thanks for you help, Ken. > > *From:* Ken Murchison > *Sent:* Friday, November 16, 2018 13:17 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/16/18 1:19 AM, Anatoli wrote: >> Ken, >> >> > If you login as an admin, you should be able to SELECT the mailbox >> and use normal IMAP commands.? Alternatively, if you add "+DAV" to a >> regular userid, this will also allow SELECTing of DAV collection >> mailboxes. >> >> When I do imtest -a mailadmin and then issue a002 select >> #drive/folder, I get: >> >> a002 NO Invalid mailbox type > > > It appears that just logging in as an admin won't do the trick. > > > >> >> When I do imtest -a mailadmin+DAV, I get (XX replaces the real auth >> value): >> >> C: A01 AUTHENTICATE PLAIN XXXXXXXXXXXXXXXXXXX >> S: A01 NO authentication failure >> Authentication failed. generic failure >> >> I've also tried these combinations with the same result: >> "user at domain.tld+DAV" and "user+DAV at domain.tld". Am I doing it wrong? > > > Enable the imapmagicplus option in imapd.conf > > > >> >> Independently of this, is there a way to obtain the details about the >> flags for each message in a folder directly from the db files? My >> idea is to rsync the Cyrus store where the WebDAV is located to some >> other folder (probably on another server), purge there the files >> marked as deleted and backup the remaining files, all this without >> altering the Cyrus store. Is it possible? >> >> >> > If the append of the resource into the mailbox, or updating the DAV >> db entry fails, the operation should be reverted, with partial saving >> done.? Which version of Cyrus are you using? >> >> Currently it is 3.0.5, but I can upgrade if there were any related >> changes in the later versions. What I was observing is that if a PC >> (LibreOffice Calc on Ubuntu 16.04, the folder mounted with davfs2) >> crashes in the middle of saving a file on the server, the result was >> a damaged file: some 400 bytes instead of 3-4Mb of a real file. >> >> I was thinking that maybe when the TCP stream hangs in the middle, >> Cyrus would interpret it as an end of data and write a file, but I've >> just tried to make some tests killing mount.davfs2 process and/or >> blocking the stream with iptables in the middle of file transmission >> and Cyrus responded correctly. For killing mount.davfs2 it showed in >> the corresponding log file the bytestream followed by: >> >> HTTP/1.1 400 Bad Request >> >> Unable to read body data >> >> And for blocking the stream with iptables it was showing the >> bytestream ending where the transmission stopped, without the 400 Bad >> Request, but in both cases the original file was not modified by the >> partial upload. So it appears the problem is elsewhere. >> >> >> Regards, >> Anatoli >> >> *From:* Ken Murchison >> *Sent:* Thursday, November 15, 2018 14:09 >> *To:* Info-cyrus >> *Subject:* Re: WebDAV folders internally have hundreds of copies of >> the same few files >> >> >> On 11/15/18 1:48 AM, Anatoli wrote: >>> Hi Ken, >>> >>> Thanks a lot for the clarification, everything makes sense now. How >>> can I list the files marked for deletion and those that are not >>> marked? unexpunge can provide the list of files marked for deletion, >>> is there any better way to list them, directly reading the DB? How >>> to list those that are not marked? >> >> >> If you login as an admin, you should be able to SELECT the mailbox >> and use normal IMAP commands.? Alternatively, if you add "+DAV" to a >> regular userid, this will also allow SELECTing of DAV collection >> mailboxes. >> >> >>> One more question, related: we got a client who's PC was crashing >>> exactly during the modify operation (some issue with the PC hardware >>> triggered by Excel save operation, probably a RAM spike touching >>> some bad blocks). As a result, the file in Cyrus was becoming >>> damaged, i.e. partially saved. Is it expected? >>> >>> Shouldn't Cyrus update the db with the pointer to the new file (a >>> new message in the store) only if the operation completes >>> successfully (e.g. the WebDAV messages exchange completes and the >>> connection is closed at the right time or something similar)? >> >> >> If the append of the resource into the mailbox, or updating the DAV >> db entry fails, the operation should be reverted, with partial saving >> done.? Which version of Cyrus are you using? >> >> >> >>> *From:* Ken Murchison >>> *Sent:* Wednesday, November 14, 2018 10:54 >>> *To:* Info-cyrus >>> *Subject:* Re: WebDAV folders internally have hundreds of copies of >>> the same few files >>> >>> >>> On 11/13/18 10:15 PM, Anatoli wrote: >>>> Hi, >>>> >>>> I'm not sure this is due to some configuration option, bug or >>>> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >>>> having hundreds (995 at this moment to be precise) internal files >>>> in the format "NNN." that correspond to the same file but different >>>> versions in time. >>>> >>>> There are 2-3 files (xls) in the folder that are edited constantly >>>> during the day and it looks like each save operation creates a new >>>> file. The files are of some 3-5Mb each. In the explorer/web view >>>> there are only a couple of files with a total size of 17.5Mb, but >>>> the reported disk usage for the folder is of 1.6Gb. >>>> >>>> Could someone please shed some light on what's going on and how to >>>> make each file visible to the users to be stored in only one >>>> internal file? >>>> >>>> Thanks, >>>> Anatoli >>> >>> >>> Because *DAV is layered on top of an IMAP store, we have to abide by >>> IMAP semantics in which messages (in this case DAV resources) are >>> immutable.? Therefore, we can NOT overwrite an existing message in >>> the mailbox.? Each change MUST result in a new message.? However, >>> the server does mark the previous version(s) as deleted and >>> expunged, which means that they will eventually be removed by >>> cyr_expire.? If you aren't running cyr_expire, you should consider >>> adding an event to cyrus.conf to remove expunged messages (see -X >>> option). >>> >>> -- >>> Ken Murchison >>> Cyrus Development Team >>> FastMail US LLC >>> >>> ---- >>> Cyrus Home Page:http://www.cyrusimap.org/ >>> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >>> >>> >>> ---- >>> Cyrus Home Page:http://www.cyrusimap.org/ >>> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> -- >> Ken Murchison >> Cyrus Development Team >> FastMail US LLC >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From byrnejb at harte-lyne.ca Tue Nov 20 09:29:34 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Tue, 20 Nov 2018 09:29:34 -0500 Subject: ipurge difficulties Message-ID: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> Having recently switched our mail service over to IMAPv3 I have a nagging doubt that the ipurge commands in our cyrus.conf file are not working as I anticipate. For example, my Trash folder does not seem to have been emptied since the conversion: find '/var/spool/imap/x/user/x/INBOX^Trash' -mtime +36d | wc -l 11367 # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 'user/*/INBOX^Trash' # echo $? 0 # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 'user/x/INBOX^Trash' # echo $? 0 What is happening here? -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From murch at fastmail.com Tue Nov 20 10:00:56 2018 From: murch at fastmail.com (Ken Murchison) Date: Tue, 20 Nov 2018 10:00:56 -0500 Subject: SASL 2.1.27 Message-ID: <9a09ebfd-0fa8-fc0d-b707-4133227cb0b9@fastmail.com> All, I'm pleased to announce the release of the long-awaited SASL 2.1.27 which can be downloaded from here: * HTTP: https://www.cyrusimap.org/releases/cyrus-sasl-2.1.27.tar.gz https://www.cyrusimap.org/releases/cyrus-sasl-2.1.27.tar.gz.sig * FTP: ftp://ftp.cyrusimap.org/cyrus-sasl/cyrus-sasl-2.1.27.tar.gz ftp://ftp.cyrusimap.org/cyrus-sasl/cyrus-sasl-2.1.27.tar.gz.sig md5sum: a33820c66e0622222c5aefafa1581083 cyrus-sasl-2.1.27.tar.gz b295313b9915be32b334f7e88f30dacd cyrus-sasl-2.1.27.tar.gz.sig The (mostly) complete list of changes from 2.1.26 are these: * Added support for OpenSSL 1.1 * Added support for lmdb (from Howard Chu) * Lots of build fixes (from Ignacio Casal Quinteiro and others) * Treat SCRAM and DIGEST-MD5 as more secure than PLAIN when selecting client mech * DIGEST-MD5 plugin: o Fixed memory leaks o Fixed a segfault when looking for non-existent reauth cache o Prevent client from going from step 3 back to step 2 o Allow cmusaslsecretDIGEST-MD5 property to be disabled * GSSAPI plugin: o Added support for retrieving negotiated SSF o Properly compute maxbufsize AFTER security layers have been set * SCRAM plugin: o Added support for SCRAM-SHA-256 o Allow SCRAM-* to be used by HTTP * LOGIN plugin: o Don?t prompt client for password until requested by server * NTLM plugin: o Fixed crash due to uninitialized HMAC context * saslauthd: o cache.c: + Don?t use cached credentials if timeout has expired + Fixed debug logging output o ipc_doors.c: + Fixed potential DoS attack (from Oracle) o ipc_unix.c: + Prevent premature closing of socket o auth_rimap.c: + Added support LOGOUT command + Added support for unsolicited CAPABILITY responses in LOGIN reply + Properly detect end of responses (don?t needlessly wait) + Properly handle backslash in passwords o auth_httpform: + Fix off-by-one error in string termination + Added support for 204 success response o auth_krb5.c: + Added krb5_conv_krb4_instance option + Added more verbose error logging -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From me at anatoli.ws Tue Nov 20 18:23:43 2018 From: me at anatoli.ws (Anatoli) Date: Tue, 20 Nov 2018 20:23:43 -0300 Subject: WebDAV folders internally have hundreds of copies of the same few files In-Reply-To: <81d8bebd-8cb6-51e6-222a-2bc677e9d8b9@fastmail.com> References: <024e49fa-74d2-613f-1d5a-36497dffae04@anatoli.ws> <377b8a00-5c8d-3c86-342a-61f4526b0015@anatoli.ws> <9e032a3e-36c4-3a3b-7278-bab305567cda@anatoli.ws> <56b3ce01-19a5-31f7-a4cb-d965410aeb7c@fastmail.com> <26ed7011-e26f-2aa0-77bc-c53cabc9b773@anatoli.ws> <81d8bebd-8cb6-51e6-222a-2bc677e9d8b9@fastmail.com> Message-ID: > What are you using as the mailbox name? #drive/shared/test2 Ken, do you know why cyr_expire -u and -p don't work on shared DAV mailboxes? E.g. cyr_expire -X 3 -u "#drive/shared/test2" doesn't clean the folder and with -v shows 0 for everything, then unexpunge -l "#drive/shared/test2" shows a lot of items with Expg date older that 3 days, but a general cyr_expire -X 3 (i.e. without the -u or -p) does clean the entire store, including the shared DAV folders. *From:* Ken Murchison *Sent:* Tuesday, November 20, 2018 10:22 *To:* Info-cyrus *Subject:* Re: WebDAV folders internally have hundreds of copies of the same few files What are you using as the mailbox name? On 11/20/18 1:01 AM, Anatoli wrote: > > Enable the imapmagicplus option in imapd.conf > > With this option I could login with imtest specifying "+DAV" for the > user, both as the admin and as a regular user, but then when trying to > select a folder, I got "NO Permission denied" for the admin and "NO > Mailbox does not exist" for a common user. This looks like > undocumented magic and mbexamine actually provides all needed > information, so I will get file details with it. > > Thanks for you help, Ken. > > *From:* Ken Murchison > *Sent:* Friday, November 16, 2018 13:17 > *To:* Info-cyrus > *Subject:* Re: WebDAV folders internally have hundreds of copies of > the same few files > > > On 11/16/18 1:19 AM, Anatoli wrote: >> Ken, >> >> > If you login as an admin, you should be able to SELECT the mailbox >> and use normal IMAP commands.? Alternatively, if you add "+DAV" to a >> regular userid, this will also allow SELECTing of DAV collection >> mailboxes. >> >> When I do imtest -a mailadmin and then issue a002 select >> #drive/folder, I get: >> >> a002 NO Invalid mailbox type > > > It appears that just logging in as an admin won't do the trick. > > > >> >> When I do imtest -a mailadmin+DAV, I get (XX replaces the real auth >> value): >> >> C: A01 AUTHENTICATE PLAIN XXXXXXXXXXXXXXXXXXX >> S: A01 NO authentication failure >> Authentication failed. generic failure >> >> I've also tried these combinations with the same result: >> "user at domain.tld+DAV" and "user+DAV at domain.tld". Am I doing it wrong? > > > Enable the imapmagicplus option in imapd.conf > > > >> >> Independently of this, is there a way to obtain the details about the >> flags for each message in a folder directly from the db files? My >> idea is to rsync the Cyrus store where the WebDAV is located to some >> other folder (probably on another server), purge there the files >> marked as deleted and backup the remaining files, all this without >> altering the Cyrus store. Is it possible? >> >> >> > If the append of the resource into the mailbox, or updating the DAV >> db entry fails, the operation should be reverted, with partial saving >> done.? Which version of Cyrus are you using? >> >> Currently it is 3.0.5, but I can upgrade if there were any related >> changes in the later versions. What I was observing is that if a PC >> (LibreOffice Calc on Ubuntu 16.04, the folder mounted with davfs2) >> crashes in the middle of saving a file on the server, the result was >> a damaged file: some 400 bytes instead of 3-4Mb of a real file. >> >> I was thinking that maybe when the TCP stream hangs in the middle, >> Cyrus would interpret it as an end of data and write a file, but I've >> just tried to make some tests killing mount.davfs2 process and/or >> blocking the stream with iptables in the middle of file transmission >> and Cyrus responded correctly. For killing mount.davfs2 it showed in >> the corresponding log file the bytestream followed by: >> >> HTTP/1.1 400 Bad Request >> >> Unable to read body data >> >> And for blocking the stream with iptables it was showing the >> bytestream ending where the transmission stopped, without the 400 Bad >> Request, but in both cases the original file was not modified by the >> partial upload. So it appears the problem is elsewhere. >> >> >> Regards, >> Anatoli >> >> *From:* Ken Murchison >> *Sent:* Thursday, November 15, 2018 14:09 >> *To:* Info-cyrus >> *Subject:* Re: WebDAV folders internally have hundreds of copies of >> the same few files >> >> >> On 11/15/18 1:48 AM, Anatoli wrote: >>> Hi Ken, >>> >>> Thanks a lot for the clarification, everything makes sense now. How >>> can I list the files marked for deletion and those that are not >>> marked? unexpunge can provide the list of files marked for deletion, >>> is there any better way to list them, directly reading the DB? How >>> to list those that are not marked? >> >> >> If you login as an admin, you should be able to SELECT the mailbox >> and use normal IMAP commands.? Alternatively, if you add "+DAV" to a >> regular userid, this will also allow SELECTing of DAV collection >> mailboxes. >> >> >>> One more question, related: we got a client who's PC was crashing >>> exactly during the modify operation (some issue with the PC hardware >>> triggered by Excel save operation, probably a RAM spike touching >>> some bad blocks). As a result, the file in Cyrus was becoming >>> damaged, i.e. partially saved. Is it expected? >>> >>> Shouldn't Cyrus update the db with the pointer to the new file (a >>> new message in the store) only if the operation completes >>> successfully (e.g. the WebDAV messages exchange completes and the >>> connection is closed at the right time or something similar)? >> >> >> If the append of the resource into the mailbox, or updating the DAV >> db entry fails, the operation should be reverted, with partial saving >> done.? Which version of Cyrus are you using? >> >> >> >>> *From:* Ken Murchison >>> *Sent:* Wednesday, November 14, 2018 10:54 >>> *To:* Info-cyrus >>> *Subject:* Re: WebDAV folders internally have hundreds of copies of >>> the same few files >>> >>> >>> On 11/13/18 10:15 PM, Anatoli wrote: >>>> Hi, >>>> >>>> I'm not sure this is due to some configuration option, bug or >>>> feature, but I'm observing some folders on Cyrus HTTP WebDAV server >>>> having hundreds (995 at this moment to be precise) internal files >>>> in the format "NNN." that correspond to the same file but different >>>> versions in time. >>>> >>>> There are 2-3 files (xls) in the folder that are edited constantly >>>> during the day and it looks like each save operation creates a new >>>> file. The files are of some 3-5Mb each. In the explorer/web view >>>> there are only a couple of files with a total size of 17.5Mb, but >>>> the reported disk usage for the folder is of 1.6Gb. >>>> >>>> Could someone please shed some light on what's going on and how to >>>> make each file visible to the users to be stored in only one >>>> internal file? >>>> >>>> Thanks, >>>> Anatoli >>> >>> >>> Because *DAV is layered on top of an IMAP store, we have to abide by >>> IMAP semantics in which messages (in this case DAV resources) are >>> immutable.? Therefore, we can NOT overwrite an existing message in >>> the mailbox.? Each change MUST result in a new message.? However, >>> the server does mark the previous version(s) as deleted and >>> expunged, which means that they will eventually be removed by >>> cyr_expire.? If you aren't running cyr_expire, you should consider >>> adding an event to cyrus.conf to remove expunged messages (see -X >>> option). >>> >>> -- >>> Ken Murchison >>> Cyrus Development Team >>> FastMail US LLC >>> >>> ---- >>> Cyrus Home Page:http://www.cyrusimap.org/ >>> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >>> >>> >>> ---- >>> Cyrus Home Page:http://www.cyrusimap.org/ >>> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> -- >> Ken Murchison >> Cyrus Development Team >> FastMail US LLC >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> >> >> ---- >> Cyrus Home Page:http://www.cyrusimap.org/ >> List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > -- > Ken Murchison > Cyrus Development Team > FastMail US LLC > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Ken Murchison Cyrus Development Team FastMail US LLC ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From javier at jangulo.net Wed Nov 21 03:25:07 2018 From: javier at jangulo.net (Javier Angulo) Date: Wed, 21 Nov 2018 09:25:07 +0100 Subject: ipurge difficulties In-Reply-To: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> References: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> Message-ID: On 11/20/18 3:29 PM, James B. Byrne via Info-cyrus wrote: > # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 > 'user/x/INBOX^Trash' > # echo $? > 0 > > What is happening here? Probably you have to use a '.' instead of '^' try: # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 'user/*/INBOX.Trash' Cheers, Javier. From byrnejb at harte-lyne.ca Wed Nov 21 08:38:15 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Wed, 21 Nov 2018 08:38:15 -0500 Subject: [SOLVED] Re: ipurge difficulties In-Reply-To: References: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> Message-ID: <973efcbe4c55588aeb10621dd8970851.squirrel@webmail.harte-lyne.ca> On Wed, November 21, 2018 03:25, Javier Angulo wrote: > > On 11/20/18 3:29 PM, James B. Byrne via Info-cyrus wrote: >> # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 >> 'user/x/INBOX^Trash' >> # echo $? >> 0 >> >> What is happening here? > > Probably you have to use a '.' instead of '^' > > try: > # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 > 'user/*/INBOX.Trash' > Thank you. That was it exactly. My next question is: Why did the conversion to imap3 ignore users' existing Trash folder and create a new folder named INBOX^Trash for everyone; and likewise with Drafts and Sent? -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From javier at jangulo.net Wed Nov 21 09:33:43 2018 From: javier at jangulo.net (Javier Angulo) Date: Wed, 21 Nov 2018 15:33:43 +0100 Subject: [SOLVED] Re: ipurge difficulties In-Reply-To: <973efcbe4c55588aeb10621dd8970851.squirrel@webmail.harte-lyne.ca> References: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> <973efcbe4c55588aeb10621dd8970851.squirrel@webmail.harte-lyne.ca> Message-ID: <1afc4ded-c6d9-49f6-e2e1-7b3f2e9d7d9d@jangulo.net> On 11/21/18 2:38 PM, James B. Byrne via Info-cyrus wrote: > > > On Wed, November 21, 2018 03:25, Javier Angulo wrote: >> >> On 11/20/18 3:29 PM, James B. Byrne via Info-cyrus wrote: >>> # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 >>> 'user/x/INBOX^Trash' >>> # echo $? >>> 0 >>> >>> What is happening here? >> >> Probably you have to use a '.' instead of '^' >> >> try: >> # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 >> 'user/*/INBOX.Trash' >> > > Thank you. That was it exactly. > > My next question is: Why did the conversion to imap3 ignore users' > existing Trash folder and create a new folder named INBOX^Trash for > everyone; and likewise with Drafts and Sent? > mmm we have upgraded quite a few mailboxes and never had that thing. Just speculating but could be related to new defaults unixhierarchysep: on altnamespace: on We had both on before upgrading. check https://www.cyrusimap.org/3.0/imap/download/upgrade.html Cheers From byrnejb at harte-lyne.ca Wed Nov 21 10:20:08 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Wed, 21 Nov 2018 10:20:08 -0500 Subject: [SOLVED] Re: ipurge difficulties In-Reply-To: <1afc4ded-c6d9-49f6-e2e1-7b3f2e9d7d9d@jangulo.net> References: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> <973efcbe4c55588aeb10621dd8970851.squirrel@webmail.harte-lyne.ca> <1afc4ded-c6d9-49f6-e2e1-7b3f2e9d7d9d@jangulo.net> Message-ID: <8bcac063aee757eccea21ead63a49e04.squirrel@webmail.harte-lyne.ca> On Wed, November 21, 2018 09:33, Javier Angulo wrote: > > > On 11/21/18 2:38 PM, James B. Byrne via Info-cyrus wrote: >> >> >> On Wed, November 21, 2018 03:25, Javier Angulo wrote: >>> >>> Probably you have to use a '.' instead of '^' >>> >>> try: >>> # sudo -u cyrus /usr/local/cyrus/sbin/ipurge -v -f -d 35 >>> 'user/*/INBOX.Trash' >>> >> >> Thank you. That was it exactly. >> >> My next question is: Why did the conversion to imap3 ignore users' >> existing Trash folder and create a new folder named INBOX^Trash for >> everyone; and likewise with Drafts and Sent? >> > > > mmm we have upgraded quite a few mailboxes and never had that thing. > Just speculating but could be related to new defaults > > unixhierarchysep: on > altnamespace: on > > We had both on before upgrading. > We had previously used the '.' as the separator. Our current settings are: /usr/local/etc/imapd.conf:unixhierarchysep: true /usr/local/etc/imapd.conf:altnamespace: true Before the purge this mailbox folder was displayed in my webmail application (Squirrelmail) as INBOX^Trash, which is why I choose that construction for the ipurge command. However, following the successful purge run of ipurge INBOX.Trash the mailbox now displays as INBOX.Trash. What is equally curious is that there exists a folder simply named Trash, which was used as the trash folder by the previous version of IMAP and which was replaced by INBOX^Trash by some part of the upgrade process. It is certain that these changes (Trash -> INBOX^Trash, Sent -> INBOX^Sent, Drafts -> INBOX^Drafts) were not consciously made and they affected all users. And, yes, I did follow the published upgrade procedures to the best of my understanding. -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From jc at irbs.com Wed Nov 21 18:16:00 2018 From: jc at irbs.com (John Capo) Date: Wed, 21 Nov 2018 18:16:00 -0500 (EST) Subject: [SOLVED] Re: ipurge difficulties In-Reply-To: <8bcac063aee757eccea21ead63a49e04.squirrel@webmail.harte-lyne.ca> References: <2bc50e814e9efe01ddf108a041181871.squirrel@webmail.harte-lyne.ca> <973efcbe4c55588aeb10621dd8970851.squirrel@webmail.harte-lyne.ca> <1afc4ded-c6d9-49f6-e2e1-7b3f2e9d7d9d@jangulo.net> <8bcac063aee757eccea21ead63a49e04.squirrel@webmail.harte-lyne.ca> Message-ID: <7654.205.237.194.2.1542842160.squirrel@beta.mxes.net> On Wed, November 21, 2018 10:20, James B. Byrne via Info-cyrus wrote: > > We had previously used the '.' as the separator. Our current settings > are: > > > /usr/local/etc/imapd.conf:unixhierarchysep: true > /usr/local/etc/imapd.conf:altnamespace: true > Change altnamespace/no to false or Options -> Folder Preferences and choose the Trash, Drafts, and Sent folders again. Changing the IMAP name space mid-stream confuses some/many IMAP clients. Mail on Apple thinghies will not recover without deleting the account on the device and creating it again. Don't ask how I know this. :( John Capo From byrnejb at harte-lyne.ca Fri Nov 23 11:08:25 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Fri, 23 Nov 2018 11:08:25 -0500 Subject: IMAP-3.0.8 and Diffie-Hellman Message-ID: <7ac8047374719574da3a6799700bf904.squirrel@webmail.harte-lyne.ca> I would like someone to explain to me how the diffie-hellman parameters are adjusted for cyrus-imap. Unlike Postfix, there does not seem to be a separate setting in imapd.conf for a DH parameter file. At least, I cannot find documentation respecting such a thing. The only information I have gleaned is that it may be necessary to append the DHParm file to the private key of the imap server. That seems to be a rather inelegant way of doings but, if that is the only way to do so then I need that confirmed. If not, then I would very much appreciate being told how else to accomplish it. -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From a_s_y at sama.ru Fri Nov 23 11:12:22 2018 From: a_s_y at sama.ru (Sergey) Date: Fri, 23 Nov 2018 20:12:22 +0400 Subject: imapd and count of deleted messages In-Reply-To: <20181112115625.Horde.6f1i9yCqaiLWsRcojYjq3me@webmail.uni-tuebingen.de> References: <20181112115625.Horde.6f1i9yCqaiLWsRcojYjq3me@webmail.uni-tuebingen.de> Message-ID: <201811232012.22518.a_s_y@sama.ru> On Monday 12 November 2018, Michael Menge wrote: > Are you sure messages have been "Deleted" via IMAP EXPUNGE command? Thanks. Two identical clients had different settings for deletion. Everything logging well. -- Regards, Sergey From boutilpj at ednet.ns.ca Fri Nov 23 13:59:31 2018 From: boutilpj at ednet.ns.ca (Patrick Boutilier) Date: Fri, 23 Nov 2018 14:59:31 -0400 Subject: IMAP-3.0.8 and Diffie-Hellman In-Reply-To: <7ac8047374719574da3a6799700bf904.squirrel@webmail.harte-lyne.ca> References: <7ac8047374719574da3a6799700bf904.squirrel@webmail.harte-lyne.ca> Message-ID: <38a8c5b9-d3ba-a063-1464-2902076a8fa0@ednet.ns.ca> On 11/23/18 12:08 PM, James B. Byrne via Info-cyrus wrote: > I would like someone to explain to me how the diffie-hellman > parameters are adjusted for cyrus-imap. Unlike Postfix, there does > not seem to be a separate setting in imapd.conf for a DH parameter > file. At least, I cannot find documentation respecting such a thing. > > The only information I have gleaned is that it may be necessary to > append the DHParm file to the private key of the imap server. That > seems to be a rather inelegant way of doings but, if that is the only > way to do so then I need that confirmed. If not, then I would very > much appreciate being told how else to accomplish it. Not sure about 3.x but that is how it is done in 2.4.x > > > -------------- next part -------------- A non-text attachment was scrubbed... Name: boutilpj.vcf Type: text/x-vcard Size: 286 bytes Desc: not available URL: From byrnejb at harte-lyne.ca Fri Nov 23 15:08:37 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Fri, 23 Nov 2018 15:08:37 -0500 Subject: TLSv1.0 Message-ID: We have been informed that our mail server may no longer employ TLSv1.0. Only TLSv1.1 and higher are now approved. I attempted to implement this with the following change to imapd.conf: tls_versions: tls1_2 tls1_3 However restarting imapd does not seem to eliminate TLSv1.0. # sslscan 216.185.71.17:993 Version: 1.11.11 OpenSSL 1.0.2-chacha (1.0.2k-dev) Connected to 216.185.71.17 Testing SSL server 216.185.71.17 on port 993 using SNI name 216.185.71.17 TLS Fallback SCSV: Server supports TLS Fallback SCSV TLS renegotiation: Session renegotiation not supported TLS Compression: Compression disabled Heartbleed: TLS 1.2 not vulnerable to heartbleed TLS 1.1 not vulnerable to heartbleed TLS 1.0 not vulnerable to heartbleed <<=== Supported Server Cipher(s): How do I eliminate TLSv1.0? -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From a_s_y at sama.ru Sun Nov 25 07:14:18 2018 From: a_s_y at sama.ru (Sergey) Date: Sun, 25 Nov 2018 16:14:18 +0400 Subject: SASL 2.1.27 In-Reply-To: <9a09ebfd-0fa8-fc0d-b707-4133227cb0b9@fastmail.com> References: <9a09ebfd-0fa8-fc0d-b707-4133227cb0b9@fastmail.com> Message-ID: <201811251614.18063.a_s_y@sama.ru> On Tuesday 20 November 2018, Ken Murchison wrote: > I'm pleased to announce the release of the long-awaited SASL 2.1.27 > which can be downloaded from here: Thanks. But I have one question and one note. https://github.com/cyrusimap/cyrus-sasl is not updated as I see, or the source tree have not release tag. Is it planned? https://www.cyrusimap.org/sasl/ contains the string "The latest stable version of Cyrus SASL is 2.1.26". -- Regards, Sergey From ellie at fastmail.com Sun Nov 25 22:03:36 2018 From: ellie at fastmail.com (ellie timoney) Date: Mon, 26 Nov 2018 14:03:36 +1100 Subject: SASL 2.1.27 In-Reply-To: <201811251614.18063.a_s_y@sama.ru> References: <9a09ebfd-0fa8-fc0d-b707-4133227cb0b9@fastmail.com> <201811251614.18063.a_s_y@sama.ru> Message-ID: <1543201416.2487530.1588567312.422F5A79@webmail.messagingengine.com> Thanks Sergey, these have been corrected and should update automatically in the next 15 minutes or so :) On Sun, Nov 25, 2018, at 11:14 PM, Sergey wrote: > On Tuesday 20 November 2018, Ken Murchison wrote: > > > I'm pleased to announce the release of the long-awaited SASL 2.1.27 > > which can be downloaded from here: > > Thanks. But I have one question and one note. > > https://github.com/cyrusimap/cyrus-sasl is not updated as I see, > or the source tree have not release tag. Is it planned? > > https://www.cyrusimap.org/sasl/ contains the string "The latest > stable version of Cyrus SASL is 2.1.26". > > -- > Regards, > Sergey > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From byrnejb at harte-lyne.ca Mon Nov 26 10:10:34 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Mon, 26 Nov 2018 15:10:34 -0000 Subject: tls-1.0 and cyrus-imaps-3.0.8 References: In-Reply-To: Message-ID: <236bb007f541b9c727b5c21c86a149f8.squirrel@webmail.harte-lyne.ca> We have this setting in imapd.conf: tls_versions: tls1_1 tls1_2 tls1_3 tls_prefer_server_ciphers: 1 tls_ciphers: HIGH:!aNULL:!MD5:!RC4 We have received notice that port 993 on our IMAP service supports TLS-1.0. When we run sslscan we get this result: # sslscan 216.185.71.17:993 Version: 1.11.11 OpenSSL 1.0.2-chacha (1.0.2k-dev) Connected to 216.185.71.17 Testing SSL server 216.185.71.17 on port 993 using SNI name 216.185.71.17 TLS Fallback SCSV: Server supports TLS Fallback SCSV TLS renegotiation: Session renegotiation not supported TLS Compression: Compression disabled Heartbleed: TLS 1.2 not vulnerable to heartbleed TLS 1.1 not vulnerable to heartbleed TLS 1.0 not vulnerable to heartbleed Supported Server Cipher(s): Preferred TLSv1.2 256 bits ECDHE-RSA-AES256-GCM-SHA384 Curve P-256 DHE 256 Accepted TLSv1.2 256 bits ECDHE-RSA-AES256-SHA384 Curve P-256 DHE 256 Accepted TLSv1.2 256 bits ECDHE-RSA-AES256-SHA Curve P-256 DHE 256 Accepted TLSv1.2 256 bits DHE-RSA-AES256-GCM-SHA384 DHE 2048 bits Accepted TLSv1.2 256 bits DHE-RSA-AES256-SHA256 DHE 2048 bits Accepted TLSv1.2 256 bits DHE-RSA-AES256-SHA DHE 2048 bits Accepted TLSv1.2 256 bits DHE-RSA-CAMELLIA256-SHA DHE 2048 bits Accepted TLSv1.2 256 bits AES256-GCM-SHA384 Accepted TLSv1.2 256 bits AES256-SHA256 Accepted TLSv1.2 256 bits AES256-SHA Accepted TLSv1.2 256 bits CAMELLIA256-SHA Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-GCM-SHA256 Curve P-256 DHE 256 Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-SHA256 Curve P-256 DHE 256 Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-SHA Curve P-256 DHE 256 Accepted TLSv1.2 128 bits DHE-RSA-AES128-GCM-SHA256 DHE 2048 bits Accepted TLSv1.2 128 bits DHE-RSA-AES128-SHA256 DHE 2048 bits Accepted TLSv1.2 128 bits DHE-RSA-AES128-SHA DHE 2048 bits Accepted TLSv1.2 128 bits DHE-RSA-CAMELLIA128-SHA DHE 2048 bits Accepted TLSv1.2 128 bits AES128-GCM-SHA256 Accepted TLSv1.2 128 bits AES128-SHA256 Accepted TLSv1.2 128 bits AES128-SHA Accepted TLSv1.2 128 bits CAMELLIA128-SHA Preferred TLSv1.1 256 bits ECDHE-RSA-AES256-SHA Curve P-256 DHE 256 Accepted TLSv1.1 256 bits DHE-RSA-AES256-SHA DHE 2048 bits Accepted TLSv1.1 256 bits DHE-RSA-CAMELLIA256-SHA DHE 2048 bits Accepted TLSv1.1 256 bits AES256-SHA Accepted TLSv1.1 256 bits CAMELLIA256-SHA Accepted TLSv1.1 128 bits ECDHE-RSA-AES128-SHA Curve P-256 DHE 256 Accepted TLSv1.1 128 bits DHE-RSA-AES128-SHA DHE 2048 bits Accepted TLSv1.1 128 bits DHE-RSA-CAMELLIA128-SHA DHE 2048 bits Accepted TLSv1.1 128 bits AES128-SHA Accepted TLSv1.1 128 bits CAMELLIA128-SHA SSL Certificate: Signature Algorithm: sha512WithRSAEncryption RSA Key Strength: 4096 Subject: imap.harte-lyne.ca Yes, I realise that the ciphers we use are all TLS-1.1 and above. Nonetheless cyrus-imapd seems to be telling connections that TLS-1.0 is available and this is causing us a headache with PCI. How do we turn off tls-1.0 in cyrus-imapd-3.0.8? -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From murch at fastmail.com Mon Nov 26 10:28:20 2018 From: murch at fastmail.com (Ken Murchison) Date: Mon, 26 Nov 2018 10:28:20 -0500 Subject: tls-1.0 and cyrus-imaps-3.0.8 In-Reply-To: <236bb007f541b9c727b5c21c86a149f8.squirrel@webmail.harte-lyne.ca> References: <236bb007f541b9c727b5c21c86a149f8.squirrel@webmail.harte-lyne.ca> Message-ID: <1f2f859e-f3df-4903-2b24-0bba13714842@fastmail.com> I can't reproduce your issue and I don't see where the sslscan output states that TLS1.0 is being advertised.? Can you actually connect using TLS1.0 protocol? openssl s_client -tls1 -connect 215.185.71.17:993 On 11/26/18 10:11 AM, James B. Byrne via Info-cyrus wrote: > We have this setting in imapd.conf: > > tls_versions: tls1_1 tls1_2 tls1_3 > tls_prefer_server_ciphers: 1 > tls_ciphers: HIGH:!aNULL:!MD5:!RC4 > > We have received notice that port 993 on our IMAP service supports > TLS-1.0. When we run sslscan we get this result: > > # sslscan 216.185.71.17:993 > Version: 1.11.11 > OpenSSL 1.0.2-chacha (1.0.2k-dev) > > Connected to 216.185.71.17 > > Testing SSL server 216.185.71.17 on port 993 using SNI name 216.185.71.17 > > TLS Fallback SCSV: > Server supports TLS Fallback SCSV > > TLS renegotiation: > Session renegotiation not supported > > TLS Compression: > Compression disabled > > Heartbleed: > TLS 1.2 not vulnerable to heartbleed > TLS 1.1 not vulnerable to heartbleed > TLS 1.0 not vulnerable to heartbleed > > Supported Server Cipher(s): > Preferred TLSv1.2 256 bits ECDHE-RSA-AES256-GCM-SHA384 Curve P-256 > DHE 256 > Accepted TLSv1.2 256 bits ECDHE-RSA-AES256-SHA384 Curve P-256 > DHE 256 > Accepted TLSv1.2 256 bits ECDHE-RSA-AES256-SHA Curve P-256 > DHE 256 > Accepted TLSv1.2 256 bits DHE-RSA-AES256-GCM-SHA384 DHE 2048 bits > Accepted TLSv1.2 256 bits DHE-RSA-AES256-SHA256 DHE 2048 bits > Accepted TLSv1.2 256 bits DHE-RSA-AES256-SHA DHE 2048 bits > Accepted TLSv1.2 256 bits DHE-RSA-CAMELLIA256-SHA DHE 2048 bits > Accepted TLSv1.2 256 bits AES256-GCM-SHA384 > Accepted TLSv1.2 256 bits AES256-SHA256 > Accepted TLSv1.2 256 bits AES256-SHA > Accepted TLSv1.2 256 bits CAMELLIA256-SHA > Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-GCM-SHA256 Curve P-256 > DHE 256 > Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-SHA256 Curve P-256 > DHE 256 > Accepted TLSv1.2 128 bits ECDHE-RSA-AES128-SHA Curve P-256 > DHE 256 > Accepted TLSv1.2 128 bits DHE-RSA-AES128-GCM-SHA256 DHE 2048 bits > Accepted TLSv1.2 128 bits DHE-RSA-AES128-SHA256 DHE 2048 bits > Accepted TLSv1.2 128 bits DHE-RSA-AES128-SHA DHE 2048 bits > Accepted TLSv1.2 128 bits DHE-RSA-CAMELLIA128-SHA DHE 2048 bits > Accepted TLSv1.2 128 bits AES128-GCM-SHA256 > Accepted TLSv1.2 128 bits AES128-SHA256 > Accepted TLSv1.2 128 bits AES128-SHA > Accepted TLSv1.2 128 bits CAMELLIA128-SHA > Preferred TLSv1.1 256 bits ECDHE-RSA-AES256-SHA Curve P-256 > DHE 256 > Accepted TLSv1.1 256 bits DHE-RSA-AES256-SHA DHE 2048 bits > Accepted TLSv1.1 256 bits DHE-RSA-CAMELLIA256-SHA DHE 2048 bits > Accepted TLSv1.1 256 bits AES256-SHA > Accepted TLSv1.1 256 bits CAMELLIA256-SHA > Accepted TLSv1.1 128 bits ECDHE-RSA-AES128-SHA Curve P-256 > DHE 256 > Accepted TLSv1.1 128 bits DHE-RSA-AES128-SHA DHE 2048 bits > Accepted TLSv1.1 128 bits DHE-RSA-CAMELLIA128-SHA DHE 2048 bits > Accepted TLSv1.1 128 bits AES128-SHA > Accepted TLSv1.1 128 bits CAMELLIA128-SHA > > SSL Certificate: > Signature Algorithm: sha512WithRSAEncryption > RSA Key Strength: 4096 > > Subject: imap.harte-lyne.ca > > > > Yes, I realise that the ciphers we use are all TLS-1.1 and above. > Nonetheless cyrus-imapd seems to be telling connections that TLS-1.0 > is available and this is causing us a headache with PCI. How do we > turn off tls-1.0 in cyrus-imapd-3.0.8? > > -- Ken Murchison Cyrus Development Team FastMail US LLC -------------- next part -------------- A non-text attachment was scrubbed... Name: murch.vcf Type: text/x-vcard Size: 4 bytes Desc: not available URL: From byrnejb at harte-lyne.ca Mon Nov 26 11:08:04 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Mon, 26 Nov 2018 11:08:04 -0500 Subject: tls-1.0 and cyrus-imaps-3.0.8 In-Reply-To: <1f2f859e-f3df-4903-2b24-0bba13714842@fastmail.com> References: <236bb007f541b9c727b5c21c86a149f8.squirrel@webmail.harte-lyne.ca> <1f2f859e-f3df-4903-2b24-0bba13714842@fastmail.com> Message-ID: On Mon, November 26, 2018 10:28, Ken Murchison wrote: > I can't reproduce your issue and I don't see where the sslscan output > states that TLS1.0 is being advertised.?? Can you actually connect > using TLS1.0 protocol? > No, we cannot. I will pass the results of our test to the powers thast be and see what their reply is. Thank you, that was most helpful advice. -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From boutilpj at ednet.ns.ca Mon Nov 26 11:36:28 2018 From: boutilpj at ednet.ns.ca (Patrick Boutilier) Date: Mon, 26 Nov 2018 12:36:28 -0400 Subject: tls-1.0 and cyrus-imaps-3.0.8 In-Reply-To: References: <236bb007f541b9c727b5c21c86a149f8.squirrel@webmail.harte-lyne.ca> <1f2f859e-f3df-4903-2b24-0bba13714842@fastmail.com> Message-ID: <4ad28369-844f-3063-b0b0-da3e68a54f7e@ednet.ns.ca> On 11/26/18 12:08 PM, James B. Byrne via Info-cyrus wrote: > > > On Mon, November 26, 2018 10:28, Ken Murchison wrote: >> I can't reproduce your issue and I don't see where the sslscan output >> states that TLS1.0 is being advertised.?? Can you actually connect >> using TLS1.0 protocol? >> > > > No, we cannot. I will pass the results of our test to the powers > thast be and see what their reply is. > > Thank you, that was most helpful advice. https://testssl.sh is also useful. testssl.sh --ssl-native -p :993 .... Service detected: IMAP, thus skipping HTTP specific checks Testing protocols via native openssl SSLv2 Local problem: /usr/bin/openssl doesn't support "s_client -ssl2" SSLv3 not offered (OK) TLS 1 not offered TLS 1.1 not offered TLS 1.2 offered (OK) TLS 1.3 not offered NPN/SPDY not offered ALPN/HTTP2 not offered > > -------------- next part -------------- A non-text attachment was scrubbed... Name: boutilpj.vcf Type: text/x-vcard Size: 307 bytes Desc: not available URL: From charles.bradshaw at ntlworld.com Wed Nov 28 10:21:23 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Wed, 28 Nov 2018 15:21:23 +0000 Subject: suddenly 'User unknown'? Message-ID: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> I have been running cyrus imap successfully for some years. Suddenly the server is throwing 'User unknown' in the maillog. I can login using using Thunderbird Mail OK, but NOTHING is being delivered to any user, pecifically to me brad at bradcan.homelinux.com I am at a complete loss to understand what has gone wrong. ?How do I diagnose the problem? ?What in detail is mechanism that decides that a user is known/unknown? I have included what I think are the relevant messages and parts of my configuration files (sendmail.mc cyrus.conf) files (sorry about the length) My tests while logged in to the server as brad: [brad at dell2600-1 ~]$ hostname dell2600-1.bradcan.homelinux.com [brad at dell2600-1 ~]$ sendmail brad at bradcan.homelinux.com < email.txt <<<<< THIS FAILS see below As root maillog content following the above: [root at dell2600-1 brad]# cat /var/log/maillog Nov 27 15:18:35 dell2600-1 sendmail[4798]: wARFIZXZ004798: from=brad, size=44, class=0, nrcpts=1, msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, relay=brad at localhost Nov 27 15:18:35 dell2600-1 sendmail[4799]: NOQUEUE: connect from localhost.localdomain [127.0.0.1] Nov 27 15:18:35 dell2600-1 sendmail[4799]: AUTH: available mech=CRAM-MD5 DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 Nov 27 15:18:35 dell2600-1 sendmail[4799]: wARFIZvg004799: Milter: no active filter Nov 27 15:18:35 dell2600-1 sendmail[4799]: STARTTLS=server, relay=localhost.localdomain [127.0.0.1], version=TLSv1/SSLv3, verify=NO, cipher=DHE RSA-AES256-GCM-SHA384, bits=256/256 Nov 27 15:18:35 dell2600-1 sendmail[4799]: STARTTLS=server, cert-subject=, cert-issuer=, verifymsg=ok Nov 27 15:18:35 dell2600-1 sendmail[4798]: STARTTLS=client, relay=[127.0.0.1], version=TLSv1/SSLv3, verify=FAIL, cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 Nov 27 15:18:35 dell2600-1 sendmail[4799]: AUTH: available mech=CRAM-MD5 DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 Nov 27 15:18:35 dell2600-1 sendmail[4799]: ruleset=trust_auth, arg1=brad at bradcan.homelinux.com, relay=localhost.localdomain [127.0.0.1], reject=550 5.7.1 ... not authenticated Nov 27 15:18:35 dell2600-1 sendmail[4799]: wARFIZvh004799: from=, size=358, class=0, nrcpts=1, msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, proto=ESMTP, daemon=MTA, relay=localhost.localdomain [127.0.0.1] Nov 27 15:18:36 dell2600-1 sendmail[4798]: wARFIZXZ004798: to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), delay=00:00:01, xdelay=00:00:01, mailer=relay, pri=30044, relay=[127.0.0.1] [127.0.0.1], dsn=2.0.0, stat=Sent (wARFIZvh004799 Message accepted for delivery) Nov 27 15:18:36 dell2600-1 sendmail[4801]: AUTH=client, relay=localhost, mech=, bits=0 Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: to=, delay=00:00:01, xdelay=00:00:00, mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User unknown Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: wARFIavg004801: DSN: User unknown Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: to=, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown ~ o ~ What cyradmin says: localhost.localdomain> ver name : Cyrus IMAPD version : v2.4.17-Invoca-RPM-2.4.17-7.el6 d1df8aff 2012-12-01 vendor : Project Cyrus support-url: http://www.cyrusimap.org os : Linux os-version : 2.6.32-754.6.3.el6.i686 environment: Built w/Cyrus SASL 2.1.23 Running w/Cyrus SASL 2.1.23 Built w/OpenSSL 1.0.1e-fips 11 Feb 2013 Running w/OpenSSL 1.0.1e-fips 11 Feb 2013 Built w/zlib 1.2.3 Running w/zlib 1.2.3 CMU Sieve 2.4 mmap = shared lock = fcntl nonblock = fcntl idle = idled localhost.localdomain> info user/brad at bradcan.homelinux.com {user/brad at bradcan.homelinux.com}: duplicatedeliver: false lastpop: 24-Oct-2013 21:04:43 +0100 lastupdate: 27-Nov-2018 04:00:00 +0000 partition: default pop3newuidl: true sharedseen: false size: 8489796 ~ o ~ Part of /etc/mail/sendmail.mc ... MASQUERADE_DOMAIN(bradcan.homelinux.com) MASQUERADE_DOMAIN(localhost)dnl MASQUERADE_DOMAIN(localhost.localdomain)dnl MAILER(smtp)dnl MAILER(cyrusv2)dnl MAILER_DEFINITIONS Mcyrusv2,??? P=[IPC], F=_MODMF_(CONCAT(_DEF_CYRUSV2_MAILER_FLAGS, CYRUSV2_MAILER_FLAGS), `CYRUSV2'), ??? ??? S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMT, E=\r\n, ??? ??? _OPTINS(`CYRUSV2_MAILER_MAXMSGS', `m=', `, ')_OPTINS(`CYRUSV2_MAILER_MAXRCPTS', `r=', `, ')_OPTINS(`CYRUSV2_MAILER_CHARSET', `C=', `, ')T=DNS/RFC822/SMTP,_CYRUSV2_QGRP ??? ??? A=CYRUSV2_MAILER_ARGS /etc/cyrus.conf: # standard standalone server implementation START { # do not delete this entry! recover cmd="ctl_cyrusdb -r" # this is only necessary if using idled for IMAP IDLE idled cmd="idled" } # UNIX sockets start with a slash and are put into /var/lib/imap/sockets SERVICES { # add or remove based on preferences imap cmd="imapd" listen="imap" prefork=5 imaps cmd="imapd -s" listen="imaps" prefork=1 pop3 cmd="pop3d" listen="pop3" prefork=3 pop3s cmd="pop3d -s" listen="pop3s" prefork=1 sieve cmd="timsieved" listen="sieve" prefork=0 # these are only necessary if receiving/exporting usenet via NNTP # nntp cmd="nntpd" listen="nntp" prefork=3 # nntps cmd="nntpd -s" listen="nntps" prefork=1 # at least one LMTP is required for delivery # lmtp cmd="lmtpd" listen="lmtp" prefork=0 lmtpunix cmd="lmtpd" listen="/var/lib/imap/socket/lmtp" prefork=1 # this is only necessary if using notifications # notify cmd="notifyd" listen="/var/lib/imap/socket/notify" proto="udp" prefork=1 } EVENTS { # this is required checkpoint cmd="ctl_cyrusdb -c" period=30 # this is only necessary if using duplicate delivery suppression, # Sieve or NNTP delprune cmd="cyr_expire -D 7 -E 3 -X 7" at=0400 # this is only necessary if caching TLS sessions tlsprune cmd="tls_prune" at=0400 } and /etc/imapd.conf [root at dell2600-1 brad]# cat /etc/imapd.conf configdirectory: /var/lib/imap partition-default: /var/spool/imap admins: cyrus sievedir: /var/lib/imap/sieve sendmail: /usr/sbin/sendmail hashimapspool: true sasl_pwcheck_method: auxprop sasl_mech_list: DIGEST-MD5 CRAM-MD5 # sasl_auxprop_plugin:sql sasl_sql_engine:mysql sasl_sql_hostnames:127.0.0.1:3306 sasl_sql_user:mail sasl_sql_passwd:qy19pbV63 sasl_sql_database:mail sasl_sql_select:SELECT pwd('%u','%r'); # allowplaintext: no unixhierarchysep: yes virtdomains: userid # tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH From dwhite at olp.net Wed Nov 28 11:12:03 2018 From: dwhite at olp.net (Dan White) Date: Wed, 28 Nov 2018 10:12:03 -0600 Subject: suddenly 'User unknown'? In-Reply-To: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> Message-ID: <20181128161203.GB20152@dan.olp.net> On 11/28/18?15:21?+0000, Charles Bradshaw via Info-cyrus wrote: >My tests while logged in to the server as brad: > >[root at dell2600-1 brad]# cat /var/log/maillog >Nov 27 15:18:35 dell2600-1 sendmail[4798]: wARFIZXZ004798: from=brad, >size=44, class=0, nrcpts=1, >msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, >relay=brad at localhost >Nov 27 15:18:35 dell2600-1 sendmail[4799]: wARFIZvh004799: from=, size=358, class=0, nrcpts=1, msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, proto=ESMTP, daemon=MTA, relay=localhost.localdomain [127.0.0.1] >Nov 27 15:18:36 dell2600-1 sendmail[4798]: wARFIZXZ004798: >to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), delay=00:00:01, xdelay=00:00:01, mailer=relay, pri=30044, relay=[127.0.0.1] [127.0.0.1], dsn=2.0.0, stat=Sent (wARFIZvh004799 Message accepted for delivery) > >Nov 27 15:18:36 dell2600-1 sendmail[4801]: AUTH=client, relay=localhost, mech=, bits=0 >Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: to=, delay=00:00:01, xdelay=00:00:00, mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User unknown >Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: wARFIavg004801: DSN: User unknown > >Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: to=, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown What do your cyrus syslog entries say? >What cyradmin says: > >localhost.localdomain> ver >name : Cyrus IMAPD >version : v2.4.17-Invoca-RPM-2.4.17-7.el6 d1df8aff 2012-12-01 > >localhost.localdomain> info user/brad at bradcan.homelinux.com >{user/brad at bradcan.homelinux.com}: > duplicatedeliver: false > lastpop: 24-Oct-2013 21:04:43 +0100 > lastupdate: 27-Nov-2018 04:00:00 +0000 > partition: default > pop3newuidl: true > sharedseen: false > size: 8489796 Does the output of 'lm' look correct? >and /etc/imapd.conf >[root at dell2600-1 brad]# cat /etc/imapd.conf >configdirectory: /var/lib/imap >partition-default: /var/spool/imap >admins: cyrus >sievedir: /var/lib/imap/sieve >sendmail: /usr/sbin/sendmail >hashimapspool: true >sasl_pwcheck_method: auxprop ># >sasl_auxprop_plugin:sql ># >allowplaintext: no >unixhierarchysep: yes >virtdomains: userid ># -- Dan White From charles.bradshaw at ntlworld.com Wed Nov 28 19:46:49 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Thu, 29 Nov 2018 00:46:49 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <20181128161203.GB20152@dan.olp.net> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> Message-ID: <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> Hi Dan, thanks for the prompt reply. Not sure if I should reply to the list or direct to you. lm user/brad at bradcan.homelinux.com?????????????????????? user/brad at bradcan.homelinux.com (\HasChildren) and the directory /var/spool/imap/domain/b/bradcan.homelinux.com/b/user/brad exists and is intact. Sorry I don't I'm not sure about cyrus syslog configuration: ?I have this in rsyslog.conf: # cyrus imapd auth.*??? ??? ??? ??? ??? ??? ??? /var/log/auth.log So I assume auth.log? has the log entries you ask for. Here it is: Nov 25 11:40:07 dell2600-1 sendmail[4274]: sql auxprop plugin using mysql engine Nov 25 11:42:23 dell2600-1 sendmail[4296]: sql freeing memory Nov 25 11:43:17 dell2600-1 sendmail[4340]: sql auxprop plugin using mysql engine Nov 25 11:49:28 dell2600-1 sendmail[4372]: sql freeing memory Nov 25 11:58:25 dell2600-1 sendmail[3760]: sql auxprop plugin using mysql engine Nov 25 11:58:36 dell2600-1 sendmail[4073]: sql freeing memory Nov 25 12:00:31 dell2600-1 sendmail[4145]: sql freeing memory Nov 25 12:05:43 dell2600-1 sendmail[4200]: sql freeing memory Nov 25 12:10:54 dell2600-1 sendmail[4250]: sql freeing memory Nov 25 14:33:32 dell2600-1 seahorse-daemon[4850]: DNS-SD initialization failed: Daemon not running Nov 25 14:33:32 dell2600-1 seahorse-daemon[4850]: init gpgme version 1.1.8 Nov 25 14:45:04 dell2600-1 gnome-keyring-daemon[4848]: dbus failure unregistering from session: Connection is closed Nov 26 11:39:21 dell2600-1 seahorse-daemon[10052]: DNS-SD initialization failed: Daemon not running Nov 26 11:39:21 dell2600-1 seahorse-daemon[10052]: init gpgme version 1.1.8 Nov 26 13:23:09 dell2600-1 sendmail[10809]: sql auxprop plugin using mysql engine Nov 26 13:31:51 dell2600-1 gnome-keyring-daemon[10049]: GVFS-RemoteVolumeMonitor: Owner :1.31 of volume monitor org.gtk.Private.GduVolumeMonitor disconnected from the bus; removing drives/volumes/mounts Nov 26 13:34:27 dell2600-1 sendmail[3741]: sql auxprop plugin using mysql engine Nov 26 13:34:40 dell2600-1 sendmail[4049]: sql freeing memory Nov 26 15:12:20 dell2600-1 sendmail[4601]: sql auxprop plugin using mysql engine Nov 27 12:18:06 dell2600-1 sendmail[4602]: sql auxprop plugin using mysql engine Nov 27 13:12:15 dell2600-1 sendmail[3750]: sql auxprop plugin using mysql engine Nov 27 13:12:22 dell2600-1 sendmail[3837]: sql freeing memory Nov 27 13:12:30 dell2600-1 sendmail[3986]: sql freeing memory Nov 27 13:32:41 dell2600-1 sendmail[4240]: sql freeing memory Nov 27 13:47:29 dell2600-1 sendmail[4292]: sql freeing memory Nov 27 13:50:19 dell2600-1 sendmail[4307]: sql freeing memory Nov 27 13:51:06 dell2600-1 sendmail[4315]: sql freeing memory Nov 27 15:50:03 dell2600-1 sendmail[4971]: sql freeing memory Nov 27 18:28:08 dell2600-1 sendmail[5493]: sql freeing memory Nov 27 22:55:05 dell2600-1 sendmail[6234]: sql freeing memory Nov 27 22:58:00 dell2600-1 sendmail[6244]: sql freeing memory Nov 27 23:34:53 dell2600-1 sendmail[6352]: sql freeing memory Nov 28 00:01:47 dell2600-1 sendmail[6446]: sql freeing memory Nov 28 01:05:00 dell2600-1 sendmail[6612]: sql freeing memory Nov 28 03:09:05 dell2600-1 sendmail[6943]: sql freeing memory Nov 28 13:10:49 dell2600-1 perl: DIGEST-MD5 client step 2 Nov 28 13:12:44 dell2600-1 perl: DIGEST-MD5 client step 3 Nov 28 14:45:18 dell2600-1 perl: DIGEST-MD5 client step 2 Nov 28 14:45:48 dell2600-1 perl: DIGEST-MD5 client step 3 Nov 28 15:03:30 dell2600-1 perl: DIGEST-MD5 client step 2 Nov 28 15:03:58 dell2600-1 perl: DIGEST-MD5 client step 3 Nov 28 15:16:15 dell2600-1 sendmail[9878]: sql freeing memory Nov 28 23:38:15 dell2600-1 perl: DIGEST-MD5 client step 2 Nov 28 23:38:35 dell2600-1 perl: DIGEST-MD5 client step 3 Perhaps I should change my rsyslog configuration. https://cyrusimap.org/imap/installing.html has some alternative instructions. Will the following be more helpful? |local6.*??????? /var/log/imapd.log| |auth.debug????? /var/log/auth.log| On 28/11/2018 16:12, Dan White wrote: > On 11/28/18?15:21?+0000, Charles Bradshaw via Info-cyrus wrote: >> My tests while logged in to the server as brad: >> >> [root at dell2600-1 brad]# cat /var/log/maillog >> Nov 27 15:18:35 dell2600-1 sendmail[4798]: wARFIZXZ004798: from=brad, >> size=44, class=0, nrcpts=1, >> msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, >> relay=brad at localhost >> Nov 27 15:18:35 dell2600-1 sendmail[4799]: wARFIZvh004799: >> from=, size=358, class=0, nrcpts=1, >> msgid=<201811271518.wARFIZXZ004798 at bradcan.homelinux.com>, >> proto=ESMTP, daemon=MTA, relay=localhost.localdomain [127.0.0.1] >> Nov 27 15:18:36 dell2600-1 sendmail[4798]: wARFIZXZ004798: >> to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), >> delay=00:00:01, xdelay=00:00:01, mailer=relay, pri=30044, >> relay=[127.0.0.1] [127.0.0.1], dsn=2.0.0, stat=Sent (wARFIZvh004799 >> Message accepted for delivery) >> >> Nov 27 15:18:36 dell2600-1 sendmail[4801]: AUTH=client, >> relay=localhost, mech=, bits=0 >> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: >> to=, delay=00:00:01, xdelay=00:00:00, >> mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User >> unknown >> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIZvh004799: >> wARFIavg004801: DSN: User unknown >> >> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: >> to=, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > > What do your cyrus syslog entries say? > >> What cyradmin says: >> >> localhost.localdomain> ver >> name?????? : Cyrus IMAPD >> version??? : v2.4.17-Invoca-RPM-2.4.17-7.el6 d1df8aff 2012-12-01 >> >> localhost.localdomain> info user/brad at bradcan.homelinux.com >> {user/brad at bradcan.homelinux.com}: >> ?duplicatedeliver: false >> ?lastpop: 24-Oct-2013 21:04:43 +0100 >> ?lastupdate: 27-Nov-2018 04:00:00 +0000 >> ?partition: default >> ?pop3newuidl: true >> ?sharedseen: false >> ?size: 8489796 > > Does the output of 'lm' look correct? > >> and /etc/imapd.conf >> [root at dell2600-1 brad]# cat /etc/imapd.conf >> configdirectory: /var/lib/imap >> partition-default: /var/spool/imap >> admins: cyrus >> sievedir: /var/lib/imap/sieve >> sendmail: /usr/sbin/sendmail >> hashimapspool: true >> sasl_pwcheck_method: auxprop >> # >> sasl_auxprop_plugin:sql >> # >> allowplaintext: no >> unixhierarchysep: yes >> virtdomains: userid >> # > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dwhite at olp.net Thu Nov 29 09:39:13 2018 From: dwhite at olp.net (Dan White) Date: Thu, 29 Nov 2018 08:39:13 -0600 Subject: suddenly 'User unknown'? In-Reply-To: <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> Message-ID: <20181129143913.GE20152@dan.olp.net> On 11/29/18?00:46?+0000, Charles Bradshaw wrote: > >lm user/brad at bradcan.homelinux.com?????????????????????? >user/brad at bradcan.homelinux.com (\HasChildren) > >and the directory >/var/spool/imap/domain/b/bradcan.homelinux.com/b/user/brad exists and is >intact. >Perhaps I should change my rsyslog configuration. >https://cyrusimap.org/imap/installing.html has some alternative >instructions. > >Will the following be more helpful? > > |local6.*??????? /var/log/imapd.log| > > |auth.debug????? /var/log/auth.log| Yes that should hopefully get you something useful from Cyrus to work with. Some OS packages, like Debian, modifiy the syslog facility, so you may need to consult your system documentation if that doesn't give appropriate output. >On 28/11/2018 16:12, Dan White wrote: >> On 11/28/18?15:21?+0000, Charles Bradshaw via Info-cyrus wrote: >>> My tests while logged in to the server as brad: >>> >>> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: >>> to=, delay=00:00:00, xdelay=00:00:00, >>> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >>> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown >> >> What do your cyrus syslog entries say? >> >> Does the output of 'lm' look correct? >> >>> and /etc/imapd.conf >>> [root at dell2600-1 brad]# cat /etc/imapd.conf >>> configdirectory: /var/lib/imap >>> partition-default: /var/spool/imap >>> admins: cyrus >>> sievedir: /var/lib/imap/sieve >>> sendmail: /usr/sbin/sendmail >>> hashimapspool: true >>> sasl_pwcheck_method: auxprop >>> # >>> sasl_auxprop_plugin:sql >>> # >>> allowplaintext: no >>> unixhierarchysep: yes >>> virtdomains: userid From charles.bradshaw at ntlworld.com Thu Nov 29 10:25:51 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Thu, 29 Nov 2018 15:25:51 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <20181129143913.GE20152@dan.olp.net> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> Message-ID: <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> Dan I have, and have always had, an empty /var/log/imapd.log so I'm not going to make progress until I fix that. In n /etc/rsyslog.conf # cyrus imapd #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried this first. local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log and in /etc/imapd.conf syslog_prefix: cyrus syslog_facility: LOCAL6 If I remove the file /etc/imapd.log then # /etc/init.d/rsyslog restart # logger local6.debug 'test log message' # cat /var/log/imapd.log Nov 29 15:06:42 dell2600-1 brad: test log message Obviously syslog is working local6. But still no messages from cyrus! Therefor I'm now stuck with this secondary problem. I have followed the cyrus instructions as best I can, but no go. I say again this has all worked for years, albeit with an always empty imapd.log There must be some missing cyrus syslog configuration. On 29/11/2018 14:39, Dan White wrote: > On 11/29/18?00:46?+0000, Charles Bradshaw wrote: >> >> lm user/brad at bradcan.homelinux.com?????????????????????? >> user/brad at bradcan.homelinux.com (\HasChildren) >> >> and the directory >> /var/spool/imap/domain/b/bradcan.homelinux.com/b/user/brad exists and is >> intact. > >> Perhaps I should change my rsyslog configuration. >> https://cyrusimap.org/imap/installing.html has some alternative >> instructions. >> >> Will the following be more helpful? >> >> ?? |local6.*??????? /var/log/imapd.log| >> >> ?? |auth.debug????? /var/log/auth.log| > > Yes that should hopefully get you something useful from Cyrus to work > with. > Some OS packages, like Debian, modifiy the syslog facility, so you may > need > to consult your system documentation if that doesn't give appropriate > output. > >> On 28/11/2018 16:12, Dan White wrote: >>> On 11/28/18?15:21?+0000, Charles Bradshaw via Info-cyrus wrote: >>>> My tests while logged in to the server as brad: >>>> >>>> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: >>>> to=, delay=00:00:00, xdelay=00:00:00, >>>> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >>>> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown >>> >>> What do your cyrus syslog entries say? >>> >>> Does the output of 'lm' look correct? >>> >>>> and /etc/imapd.conf >>>> [root at dell2600-1 brad]# cat /etc/imapd.conf >>>> configdirectory: /var/lib/imap >>>> partition-default: /var/spool/imap >>>> admins: cyrus >>>> sievedir: /var/lib/imap/sieve >>>> sendmail: /usr/sbin/sendmail >>>> hashimapspool: true >>>> sasl_pwcheck_method: auxprop >>>> # >>>> sasl_auxprop_plugin:sql >>>> # >>>> allowplaintext: no >>>> unixhierarchysep: yes >>>> virtdomains: userid From dwhite at olp.net Thu Nov 29 10:32:07 2018 From: dwhite at olp.net (Dan White) Date: Thu, 29 Nov 2018 09:32:07 -0600 Subject: suddenly 'User unknown'? In-Reply-To: <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> Message-ID: <20181129153207.GH20152@dan.olp.net> Do you otherwise see log entries for an imap connection? Is there a permissions problem on the lmtpunix mux (/var/lib/imap/socket/lmtp)? Your syslog entry seems to indicate it is communicating with cyrus, but perhaps I'm misreading it. Look up telemetry logging, and lmtptest for other ways to verify your cyrus config. You may need to temporarily enable lmtp on a TCP port to test. On 11/29/18?15:25?+0000, Charles Bradshaw wrote: >I have, and have always had, an empty /var/log/imapd.log so I'm not >going to make progress until I fix that. > >In n /etc/rsyslog.conf > ># cyrus imapd >#local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried this >first. >local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log >auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log > >and in /etc/imapd.conf > >syslog_prefix: cyrus >syslog_facility: LOCAL6 > >If I remove the file /etc/imapd.log then > ># /etc/init.d/rsyslog restart > ># logger local6.debug 'test log message' > ># cat /var/log/imapd.log > >Nov 29 15:06:42 dell2600-1 brad: test log message > >Obviously syslog is working local6. But still no messages from cyrus! >Therefor I'm now stuck with this secondary problem. > >I have followed the cyrus instructions as best I can, but no go. I say >again this has all worked for years, albeit with an always empty imapd.log > >There must be some missing cyrus syslog configuration. >On 29/11/2018 14:39, Dan White wrote: >> On 11/29/18?00:46?+0000, Charles Bradshaw wrote: >>>>> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: >>>>> to=, delay=00:00:00, xdelay=00:00:00, >>>>> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >>>>> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown From simon.matter at invoca.ch Thu Nov 29 12:55:44 2018 From: simon.matter at invoca.ch (Simon Matter) Date: Thu, 29 Nov 2018 18:55:44 +0100 Subject: suddenly 'User unknown'? In-Reply-To: <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> Message-ID: <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> > Dan > > I have, and have always had, an empty /var/log/imapd.log so I'm not > going to make progress until I fix that. > > In n /etc/rsyslog.conf > > # cyrus imapd > #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried this > first. > local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log > auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log > > and in /etc/imapd.conf > > syslog_prefix: cyrus > syslog_facility: LOCAL6 > > If I remove the file /etc/imapd.log then > > # /etc/init.d/rsyslog restart > > # logger local6.debug 'test log message' > > # cat /var/log/imapd.log > > Nov 29 15:06:42 dell2600-1 brad: test log message > > Obviously syslog is working local6. But still no messages from cyrus! > Therefor I'm now stuck with this secondary problem. > > I have followed the cyrus instructions as best I can, but no go. I say > again this has all worked for years, albeit with an always empty imapd.log > > There must be some missing cyrus syslog configuration. >From README.RPM in the cyrus-imapd package: 12) Check your syslog configuration. This RPM uses the mail facility to log messages. On busy sites you may want to limit the mail facility to the info priority with something like 'mail.info /var/log/maillog' in /etc/syslog.conf. So, I guess your cyrus-imapd messages go to /var/log/maillog then, not? Regards, Simon From charles.bradshaw at ntlworld.com Thu Nov 29 14:00:37 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Thu, 29 Nov 2018 19:00:37 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> Message-ID: Simon My original post contained a dump of /var/log/maillog, butwas asked by Dan "what does cyrus syslog say" so assumed there should be some more log messages somewhere. For the record I do: Clear /var/log/maillog then send a test email from the command line. Then /var/log/maillog contains: Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: from=brad, size=44, class=0, nrcpts=1, msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, relay=brad at localhost Nov 29 18:36:51 dell2600-1 sendmail[5068]: NOQUEUE: connect from localhost.localdomain [127.0.0.1] Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available mech=CRAM-MD5 DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgq005068: Milter: no active filter Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, relay=localhost.localdomain [127.0.0.1], version=TLSv1/SSLv3, verify=NO, cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, cert-subject=, cert-issuer=, verifymsg=ok Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available mech=CRAM-MD5 DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 Nov 29 18:36:51 dell2600-1 sendmail[5067]: STARTTLS=client, relay=[127.0.0.1], version=TLSv1/SSLv3, verify=FAIL, cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 Nov 29 18:36:51 dell2600-1 sendmail[5068]: ruleset=trust_auth, arg1=brad at bradcan.homelinux.com, relay=localhost.localdomain [127.0.0.1], reject=550 5.7.1 ... not authenticated Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgr005068: from=, size=358, class=0, nrcpts=1, msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, proto=ESMTP, daemon=MTA, relay=localhost.localdomain [127.0.0.1] Nov 29 18:36:51 dell2600-1 sendmail[5070]: AUTH=client, relay=localhost, mech=, bits=0 Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: to=, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User unknown Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: wATIapgq005070: DSN: User unknown Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), delay=00:00:00, xdelay=00:00:00, mailer=relay, pri=30044, relay=[127.0.0.1] [127.0.0.1], dsn=2.0.0, stat=Sent (wATIapgr005068 Message accepted for delivery) Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: to=, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown NOTE: The following is to be expected because both root and postmaster are aliased to brad at bradcan.homelinux.com Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias MAILER-DAEMON => postmaster Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias postmaster => root Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root => brad at bradcan.homelinux.com Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias postmaster => root Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root => brad at bradcan.homelinux.com Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: wATIapgr005070: return to sender: User unknown Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias MAILER-DAEMON => postmaster Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias postmaster => root Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias root => brad at bradcan.homelinux.com Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: done; delay=00:00:00, ntries=1 Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: Losing ./qfwATIapgq005070: savemail panic Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: SYSERR(root): savemail: cannot save rejected email anywhere Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: done; delay=00:00:00, ntries=1 Nov 29 18:36:52 dell2600-1 sendmail[5070]: wATIapgr005068: done; delay=00:00:01, ntries=1 That's the entire content. Now you tell me is cyrus syslog being sent to /var/log/maillog? Or should it be going to /var/imapd.log as the configuration files, man pages and cyrus installation guides ( found here: https://www.cyrusimap.org/imap/installing.html ) say it should? I originally asked for an explanation of the mechanism (IE. sequence of events) lmtp uses to decide stat = 'User unknown" or not. But I seem to be getting deeper and deeper into where the logs are going rather than understanding the process. On 29/11/2018 17:55, Simon Matter wrote: >> Dan >> >> I have, and have always had, an empty /var/log/imapd.log so I'm not >> going to make progress until I fix that. >> >> In n /etc/rsyslog.conf >> >> # cyrus imapd >> #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried this >> first. >> local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log >> auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log >> >> and in /etc/imapd.conf >> >> syslog_prefix: cyrus >> syslog_facility: LOCAL6 >> >> If I remove the file /etc/imapd.log then >> >> # /etc/init.d/rsyslog restart >> >> # logger local6.debug 'test log message' >> >> # cat /var/log/imapd.log >> >> Nov 29 15:06:42 dell2600-1 brad: test log message >> >> Obviously syslog is working local6. But still no messages from cyrus! >> Therefor I'm now stuck with this secondary problem. >> >> I have followed the cyrus instructions as best I can, but no go. I say >> again this has all worked for years, albeit with an always empty imapd.log >> >> There must be some missing cyrus syslog configuration. > From README.RPM in the cyrus-imapd package: > 12) Check your syslog configuration. This RPM uses the mail facility to log > messages. On busy sites you may want to limit the mail facility to the > info priority with something like 'mail.info /var/log/maillog' in > /etc/syslog.conf. > > So, I guess your cyrus-imapd messages go to /var/log/maillog then, not? > > Regards, > Simon > From charles.bradshaw at ntlworld.com Thu Nov 29 14:20:01 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Thu, 29 Nov 2018 19:20:01 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <20181129153207.GH20152@dan.olp.net> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <20181129153207.GH20152@dan.olp.net> Message-ID: <680c2498-a6b5-0f4e-fd3c-ff33cbbdae07@ntlworld.com> On 29/11/2018 15:32, Dan White wrote: > Do you otherwise see log entries for an imap connection? Where would I find these? Other than in /etc/imapd.log > > Is there a permissions problem on the lmtpunix mux > (/var/lib/imap/socket/lmtp)? Your syslog entry seems to indicate it is > communicating with cyrus, but perhaps I'm misreading it. # ls -lA /var/lib/imap/socket/lmtp srwxrwxrwx. 1 root root 0 Nov 29 14:38 /var/lib/imap/socket/lmtp > > Look up telemetry logging, and lmtptest for other ways to verify your > cyrus > config. You may need to temporarily enable lmtp on a TCP port to test. I did: [root at dell2600-1 brad]# ls -l /var/lib/imap/log total 0 [root at dell2600-1 brad]# mkdir /var/lib/imap/log/brad at bradcan.homelinux.com [root at dell2600-1 brad]# chown cyrus /var/lib/imap/log/brad at bradcan.homelinux.com [root at dell2600-1 brad]# ls -l /var/lib/imap/log/ total 4 drwxr-xr-x. 2 cyrus root 4096 Nov 29 16:51 brad at bradcan.homelinux.com then re-connect from another client on the network using Thunderbird Mail. I then see: [root at dell2600-1 brad]# ls -l /var/lib/imap/log/brad at bradcan.homelinux.com total 52 -rw-------. 1 cyrus mail 25990 Nov 29 16:59 imaps-4288 -rw-------. 1 cyrus mail 21539 Nov 29 17:07 imaps-4646 I think that's as expected? I looked at # man lmtptest, but I don't begin to understand! Not surprising since lmtptest seems to be a? debugging tool for developers, which I definitely ain't :-( Perhaps? you would be kind enough to post the specific lmtptest command I should use and the expected result. > > On 11/29/18?15:25?+0000, Charles Bradshaw wrote: >> I have, and have always had, an empty /var/log/imapd.log so I'm not >> going to make progress until I fix that. >> >> In n /etc/rsyslog.conf >> >> # cyrus imapd >> #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried this >> first. >> local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log >> auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log >> >> and in /etc/imapd.conf >> >> syslog_prefix: cyrus >> syslog_facility: LOCAL6 >> >> If I remove the file /etc/imapd.log then >> >> # /etc/init.d/rsyslog restart >> >> # logger local6.debug 'test log message' >> >> # cat /var/log/imapd.log >> >> Nov 29 15:06:42 dell2600-1 brad: test log message >> >> Obviously syslog is working local6. But still no messages from cyrus! >> Therefor I'm now stuck with this secondary problem. >> >> I have followed the cyrus instructions as best I can, but no go. I say >> again this has all worked for years, albeit with an always empty >> imapd.log >> >> There must be some missing cyrus syslog configuration. > >> On 29/11/2018 14:39, Dan White wrote: >>> On 11/29/18?00:46?+0000, Charles Bradshaw wrote: >>>>>> Nov 27 15:18:36 dell2600-1 sendmail[4801]: wARFIavg004801: >>>>>> to=, delay=00:00:00, xdelay=00:00:00, >>>>>> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >>>>>> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown From bshaw at vsvinc.com Thu Nov 29 14:34:47 2018 From: bshaw at vsvinc.com (Shaw, Brian) Date: Thu, 29 Nov 2018 14:34:47 -0500 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> Message-ID: <3a0f056a5d28633a353b130dce08a0a8@vsvinc.com> It looks like you may have some type of disk permissions issue. Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: Losing ./qfwATIapgq005070: savemail panic Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: SYSERR(root): savemail: cannot save rejected email anywhere This may be the cause of your "user unknown" error. Either way, you shouldn't have errors like this. Brian On 2018-11-29 2:00 pm, Charles Bradshaw via Info-cyrus wrote: > Simon > > My original post contained a dump of /var/log/maillog, butwas asked by > Dan "what does cyrus syslog say" so assumed there should be some more > log messages somewhere. > > For the record I do: Clear /var/log/maillog then send a test email from > the command line. Then /var/log/maillog contains: > > Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: from=brad, > size=44, class=0, nrcpts=1, > msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, > relay=brad at localhost > Nov 29 18:36:51 dell2600-1 sendmail[5068]: NOQUEUE: connect from > localhost.localdomain [127.0.0.1] > Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available > mech=CRAM-MD5 > DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 > Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgq005068: Milter: no > active filter > Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, > relay=localhost.localdomain [127.0.0.1], version=TLSv1/SSLv3, > verify=NO, > cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 > Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, > cert-subject=, cert-issuer=, verifymsg=ok > Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available > mech=CRAM-MD5 > DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 > Nov 29 18:36:51 dell2600-1 sendmail[5067]: STARTTLS=client, > relay=[127.0.0.1], version=TLSv1/SSLv3, verify=FAIL, > cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 > Nov 29 18:36:51 dell2600-1 sendmail[5068]: ruleset=trust_auth, > arg1=brad at bradcan.homelinux.com, relay=localhost.localdomain > [127.0.0.1], reject=550 5.7.1 ... not > authenticated > Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgr005068: > from=, size=358, class=0, nrcpts=1, > msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, proto=ESMTP, > daemon=MTA, relay=localhost.localdomain [127.0.0.1] > Nov 29 18:36:51 dell2600-1 sendmail[5070]: AUTH=client, > relay=localhost, > mech=, bits=0 > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: > to=, delay=00:00:00, xdelay=00:00:00, > mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User > unknown > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: > wATIapgq005070: DSN: User unknown > Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: > to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), delay=00:00:00, > xdelay=00:00:00, mailer=relay, pri=30044, relay=[127.0.0.1] > [127.0.0.1], > dsn=2.0.0, stat=Sent (wATIapgr005068 Message accepted for delivery) > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: > to=, delay=00:00:00, xdelay=00:00:00, > mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: > /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > > NOTE: The following is to be expected because both root and postmaster > are aliased to brad at bradcan.homelinux.com > > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias > MAILER-DAEMON => postmaster > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias > postmaster => root > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root > => > brad at bradcan.homelinux.com > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias > postmaster => root > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root > => > brad at bradcan.homelinux.com > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: > wATIapgr005070: return to sender: User unknown > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: > to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, > mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: > /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias > MAILER-DAEMON => postmaster > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias > postmaster => root > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias root > => > brad at bradcan.homelinux.com > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: done; > delay=00:00:00, ntries=1 > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: Losing > ./qfwATIapgq005070: savemail panic > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: > SYSERR(root): > savemail: cannot save rejected email anywhere > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: done; > delay=00:00:00, ntries=1 > Nov 29 18:36:52 dell2600-1 sendmail[5070]: wATIapgr005068: done; > delay=00:00:01, ntries=1 > > That's the entire content. > > Now you tell me is cyrus syslog being sent to /var/log/maillog? Or > should it be going to /var/imapd.log as the configuration files, man > pages and cyrus installation guides ( found here: > https://www.cyrusimap.org/imap/installing.html ) say it should? > > I originally asked for an explanation of the mechanism (IE. sequence of > events) lmtp uses to decide stat = 'User unknown" or not. But I seem to > be getting deeper and deeper into where the logs are going rather than > understanding the process. > > On 29/11/2018 17:55, Simon Matter wrote: >>> Dan >>> >>> I have, and have always had, an empty /var/log/imapd.log so I'm not >>> going to make progress until I fix that. >>> >>> In n /etc/rsyslog.conf >>> >>> # cyrus imapd >>> #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried >>> this >>> first. >>> local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log >>> auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log >>> >>> and in /etc/imapd.conf >>> >>> syslog_prefix: cyrus >>> syslog_facility: LOCAL6 >>> >>> If I remove the file /etc/imapd.log then >>> >>> # /etc/init.d/rsyslog restart >>> >>> # logger local6.debug 'test log message' >>> >>> # cat /var/log/imapd.log >>> >>> Nov 29 15:06:42 dell2600-1 brad: test log message >>> >>> Obviously syslog is working local6. But still no messages from cyrus! >>> Therefor I'm now stuck with this secondary problem. >>> >>> I have followed the cyrus instructions as best I can, but no go. I >>> say >>> again this has all worked for years, albeit with an always empty >>> imapd.log >>> >>> There must be some missing cyrus syslog configuration. >> From README.RPM in the cyrus-imapd package: >> 12) Check your syslog configuration. This RPM uses the mail facility >> to log >> messages. On busy sites you may want to limit the mail facility to >> the >> info priority with something like 'mail.info /var/log/maillog' >> in >> /etc/syslog.conf. >> >> So, I guess your cyrus-imapd messages go to /var/log/maillog then, >> not? >> >> Regards, >> Simon >> > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From charles.bradshaw at ntlworld.com Thu Nov 29 19:40:13 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Fri, 30 Nov 2018 00:40:13 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <3a0f056a5d28633a353b130dce08a0a8@vsvinc.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <3a0f056a5d28633a353b130dce08a0a8@vsvinc.com> Message-ID: <5789af76-9c16-d151-b204-f3e5b1901fc0@ntlworld.com> Brian On 29/11/2018 19:34, Shaw, Brian wrote: > ? It looks like you may have some type of disk permissions issue. > > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: Losing > ./qfwATIapgq005070: savemail panic > Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: SYSERR(root): > savemail: cannot save rejected email anywhere > > ? This may be the cause of your "user unknown" error.? Either way, you > shouldn't have errors like this. Nice idea but not true. The above lines follow from 'User unknown' because /etc/aliases contains: postmaster:??? root root:??? ??? brad at bradcan.homelinux.com So in event that brad at bradcan.homelinux.com is unknown? then so is root and postmaster. Therefore: 'savemail: cannot save rejected email anywhere' is to be expected. > > Brian > > On 2018-11-29 2:00 pm, Charles Bradshaw via Info-cyrus wrote: >> Simon >> >> My original post contained a dump of /var/log/maillog, butwas asked by >> Dan "what does cyrus syslog say" so assumed there should be some more >> log messages somewhere. >> >> For the record I do: Clear /var/log/maillog then send a test email from >> the command line. Then /var/log/maillog contains: >> >> Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: from=brad, >> size=44, class=0, nrcpts=1, >> msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, >> relay=brad at localhost >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: NOQUEUE: connect from >> localhost.localdomain [127.0.0.1] >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available mech=CRAM-MD5 >> DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgq005068: Milter: no >> active filter >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, >> relay=localhost.localdomain [127.0.0.1], version=TLSv1/SSLv3, verify=NO, >> cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: STARTTLS=server, >> cert-subject=, cert-issuer=, verifymsg=ok >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: AUTH: available mech=CRAM-MD5 >> DIGEST-MD5, allowed mech=EXTERNAL DIGEST-MD5 CRAM-MD5 >> Nov 29 18:36:51 dell2600-1 sendmail[5067]: STARTTLS=client, >> relay=[127.0.0.1], version=TLSv1/SSLv3, verify=FAIL, >> cipher=DHE-RSA-AES256-GCM-SHA384, bits=256/256 >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: ruleset=trust_auth, >> arg1=brad at bradcan.homelinux.com, relay=localhost.localdomain >> [127.0.0.1], reject=550 5.7.1 ... not >> authenticated >> Nov 29 18:36:51 dell2600-1 sendmail[5068]: wATIapgr005068: >> from=, size=358, class=0, nrcpts=1, >> msgid=<201811291836.wATIapoE005067 at bradcan.homelinux.com>, proto=ESMTP, >> daemon=MTA, relay=localhost.localdomain [127.0.0.1] >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: AUTH=client, relay=localhost, >> mech=, bits=0 >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: >> to=, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=120358, relay=localhost, dsn=5.1.1, stat=User >> unknown >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005068: >> wATIapgq005070: DSN: User unknown >> Nov 29 18:36:51 dell2600-1 sendmail[5067]: wATIapoE005067: >> to=brad at bradcan.homelinux.com, ctladdr=brad (500/500), delay=00:00:00, >> xdelay=00:00:00, mailer=relay, pri=30044, relay=[127.0.0.1] [127.0.0.1], >> dsn=2.0.0, stat=Sent (wATIapgr005068 Message accepted for delivery) >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: >> to=, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: >> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown >> >> NOTE: The following is to be expected because both root and postmaster >> are aliased to brad at bradcan.homelinux.com >> >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias >> MAILER-DAEMON => postmaster >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias >> postmaster => root >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root => >> brad at bradcan.homelinux.com >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias >> postmaster => root >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: alias root => >> brad at bradcan.homelinux.com >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: >> wATIapgr005070: return to sender: User unknown >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: >> to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: >> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias >> MAILER-DAEMON => postmaster >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias >> postmaster => root >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: alias root => >> brad at bradcan.homelinux.com >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgr005070: done; >> delay=00:00:00, ntries=1 >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: Losing >> ./qfwATIapgq005070: savemail panic >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: SYSERR(root): >> savemail: cannot save rejected email anywhere >> Nov 29 18:36:51 dell2600-1 sendmail[5070]: wATIapgq005070: done; >> delay=00:00:00, ntries=1 >> Nov 29 18:36:52 dell2600-1 sendmail[5070]: wATIapgr005068: done; >> delay=00:00:01, ntries=1 >> >> That's the entire content. >> >> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >> should it be going to /var/imapd.log as the configuration files, man >> pages and cyrus installation guides ( found here: >> https://www.cyrusimap.org/imap/installing.html ) say it should? >> >> I originally asked for an explanation of the mechanism (IE. sequence of >> events) lmtp uses to decide stat = 'User unknown" or not. But I seem to >> be getting deeper and deeper into where the logs are going rather than >> understanding the process. >> >> On 29/11/2018 17:55, Simon Matter wrote: >>>> Dan >>>> >>>> I have, and have always had, an empty /var/log/imapd.log so I'm not >>>> going to make progress until I fix that. >>>> >>>> In n /etc/rsyslog.conf >>>> >>>> # cyrus imapd >>>> #local6.* ?? ??? ??? ??? ?? ? ? ?? ??? /var/log/imapd.log?? - tried >>>> this >>>> first. >>>> local6.debug??? ??? ??? ??? ??? ??? /var/log/imapd.log >>>> auth.debug??? ??? ??? ??? ??? ? ? ? /var/log/auth.log >>>> >>>> and in /etc/imapd.conf >>>> >>>> syslog_prefix: cyrus >>>> syslog_facility: LOCAL6 >>>> >>>> If I remove the file /etc/imapd.log then >>>> >>>> # /etc/init.d/rsyslog restart >>>> >>>> # logger local6.debug 'test log message' >>>> >>>> # cat /var/log/imapd.log >>>> >>>> Nov 29 15:06:42 dell2600-1 brad: test log message >>>> >>>> Obviously syslog is working local6. But still no messages from cyrus! >>>> Therefor I'm now stuck with this secondary problem. >>>> >>>> I have followed the cyrus instructions as best I can, but no go. I say >>>> again this has all worked for years, albeit with an always empty >>>> imapd.log >>>> >>>> There must be some missing cyrus syslog configuration. >>> From README.RPM in the cyrus-imapd package: >>> 12) Check your syslog configuration. This RPM uses the mail facility >>> to log >>> ??? messages. On busy sites you may want to limit the mail facility >>> to the >>> ??? info priority with something like 'mail.info??? >>> /var/log/maillog' in >>> ??? /etc/syslog.conf. >>> >>> So, I guess your cyrus-imapd messages go to /var/log/maillog then, not? >>> >>> Regards, >>> Simon >>> >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From javier at jangulo.net Fri Nov 30 06:49:03 2018 From: javier at jangulo.net (Javier Angulo) Date: Fri, 30 Nov 2018 12:49:03 +0100 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> Message-ID: <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: > Now you tell me is cyrus syslog being sent to /var/log/maillog? Or > should it be going to /var/imapd.log as the configuration files, man > pages and cyrus installation guides ( found here: > https://www.cyrusimap.org/imap/installing.html ) say it should? I believe there is no "syslog_facility:" option in cyrus 2.4 (at least I was unable to find it). You can configure it in cyrus3 and maybe in cyrus 2.5. So in /etc/imapd.conf I would remove the syslog_facility line and set: syslog_prefix: cyrus And in /etc/rsyslog.conf: mail.* -/var/log/maillog Restart rsyslog and check logs for cyrus/something ... Cheers From charles.bradshaw at ntlworld.com Fri Nov 30 09:00:50 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Fri, 30 Nov 2018 14:00:50 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> Message-ID: Javier On 30/11/2018 11:49, Javier Angulo wrote: > On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: >> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >> should it be going to /var/imapd.log as the configuration files, man >> pages and cyrus installation guides ( found here: >> https://www.cyrusimap.org/imap/installing.html ) say it should? > I believe there is no "syslog_facility:" option in cyrus 2.4 (at least I > was unable to find it). You can configure it in cyrus3 and maybe in > cyrus 2.5. I removed syslog_facility from imapd.conf > So in /etc/imapd.conf I would remove the syslog_facility line and set: > syslog_prefix: cyrus Has no effect: present or not, or changed to test. > And in /etc/rsyslog.conf: > mail.* -/var/log/maillog Has always been in my rsyslog.conf > > Restart rsyslog and check logs for cyrus/something ... # /etc/init.d/rsyslog restart # service sendmail restart Now when I connect (from another host) using Thunderbird Mail I see in /etc/maillog: Nov 30 13:01:02 dell2600-1 sendmail[9865]: NOQUEUE: stopping daemon, reason=signal Nov 30 13:01:02 dell2600-1 sendmail[9950]: starting daemon (8.14.4): SMTP+queueing at 01:00:00 Nov 30 13:01:02 dell2600-1 sendmail[9950]: STARTTLS: CRLFile missing Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, Diffie-Hellman init, key=1024 bit (1) Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, init=1 Nov 30 13:01:03 dell2600-1 sendmail[9950]: started as: /usr/sbin/sendmail -bd -q1h Nov 30 13:01:03 dell2600-1 sm-msp-queue[9960]: starting daemon (8.14.4): queueing at 01:00:00 Nov 30 13:01:26 dell2600-1 cyrus/imaps[8645]: USAGE brad at bradcan.homelinux.com user: 0.141978 sys: 0.087986 Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: starttls: TLSv1.2 with cipher AES128-SHA (128/128 bits new) no authentication Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: login: [192.168.0.6] brad at bradcan.homelinux.com CRAM-MD5+TLS User logged in SESSIONID= Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: client id: "name" "Thunderbird" "version" "60.2.1" Hum.. cyrus/imaps sends logging to /etc/maillog I think it is absolutely clear: 1 - where cyrus syslog goes to is a red herring. It goes to, and has always gone to /var/maillog. It is simply that the prefix 'cyrus' only appears for cyrus imap transactions and other sendmail is labeled 'sendmail' 2 - imapd is working fine: allows brad.bradcan.homelinux.com to connect an email client. Also to move email from one mailbox to another. The proof is that since enabling telemetry logging /var/lib/imap/log/brad at bradcan.homelinux.com/ reflects imap transactions. 3 - A problem remains with LMTP. as is clearly evident from 'User unknown' appearing in maillog. My original question remains: How do I diagnose this when a test email is sent to brad at bradcan.homelinux.com : Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBS009882: to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown Thanks for your patience. > > Cheers > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From boutilpj at ednet.ns.ca Fri Nov 30 09:16:36 2018 From: boutilpj at ednet.ns.ca (Patrick Boutilier) Date: Fri, 30 Nov 2018 10:16:36 -0400 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> Message-ID: On 11/30/18 10:00 AM, Charles Bradshaw via Info-cyrus wrote: > Javier > > On 30/11/2018 11:49, Javier Angulo wrote: >> On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: >>> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >>> should it be going to /var/imapd.log as the configuration files, man >>> pages and cyrus installation guides ( found here: >>> https://www.cyrusimap.org/imap/installing.html ) say it should? >> I believe there is no "syslog_facility:" option in cyrus 2.4 (at least I >> was unable to find it). You can configure it in cyrus3 and maybe in >> cyrus 2.5. > I removed syslog_facility from imapd.conf >> So in /etc/imapd.conf I would remove the syslog_facility line and set: >> syslog_prefix: cyrus > Has no effect: present or not, or changed to test. >> And in /etc/rsyslog.conf: >> mail.* -/var/log/maillog > Has always been in my rsyslog.conf >> >> Restart rsyslog and check logs for cyrus/something ... > > # /etc/init.d/rsyslog restart > > # service sendmail restart > > Now when I connect (from another host) using Thunderbird Mail I see in > /etc/maillog: > > Nov 30 13:01:02 dell2600-1 sendmail[9865]: NOQUEUE: stopping daemon, > reason=signal > Nov 30 13:01:02 dell2600-1 sendmail[9950]: starting daemon (8.14.4): > SMTP+queueing at 01:00:00 > Nov 30 13:01:02 dell2600-1 sendmail[9950]: STARTTLS: CRLFile missing > Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, > Diffie-Hellman init, key=1024 bit (1) > Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, init=1 > Nov 30 13:01:03 dell2600-1 sendmail[9950]: started as: > /usr/sbin/sendmail -bd -q1h > Nov 30 13:01:03 dell2600-1 sm-msp-queue[9960]: starting daemon (8.14.4): > queueing at 01:00:00 > Nov 30 13:01:26 dell2600-1 cyrus/imaps[8645]: USAGE > brad at bradcan.homelinux.com user: 0.141978 sys: 0.087986 > Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: starttls: TLSv1.2 with > cipher AES128-SHA (128/128 bits new) no authentication > Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: login: [192.168.0.6] > brad at bradcan.homelinux.com CRAM-MD5+TLS User logged in > SESSIONID= > Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: client id: "name" > "Thunderbird" "version" "60.2.1" > > Hum.. cyrus/imaps sends logging to /etc/maillog > > I think it is absolutely clear: > > 1 - where cyrus syslog goes to is a red herring. It goes to, and has > always gone to /var/maillog. It is simply that the prefix 'cyrus' only > appears for cyrus imap transactions and other sendmail is labeled 'sendmail' > > 2 - imapd is working fine: allows brad.bradcan.homelinux.com to connect > an email client. Also to move email from one mailbox to another. The > proof is that since enabling telemetry logging > /var/lib/imap/log/brad at bradcan.homelinux.com/ reflects imap transactions. > > 3 - A problem remains with LMTP. as is clearly evident from 'User > unknown' appearing in maillog. > > My original question remains: How do I diagnose this when a test email > is sent to brad at bradcan.homelinux.com : > > Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBS009882: > to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, > mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: > /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown I think why people are concentrating on the logging is that there should be lmtp entries in your logs to indicate what the issue is. Are there any lmtp entries in either /etc/maillog or /var/log/maillog ? Another option is to limit lmtpd to one process and strace it. > > Thanks for your patience. > >> >> Cheers >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > -------------- next part -------------- A non-text attachment was scrubbed... Name: boutilpj.vcf Type: text/x-vcard Size: 286 bytes Desc: not available URL: From Eric.Luyten at vub.ac.be Fri Nov 30 09:30:21 2018 From: Eric.Luyten at vub.ac.be (Eric Luyten) Date: Fri, 30 Nov 2018 15:30:21 +0100 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> Message-ID: On 30/11/2018 15:16, Patrick Boutilier wrote: > On 11/30/18 10:00 AM, Charles Bradshaw via Info-cyrus wrote: >> Javier >> >> On 30/11/2018 11:49, Javier Angulo wrote: >>> On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: >>>> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >>>> should it be going to /var/imapd.log as the configuration files, man >>>> pages and cyrus installation guides ( found here: >>>> https://www.cyrusimap.org/imap/installing.html ) say it should? >>> I believe there is no "syslog_facility:" option in cyrus 2.4 (at >>> least I >>> was unable to find it). You can configure it in cyrus3 and maybe in >>> cyrus 2.5. >> I removed syslog_facility from imapd.conf >>> So in /etc/imapd.conf I would remove the syslog_facility line and set: >>> syslog_prefix: cyrus >> Has no effect: present or not, or changed to test. >>> And in /etc/rsyslog.conf: >>> mail.*?????? -/var/log/maillog >> Has always been in my rsyslog.conf >>> >>> Restart rsyslog and check logs for cyrus/something ... >> >> # /etc/init.d/rsyslog restart >> >> # service sendmail restart >> >> Now when I connect (from another host) using Thunderbird Mail I see in >> /etc/maillog: >> >> Nov 30 13:01:02 dell2600-1 sendmail[9865]: NOQUEUE: stopping daemon, >> reason=signal >> Nov 30 13:01:02 dell2600-1 sendmail[9950]: starting daemon (8.14.4): >> SMTP+queueing at 01:00:00 >> Nov 30 13:01:02 dell2600-1 sendmail[9950]: STARTTLS: CRLFile missing >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, >> Diffie-Hellman init, key=1024 bit (1) >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, init=1 >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: started as: >> /usr/sbin/sendmail -bd -q1h >> Nov 30 13:01:03 dell2600-1 sm-msp-queue[9960]: starting daemon (8.14.4): >> queueing at 01:00:00 >> Nov 30 13:01:26 dell2600-1 cyrus/imaps[8645]: USAGE >> brad at bradcan.homelinux.com user: 0.141978 sys: 0.087986 >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: starttls: TLSv1.2 with >> cipher AES128-SHA (128/128 bits new) no authentication >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: login: [192.168.0.6] >> brad at bradcan.homelinux.com CRAM-MD5+TLS User logged in >> SESSIONID= >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: client id: "name" >> "Thunderbird" "version" "60.2.1" >> >> Hum.. cyrus/imaps sends logging to /etc/maillog >> >> I think it is absolutely clear: >> >> 1 - where cyrus syslog goes to is a red herring. It goes to, and has >> always gone to /var/maillog. It is simply that the prefix 'cyrus' only >> appears for cyrus imap transactions and other sendmail is labeled >> 'sendmail' >> >> 2 - imapd is working fine: allows brad.bradcan.homelinux.com to connect >> an email client. Also to move email from one mailbox to another. The >> proof is that since enabling telemetry logging >> /var/lib/imap/log/brad at bradcan.homelinux.com/ reflects imap >> transactions. >> >> 3 - A problem remains with LMTP. as is clearly evident from 'User >> unknown' appearing in maillog. >> >> My original question remains: How do I diagnose this when a test email >> is sent to brad at bradcan.homelinux.com : >> >> Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBS009882: >> to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: >> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > > > I think why people are concentrating on the logging is that there > should be lmtp entries in your logs to indicate what the issue is. Are > there any lmtp entries in either /etc/maillog or /var/log/maillog ? > > > Another option is to limit lmtpd to one process and strace it. > > On our site we are not using Sendmail nor its cyrusv2 mailer but Postfix and an lmtp channel to the Cyrus service on a different server. This lmtp connection requires authentication using a specific "system" account, not the end user credentials. Mr Bradshaw, did someone at your site nuke that account or its password, not knowing what it was used for ? Eric Luyten, Computing Centre VUB/ULB. From javier at jangulo.net Fri Nov 30 09:51:33 2018 From: javier at jangulo.net (Javier Angulo) Date: Fri, 30 Nov 2018 15:51:33 +0100 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> Message-ID: <29e6fbd2-b8c3-e87d-a3b0-17035aaf11f7@jangulo.net> On 11/30/18 3:30 PM, Eric Luyten wrote: > > On 30/11/2018 15:16, Patrick Boutilier wrote: >> On 11/30/18 10:00 AM, Charles Bradshaw via Info-cyrus wrote: >>> Javier >>> >>> On 30/11/2018 11:49, Javier Angulo wrote: >>>> On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: >>>>> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >>>>> should it be going to /var/imapd.log as the configuration files, man >>>>> pages and cyrus installation guides ( found here: >>>>> https://www.cyrusimap.org/imap/installing.html ) say it should? >>>> I believe there is no "syslog_facility:" option in cyrus 2.4 (at >>>> least I >>>> was unable to find it). You can configure it in cyrus3 and maybe in >>>> cyrus 2.5. >>> I removed syslog_facility from imapd.conf >>>> So in /etc/imapd.conf I would remove the syslog_facility line and set: >>>> syslog_prefix: cyrus >>> Has no effect: present or not, or changed to test. >>>> And in /etc/rsyslog.conf: >>>> mail.*?????? -/var/log/maillog >>> Has always been in my rsyslog.conf >>>> >>>> Restart rsyslog and check logs for cyrus/something ... >>> >>> # /etc/init.d/rsyslog restart >>> >>> # service sendmail restart >>> >>> Now when I connect (from another host) using Thunderbird Mail I see in >>> /etc/maillog: >>> >>> Nov 30 13:01:02 dell2600-1 sendmail[9865]: NOQUEUE: stopping daemon, >>> reason=signal >>> Nov 30 13:01:02 dell2600-1 sendmail[9950]: starting daemon (8.14.4): >>> SMTP+queueing at 01:00:00 >>> Nov 30 13:01:02 dell2600-1 sendmail[9950]: STARTTLS: CRLFile missing >>> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, >>> Diffie-Hellman init, key=1024 bit (1) >>> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, init=1 >>> Nov 30 13:01:03 dell2600-1 sendmail[9950]: started as: >>> /usr/sbin/sendmail -bd -q1h >>> Nov 30 13:01:03 dell2600-1 sm-msp-queue[9960]: starting daemon (8.14.4): >>> queueing at 01:00:00 >>> Nov 30 13:01:26 dell2600-1 cyrus/imaps[8645]: USAGE >>> brad at bradcan.homelinux.com user: 0.141978 sys: 0.087986 >>> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: starttls: TLSv1.2 with >>> cipher AES128-SHA (128/128 bits new) no authentication >>> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: login: [192.168.0.6] >>> brad at bradcan.homelinux.com CRAM-MD5+TLS User logged in >>> SESSIONID= >>> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: client id: "name" >>> "Thunderbird" "version" "60.2.1" >>> >>> Hum.. cyrus/imaps sends logging to /etc/maillog >>> >>> I think it is absolutely clear: >>> >>> 1 - where cyrus syslog goes to is a red herring. It goes to, and has >>> always gone to /var/maillog. It is simply that the prefix 'cyrus' only >>> appears for cyrus imap transactions and other sendmail is labeled >>> 'sendmail' >>> >>> 2 - imapd is working fine: allows brad.bradcan.homelinux.com to connect >>> an email client. Also to move email from one mailbox to another. The >>> proof is that since enabling telemetry logging >>> /var/lib/imap/log/brad at bradcan.homelinux.com/ reflects imap >>> transactions. >>> >>> 3 - A problem remains with LMTP. as is clearly evident from 'User >>> unknown' appearing in maillog. >>> >>> My original question remains: How do I diagnose this when a test email >>> is sent to brad at bradcan.homelinux.com : >>> >>> Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBS009882: >>> to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, >>> mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: >>> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown >> >> >> I think why people are concentrating on the logging is that there >> should be lmtp entries in your logs to indicate what the issue is. Are >> there any lmtp entries in either /etc/maillog or /var/log/maillog ? >> >> >> Another option is to limit lmtpd to one process and strace it. >> >> > > On our site we are not using Sendmail nor its cyrusv2 mailer but Postfix > and an lmtp channel to the Cyrus service on a different server. > > This lmtp connection requires authentication using a specific "system" > account, not the end user credentials. > > > Mr Bradshaw, did someone at your site nuke that account or its password, > not knowing what it was used for ? > > > >From what sendmail show in the logs (550 5.1.1 User unknown) I would try this: In /etc/cyrus.conf, uncomment # lmtp cmd="lmtpd" listen="lmtp" prefork=0 Restart cyrus and telnet lmtp: telnet $myip 24 LHLO foo.bar MAIL FROM: RCPT TO: if lmtp does not find the user it will answer something like 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown Cheers From byrnejb at harte-lyne.ca Fri Nov 30 10:24:56 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Fri, 30 Nov 2018 10:24:56 -0500 Subject: IMAPD-3.0.8 on FreeBSD-11.2 unindexed messages in inbox Message-ID: <608137dd02511ab1386e1e328d2f73ee.squirrel@webmail.harte-lyne.ca> While investigating a problem I encountered a(nother) situation that I do not understand. I entered a user's root mailbox using cd and did 'ls -l *\.'. There are 245 files with names like '999\.' in this directory. My understanding is that this would up as 245 messages in the user's INBOX display. However, the user's INBOX only shows 36. There is is also a subfolder named 'INBOX^Trash' that is shown to contain 246 messages but which actually contains 14820. I am not familiar with IMAP3 and have only recently converted to it from imap2 running on a different host. It was during the conversion process that the existing .Trash/.Sent/.Drafts were replaced by INBOX^Trash/INBOX^Sent/INBOX^Drafts. So there may be something obvious that I do not know about. I speculate that this has something to do with the difference between delete and expunge but I would like to know for certain what is happening if someone would explain it to me. Thanks -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From charles.bradshaw at ntlworld.com Fri Nov 30 10:34:12 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Fri, 30 Nov 2018 15:34:12 +0000 Subject: suddenly 'User unknown'? In-Reply-To: References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> Message-ID: <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> Patrick, Javier, at last progress. Brilliant. :-) See below. On 30/11/2018 14:16, Patrick Boutilier wrote: > On 11/30/18 10:00 AM, Charles Bradshaw via Info-cyrus wrote: >> Javier >> >> On 30/11/2018 11:49, Javier Angulo wrote: >>> On 11/29/18 8:00 PM, Charles Bradshaw via Info-cyrus wrote: >>>> Now you tell me is cyrus syslog being sent to /var/log/maillog? Or >>>> should it be going to /var/imapd.log as the configuration files, man >>>> pages and cyrus installation guides ( found here: >>>> https://www.cyrusimap.org/imap/installing.html ) say it should? >>> I believe there is no "syslog_facility:" option in cyrus 2.4 (at >>> least I >>> was unable to find it). You can configure it in cyrus3 and maybe in >>> cyrus 2.5. >> I removed syslog_facility from imapd.conf >>> So in /etc/imapd.conf I would remove the syslog_facility line and set: >>> syslog_prefix: cyrus >> Has no effect: present or not, or changed to test. >>> And in /etc/rsyslog.conf: >>> mail.*?????? -/var/log/maillog >> Has always been in my rsyslog.conf >>> >>> Restart rsyslog and check logs for cyrus/something ... >> >> # /etc/init.d/rsyslog restart >> >> # service sendmail restart >> >> Now when I connect (from another host) using Thunderbird Mail I see in >> /etc/maillog: >> >> Nov 30 13:01:02 dell2600-1 sendmail[9865]: NOQUEUE: stopping daemon, >> reason=signal >> Nov 30 13:01:02 dell2600-1 sendmail[9950]: starting daemon (8.14.4): >> SMTP+queueing at 01:00:00 >> Nov 30 13:01:02 dell2600-1 sendmail[9950]: STARTTLS: CRLFile missing >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, >> Diffie-Hellman init, key=1024 bit (1) >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: STARTTLS=server, init=1 >> Nov 30 13:01:03 dell2600-1 sendmail[9950]: started as: >> /usr/sbin/sendmail -bd -q1h >> Nov 30 13:01:03 dell2600-1 sm-msp-queue[9960]: starting daemon (8.14.4): >> queueing at 01:00:00 >> Nov 30 13:01:26 dell2600-1 cyrus/imaps[8645]: USAGE >> brad at bradcan.homelinux.com user: 0.141978 sys: 0.087986 >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: starttls: TLSv1.2 with >> cipher AES128-SHA (128/128 bits new) no authentication >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: login: [192.168.0.6] >> brad at bradcan.homelinux.com CRAM-MD5+TLS User logged in >> SESSIONID= >> Nov 30 13:05:59 dell2600-1 cyrus/imaps[8743]: client id: "name" >> "Thunderbird" "version" "60.2.1" >> >> Hum.. cyrus/imaps sends logging to /etc/maillog >> >> I think it is absolutely clear: >> >> 1 - where cyrus syslog goes to is a red herring. It goes to, and has >> always gone to /var/maillog. It is simply that the prefix 'cyrus' only >> appears for cyrus imap transactions and other sendmail is labeled >> 'sendmail' >> >> 2 - imapd is working fine: allows brad.bradcan.homelinux.com to connect >> an email client. Also to move email from one mailbox to another. The >> proof is that since enabling telemetry logging >> /var/lib/imap/log/brad at bradcan.homelinux.com/ reflects imap >> transactions. >> >> 3 - A problem remains with LMTP. as is clearly evident from 'User >> unknown' appearing in maillog. >> >> My original question remains: How do I diagnose this when a test email >> is sent to brad at bradcan.homelinux.com : >> >> Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBS009882: >> to=brad at bradcan.homelinux.com, delay=00:00:00, xdelay=00:00:00, >> mailer=cyrusv2, pri=32701, relay=localhost [[UNIX: >> /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > > > I think why people are concentrating on the logging is that there > should be lmtp entries in your logs to indicate what the issue is. Are > there any lmtp entries in either /etc/maillog or /var/log/maillog ? The only lmtp entries are the one shown above. I do # cat /var/log/maillog | grep lmtp Nov 30 12:59:48 dell2600-1 sendmail[9882]: wAUCxmBR009882: to=, delay=00:00:00, xdelay=00:00:00, mailer=cyrusv2, pri=31677, relay=localhost [[UNIX: /var/lib/imap/socket/lmtp]], dsn=5.1.1, stat=User unknown > > > Another option is to limit lmtpd to one process and strace it. If I do: [root at dell2600-1 brad]# ps -A | grep lmtp 10146 ???????? 00:00:00 lmtpd [root at dell2600-1 brad]# strace -p 10146 Process 10146 attached accept(4, 0, NULL)????????????????????? = 11 fcntl64(10, F_SETLKW, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 alarm(0)??????????????????????????????? = 0 write(3, "\2\0\0\0\242'\0\0", 8)??????? = 8 dup2(11, 0)???????????????????????????? = 0 dup2(11, 1)???????????????????????????? = 1 dup2(11, 2)???????????????????????????? = 2 close(11)?????????????????????????????? = 0 write(3, "\3\0\0\0\242'\0\0", 8)??????? = 8 time(NULL)????????????????????????????? = 1543588732 getpeername(0, {sa_family=AF_LOCAL, NULL}, [2]) = 0 open("/var/lib/imap/log/postman/lmtpunix-10146", O_WRONLY|O_CREAT|O_APPEND, 0644) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "220 dell2600-1.bradcan.homelinux"..., 94) = 94 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999704}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "LHLO bradcan.homelinux.com\r\n", 4096) = 28 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250-dell2600-1.bradcan.homelinux"..., 139) = 139 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 997839}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "MAIL From:\r\nDATA\r\n", 4096) = 22 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) fcntl64(6, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 fstat64(6, {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 stat64("/var/lib/imap/mailboxes.db", {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 fcntl64(6, F_SETLKW, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "550-Mailbox unknown.? Either the"..., 174) = 174 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999990}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "RSET\r\n", 4096)?????????????? = 6 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250 2.0.0 ok SESSIONID= SIZE=1677\r\n", 4096) = 24 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250 2.1.0 ok\r\n", 14)??????? = 14 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999524}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "RCPT To:\r\nDATA\r\n", 4096) = 22 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) fcntl64(6, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 fstat64(6, {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 stat64("/var/lib/imap/mailboxes.db", {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 fcntl64(6, F_SETLKW, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "550-Mailbox unknown.? Either the"..., 174) = 174 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999612}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "RSET\r\n", 4096)?????????????? = 6 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250 2.0.0 ok SESSIONID= SIZE=2701\r\n", 4096) = 24 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250 2.1.0 ok\r\n", 14)??????? = 14 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999927}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "RCPT To:\r\nDATA\r\n", 4096) = 22 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) fcntl64(6, F_SETLKW, {type=F_RDLCK, whence=SEEK_SET, start=0, len=0}) = 0 fstat64(6, {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 stat64("/var/lib/imap/mailboxes.db", {st_mode=S_IFREG|0600, st_size=22204, ...}) = 0 fcntl64(6, F_SETLKW, {type=F_UNLCK, whence=SEEK_SET, start=0, len=0}) = 0 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "550-Mailbox unknown.? Either the"..., 174) = 174 time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {360, 0})??? = 1 (in [0], left {359, 999987}) time(NULL)????????????????????????????? = 1543588732 time(NULL)????????????????????????????? = 1543588732 read(0, "RSET\r\n", 4096)?????????????? = 6 open("/var/lib/imap/msg/shutdown", O_RDONLY) = -1 ENOENT (No such file or directory) time(NULL)????????????????????????????? = 1543588732 select(1, [0], NULL, NULL, {0, 0})????? = 0 (Timeout) write(1, "250 2.0.0 ok SESSIONID=1543590287>220 dell2600-1.bradcan.homelinux.com Cyrus LMTP v2.4.17-Invoca-RPM-2.4.17-7.el6 server ready <15435902871543590287>250-dell2600-1.bradcan.homelinux.com 250-8BITMIME 250-ENHANCEDSTATUSCODES 250-PIPELINING 250-SIZE 250-AUTH EXTERNAL 250 IGNOREQUOTA <1543590287 SIZE=653 >1543590287>250 2.1.0 ok <1543590287 DATA >1543590287>550-Mailbox unknown.? Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown ... Now I'm guessing, since user brad at bradcan.homelinux.com does exist and is working then it must be authorization. So why is authorization failing after years of working? How do I test authorization? > > > > > > >> >> Thanks for your patience. >> >>> >>> Cheers >>> ---- >>> Cyrus Home Page: http://www.cyrusimap.org/ >>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From letters001 at sendmaid.org Fri Nov 30 10:48:58 2018 From: letters001 at sendmaid.org (Edda) Date: Fri, 30 Nov 2018 16:48:58 +0100 Subject: suddenly 'User unknown'? In-Reply-To: <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> Message-ID: <15566cca-2c0c-263e-c806-a61eeff8c816@sendmaid.org> Not a cyrus issue. Apparently sendmail strips the domain as you see in lines like "RCPT To:" Your cyrusv2 Mailer in sendmail.mc seems correct to me. What do you get from (you can skip all the line for user root) sendmail -d21.1 -bv brad at bradcan.homelinux.com Greets, Edda Am 30.11.18 um 16:34 schrieb Charles Bradshaw via Info-cyrus: > > Patrick, Javier, at last progress. Brilliant. :-) See below. > > [root at dell2600-1 brad]# strace -p 10146 > > [...] > read(0, "RCPT To:\r\nDATA\r\n", 4096) = 22 > [...] > +++ exited with 0 +++ > > I don't understand the above! Except there are a number of lines like: > > open("/var/lib/imap/log/postman/lmtpunix-10146", > O_WRONLY|O_CREAT|O_APPEND, 0644) = -1 ENOENT (No such file or directory) > > Does any of the above explain 'User unknown', apart from fact that > lmtp quit with SIGALRM > > ?I created /var/lib/imap/log/postman then when the test email is sent > /var/lib/imap/log/postman contains this message: > > ---------- postman Fri Nov 30 15:04:47 2018 > > >1543590287>220 dell2600-1.bradcan.homelinux.com Cyrus LMTP > v2.4.17-Invoca-RPM-2.4.17-7.el6 server ready > <1543590287 >1543590287>250-dell2600-1.bradcan.homelinux.com > 250-8BITMIME > 250-ENHANCEDSTATUSCODES > 250-PIPELINING > 250-SIZE > 250-AUTH EXTERNAL > 250 IGNOREQUOTA > <1543590287 SIZE=653 > >1543590287>250 2.1.0 ok > <1543590287 > DATA > >1543590287>550-Mailbox unknown.? Either there is no mailbox > associated with this > 550-name or you do not have authorization to see it. > 550 5.1.1 User unknown > ... > > Now I'm guessing, since user brad at bradcan.homelinux.com does exist and > is working then it must be authorization. > > So why is authorization failing after years of working? How do I test > authorization? > > From charles.bradshaw at ntlworld.com Fri Nov 30 11:02:37 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Fri, 30 Nov 2018 16:02:37 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> Message-ID: <0fde7f7e-c5f7-2a86-1371-7d4d259ef234@ntlworld.com> Is my TLS configuration correct? /etc/imapd.conf contains: tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt tls_cipher_list: TLSv1:SSLv3:!NULL:!EXPORT:!DES:!LOW:@STRENGTH Files exist: [root at dell2600-1 brad]# ls -l /etc/pki/cyrus-imapd/cyrus-imapd.pem -rw-r-----. 1 root mail 3242 Apr 12? 2014 /etc/pki/cyrus-imapd/cyrus-imapd.pem [root at dell2600-1 brad]# ls -l /etc/pki/tls/certs/ca-bundle.crt -rw-r--r--. 1 root root 754217 Feb 28? 2018 /etc/pki/tls/certs/ca-bundle.crt Is the tls_cipher_list still valid?? CUT: From charles.bradshaw at ntlworld.com Fri Nov 30 11:34:24 2018 From: charles.bradshaw at ntlworld.com (Charles Bradshaw) Date: Fri, 30 Nov 2018 16:34:24 +0000 Subject: suddenly 'User unknown'? In-Reply-To: <15566cca-2c0c-263e-c806-a61eeff8c816@sendmaid.org> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> <15566cca-2c0c-263e-c806-a61eeff8c816@sendmaid.org> Message-ID: <70ab7724-c73a-3462-b282-7cbfb80d542a@ntlworld.com> Edda, On 30/11/2018 15:48, Edda wrote: > Not a cyrus issue. Apparently sendmail strips the domain as you see in > lines like "RCPT To:" > > Your cyrusv2 Mailer in sendmail.mc seems correct to me. > > What do you get from (you can skip all the line for user root) > > sendmail -d21.1 -bv brad at bradcan.homelinux.com as brad: [brad at dell2600-1 ~]$ sendmail -d21.1 -bv brad at bradcan.homelinux.com Notice: -bv may give misleading output for non-privileged user can not chdir(/var/spool/mqueue/): Permission denied Program mode requires special privileges, e.g., root or TrustedUser. How do I setup TrustUser? but as root: [root at dell2600-1 brad]# sendmail -d21.1 -bv brad at bradcan.homelinux.com rewrite: ruleset canonify?????????? input: brad rewrite: ruleset Canonify2????????? input: brad rewrite: ruleset Canonify2??????? returns: brad rewrite: ruleset canonify???????? returns: brad rewrite: ruleset parse????????????? input: brad rewrite: ruleset Parse0???????????? input: brad rewrite: ruleset Parse0?????????? returns: brad rewrite: ruleset ParseLocal???????? input: brad rewrite: ruleset ParseLocal?????? returns: brad rewrite: ruleset Parse1???????????? input: brad rewrite: ruleset Parse1?????????? returns: $# cyrusv2 $: brad rewrite: ruleset parse??????????? returns: $# cyrusv2 $: brad rewrite: ruleset 2????????????????? input: brad rewrite: ruleset 2??????????????? returns: brad rewrite: ruleset EnvToSMT?????????? input: brad rewrite: ruleset EnvToSMT???????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad rewrite: ruleset canonify?????????? input: brad rewrite: ruleset Canonify2????????? input: brad rewrite: ruleset Canonify2??????? returns: brad rewrite: ruleset canonify???????? returns: brad rewrite: ruleset 1????????????????? input: brad rewrite: ruleset 1??????????????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad rewrite: ruleset canonify?????????? input: brad @ bradcan . homelinux . com rewrite: ruleset Canonify2????????? input: brad < @ bradcan . homelinux . com > rewrite: ruleset Canonify2??????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset canonify???????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset parse????????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse0???????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse0?????????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset ParseLocal???????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset ParseLocal?????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse1???????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse1?????????? returns: $# cyrusv2 $: brad rewrite: ruleset parse??????????? returns: $# cyrusv2 $: brad rewrite: ruleset 2????????????????? input: brad rewrite: ruleset 2??????????????? returns: brad rewrite: ruleset EnvToSMT?????????? input: brad rewrite: ruleset EnvToSMT???????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad brad at bradcan.homelinux.com... deliverable: mailer cyrusv2, user brad [root at dell2600-1 brad]# sendmail -d21.1 -bv brad at bradcan.homelinux.com rewrite: ruleset canonify?????????? input: brad rewrite: ruleset Canonify2????????? input: brad rewrite: ruleset Canonify2??????? returns: brad rewrite: ruleset canonify???????? returns: brad rewrite: ruleset parse????????????? input: brad rewrite: ruleset Parse0???????????? input: brad rewrite: ruleset Parse0?????????? returns: brad rewrite: ruleset ParseLocal???????? input: brad rewrite: ruleset ParseLocal?????? returns: brad rewrite: ruleset Parse1???????????? input: brad rewrite: ruleset Parse1?????????? returns: $# cyrusv2 $: brad rewrite: ruleset parse??????????? returns: $# cyrusv2 $: brad rewrite: ruleset 2????????????????? input: brad rewrite: ruleset 2??????????????? returns: brad rewrite: ruleset EnvToSMT?????????? input: brad rewrite: ruleset EnvToSMT???????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad rewrite: ruleset canonify?????????? input: brad rewrite: ruleset Canonify2????????? input: brad rewrite: ruleset Canonify2??????? returns: brad rewrite: ruleset canonify???????? returns: brad rewrite: ruleset 1????????????????? input: brad rewrite: ruleset 1??????????????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad rewrite: ruleset canonify?????????? input: brad @ bradcan . homelinux . com rewrite: ruleset Canonify2????????? input: brad < @ bradcan . homelinux . com > rewrite: ruleset Canonify2??????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset canonify???????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset parse????????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse0???????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse0?????????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset ParseLocal???????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset ParseLocal?????? returns: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse1???????????? input: brad < @ bradcan . homelinux . com . > rewrite: ruleset Parse1?????????? returns: $# cyrusv2 $: brad rewrite: ruleset parse??????????? returns: $# cyrusv2 $: brad rewrite: ruleset 2????????????????? input: brad rewrite: ruleset 2??????????????? returns: brad rewrite: ruleset EnvToSMT?????????? input: brad rewrite: ruleset EnvToSMT???????? returns: brad rewrite: ruleset final????????????? input: brad rewrite: ruleset final??????????? returns: brad brad at bradcan.homelinux.com... deliverable: mailer cyrusv2, user brad But as root: [root at dell2600-1 brad]# sendmail brad at bradcan.homelinux.com < email.txt Still reports 'User unknown' in /etc/maillog > > Greets, > Edda > > Am 30.11.18 um 16:34 schrieb Charles Bradshaw via Info-cyrus: >> >> Patrick, Javier, at last progress. Brilliant. :-) See below. >> >> [root at dell2600-1 brad]# strace -p 10146 >> >> > [...] >> read(0, "RCPT To:\r\nDATA\r\n", 4096) = 22 >> > [...] >> +++ exited with 0 +++ >> >> I don't understand the above! Except there are a number of lines like: >> >> open("/var/lib/imap/log/postman/lmtpunix-10146", >> O_WRONLY|O_CREAT|O_APPEND, 0644) = -1 ENOENT (No such file or directory) >> >> Does any of the above explain 'User unknown', apart from fact that >> lmtp quit with SIGALRM >> >> ?I created /var/lib/imap/log/postman then when the test email is sent >> /var/lib/imap/log/postman contains this message: >> >> ---------- postman Fri Nov 30 15:04:47 2018 >> >> >1543590287>220 dell2600-1.bradcan.homelinux.com Cyrus LMTP >> v2.4.17-Invoca-RPM-2.4.17-7.el6 server ready >> <1543590287> >1543590287>250-dell2600-1.bradcan.homelinux.com >> 250-8BITMIME >> 250-ENHANCEDSTATUSCODES >> 250-PIPELINING >> 250-SIZE >> 250-AUTH EXTERNAL >> 250 IGNOREQUOTA >> <1543590287 SIZE=653 >> >1543590287>250 2.1.0 ok >> <1543590287 >> DATA >> >1543590287>550-Mailbox unknown.? Either there is no mailbox >> associated with this >> 550-name or you do not have authorization to see it. >> 550 5.1.1 User unknown >> ... >> >> Now I'm guessing, since user brad at bradcan.homelinux.com does exist >> and is working then it must be authorization. >> >> So why is authorization failing after years of working? How do I test >> authorization? >> >> > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From boutilpj at ednet.ns.ca Fri Nov 30 12:35:28 2018 From: boutilpj at ednet.ns.ca (Patrick Boutilier) Date: Fri, 30 Nov 2018 13:35:28 -0400 Subject: IMAPD-3.0.8 on FreeBSD-11.2 unindexed messages in inbox In-Reply-To: <608137dd02511ab1386e1e328d2f73ee.squirrel@webmail.harte-lyne.ca> References: <608137dd02511ab1386e1e328d2f73ee.squirrel@webmail.harte-lyne.ca> Message-ID: <577ba82d-14e4-95ab-2d5b-f5e62fcc7346@ednet.ns.ca> On 11/30/18 11:24 AM, James B. Byrne via Info-cyrus wrote: > While investigating a problem I encountered a(nother) situation that I > do not understand. > > I entered a user's root mailbox using cd and did 'ls -l *\.'. There > are 245 files with names like '999\.' in this directory. My > understanding is that this would up as 245 messages in the user's > INBOX display. However, the user's INBOX only shows 36. > > There is is also a subfolder named 'INBOX^Trash' that is shown to > contain 246 messages but which actually contains 14820. > > I am not familiar with IMAP3 and have only recently converted to it > from imap2 running on a different host. It was during the conversion > process that the existing .Trash/.Sent/.Drafts were replaced by > INBOX^Trash/INBOX^Sent/INBOX^Drafts. So there may be something > obvious that I do not know about. > > I speculate that this has something to do with the difference between > delete and expunge but I would like to know for certain what is > happening if someone would explain it to me. Most likely delayed expunge. Does this show 209? unexpunge -l user.realuserid |grep UID|wc -l > > Thanks > -------------- next part -------------- A non-text attachment was scrubbed... Name: boutilpj.vcf Type: text/x-vcard Size: 286 bytes Desc: not available URL: From letters001 at sendmaid.org Fri Nov 30 12:36:55 2018 From: letters001 at sendmaid.org (Edda) Date: Fri, 30 Nov 2018 18:36:55 +0100 Subject: suddenly 'User unknown'? In-Reply-To: <70ab7724-c73a-3462-b282-7cbfb80d542a@ntlworld.com> References: <10a3d609-11b2-e714-fc6b-e4893119d998@ntlworld.com> <20181128161203.GB20152@dan.olp.net> <28dd4fb1-74e6-41da-ae0d-24a076aa2a2e@ntlworld.com> <20181129143913.GE20152@dan.olp.net> <33c227e8-6f77-6669-eca1-3f3c7516d1cd@ntlworld.com> <43b420d0b1727118d29460b4082686a1.squirrel@webmail.bi.invoca.ch> <9fbd7a4d-3569-94c1-2ed8-fce5bca12c4b@jangulo.net> <3c52506c-a01b-b05f-db97-eb0c4228cc23@ntlworld.com> <15566cca-2c0c-263e-c806-a61eeff8c816@sendmaid.org> <70ab7724-c73a-3462-b282-7cbfb80d542a@ntlworld.com> Message-ID: Am 30.11.18 um 17:34 schrieb Charles Bradshaw: > Edda, > > On 30/11/2018 15:48, Edda wrote: >> Not a cyrus issue. Apparently sendmail strips the domain as you see in >> lines like "RCPT To:" >> >> Your cyrusv2 Mailer in sendmail.mc seems correct to me. >> >> What do you get from (you can skip all the line for user root) >> >> sendmail -d21.1 -bv brad at bradcan.homelinux.com > as brad: > > [brad at dell2600-1 ~]$ sendmail -d21.1 -bv brad at bradcan.homelinux.com > Notice: -bv may give misleading output for non-privileged user > can not chdir(/var/spool/mqueue/): Permission denied > Program mode requires special privileges, e.g., root or TrustedUser. > > How do I setup TrustUser? The message is a bit missleading. You can't just add a TrustedUser to sendmail and run this test. You would have to change all privileges.... It's absolutely ok to check the daemon as root. > > but as root: > > [root at dell2600-1 brad]# sendmail -d21.1 -bv brad at bradcan.homelinux.com > > [...] > . com . > > rewrite: ruleset Parse1???????????? input: brad < @ bradcan . homelinux > . com . > > rewrite: ruleset Parse1?????????? returns: $# cyrusv2 $: brad > rewrite: ruleset parse??????????? returns: $# cyrusv2 $: brad > rewrite: ruleset 2????????????????? input: brad > rewrite: ruleset 2??????????????? returns: brad > rewrite: ruleset EnvToSMT?????????? input: brad > rewrite: ruleset EnvToSMT???????? returns: brad > rewrite: ruleset final????????????? input: brad > rewrite: ruleset final??????????? returns: brad > brad at bradcan.homelinux.com... deliverable: mailer cyrusv2, user brad The Parse1 ruleset considers brad at bradcan.homeliniux.com as a local machine's user (Class $=w in sendmail). Therefore it strips the domain. You can check $=w like this: sendmail -C sendmail.cf -bt > $=w localhost [127.0.0.1] dell2600-1.bradcan.homelinux.com [...] >/quit Look for bradcan.homelinux.com Do you have an entry for bradcan.homelinux.com in /etc/hosts? Then you can simply delete it. Edda From byrnejb at harte-lyne.ca Fri Nov 30 13:16:03 2018 From: byrnejb at harte-lyne.ca (James B. Byrne) Date: Fri, 30 Nov 2018 13:16:03 -0500 Subject: IMAPD-3.0.8 on FreeBSD-11.2 unindexed messages in inbox In-Reply-To: <577ba82d-14e4-95ab-2d5b-f5e62fcc7346@ednet.ns.ca> References: <608137dd02511ab1386e1e328d2f73ee.squirrel@webmail.harte-lyne.ca> <577ba82d-14e4-95ab-2d5b-f5e62fcc7346@ednet.ns.ca> Message-ID: <520e6510275e80f75595c0fd5d1f3782.squirrel@webmail.harte-lyne.ca> On Fri, November 30, 2018 12:35, Patrick Boutilier wrote: > > > Most likely delayed expunge. Does this show 209? > > unexpunge -l user.realuserid |grep UID|wc -l > Yes it does. Thanks. -- *** e-Mail is NOT a SECURE channel *** Do NOT transmit sensitive data via e-Mail Do NOT open attachments nor follow links sent by e-Mail James B. Byrne mailto:ByrneJB at Harte-Lyne.ca Harte & Lyne Limited http://www.harte-lyne.ca 9 Brockley Drive vox: +1 905 561 1241 Hamilton, Ontario fax: +1 905 561 0757 Canada L8E 3C3 From brennan at columbia.edu Fri Nov 30 15:06:29 2018 From: brennan at columbia.edu (Joseph Brennan) Date: Fri, 30 Nov 2018 15:06:29 -0500 Subject: Thunderbird's color labels Message-ID: I am trying to find where cyrus imap stores the colors Thunderbird uses in the message index display. I thought they were probably custom flags and I could use mbexamine to find them. I have a mailbox that has this in the first stanza from mbexamine, which looked promising-- User Flags: $label1 $label2 $label3 $label4 $label5 $Forwarded Redirected Each message has a line with "> USERFLAGS" but those are mostly four groups of zeros, and the values do not correspond to the Tbird colors. What else can I try? -- Joseph Brennan Lead, Email and Systems Applications -------------- next part -------------- An HTML attachment was scrubbed... URL: