From matt.s at aptalaska.net Sat Feb 1 21:35:33 2020 From: matt.s at aptalaska.net (Matthew Schumacher) Date: Sat, 1 Feb 2020 18:35:33 -0800 Subject: Unable to subscribe to folders. Message-ID: <42812_1580610940_0122ZbwZ076521_adfac391-ded2-300a-d01c-006e698d3dc8@aptalaska.net> List, Anyone see this before?? For some reason I simply can't subscribe to my folders.? Looking at it from the protocol level: a list (subscribed) "" "*" returns ..... * LIST (\Subscribed \HasNoChildren) "/" Vendors/Tools * LIST (\Subscribed \HasNoChildren) "/" Vendors/Travel * LIST (\Subscribed \HasNoChildren) "/" cron a list "" "*" returns ..... * LIST (\HasNoChildren) "/" Vendors/Tools * LIST (\HasNoChildren) "/" Vendors/Travel * LIST (\HasNoChildren) "/" cron * LIST (\HasNoChildren) "/" fred So then I: a subscribe "fred" and get: a OK Completed But then my folder is still not subscribed to.? Like above. a list (subscribed) "" "*" returns ..... * LIST (\Subscribed \HasNoChildren) "/" Vendors/Tools * LIST (\Subscribed \HasNoChildren) "/" Vendors/Travel * LIST (\Subscribed \HasNoChildren) "/" cron It does the same thing with cyradm: localhost> lm fred fred (\HasNoChildren) localhost> sub fred localhost> lm fred fred (\HasNoChildren) localhost> lm Vendors/Travel Vendors/Travel (\Subscribed \HasNoChildren) Even my sub file shows I'm subscribed: grep fred /var/spool/imap/user/s/schu.sub user.schu.fred Anyone know what to look at next? Thanks, schu From zorg at probesys.com Sun Feb 2 15:09:48 2020 From: zorg at probesys.com (Zorg) Date: Sun, 2 Feb 2020 21:09:48 +0100 Subject: Create calendar as admin and set the displayname Message-ID: <074e419d-d503-c5ef-2b92-19dfb5edce87@probesys.com> Hi Let me explain. I want my admin to create the calendar for myuser (setting the displayname and the supported-calendar-component-set) For example myadmin at my.domain.com create user/myuser1/#calendars/Default using file mkcal.xml : ?? ???? ?????? ???????? My super calendar ???????? Mon calendrier ???????? ??????????? ???????? ?????? ???? ?? curl -v --user myadmin at my.domain.com :12341234 --header "Content-Type: text/xml"? -d @mkcal.xml -X MKCALENDAR http://192.168.45.42:8008/dav/calendars/user/myuser1 at mydomain.com/Default but if myuser connect the calendar is create but hte displayname and the supported-calendar-component-set and not set the admin see everything ok (the displayname and the supported-calendar-component-set) does it the way it should work ? and is there a way to set displayname and the supported-calendar-component-set for everyone the same ? Thanks From Hagedorn at uni-koeln.de Mon Feb 3 07:02:48 2020 From: Hagedorn at uni-koeln.de (Sebastian Hagedorn) Date: Mon, 3 Feb 2020 13:02:48 +0100 Subject: Unable to subscribe to folders. In-Reply-To: <42812_1580610940_0122ZbwZ076521_adfac391-ded2-300a-d01c-006e698d3dc8@aptalaska.net> References: <42812_1580610940_0122ZbwZ076521_adfac391-ded2-300a-d01c-006e698d3dc8@aptalaska.net> Message-ID: <99f707d5-c12f-0abd-b018-543121f56ca4@uni-koeln.de> Hi, Am 02.02.20 um 03:35 Uhr schrieb Matthew Schumacher: > Anyone see this before?? For some reason I simply can't subscribe to my > folders.??Looking?at?it?from?the?protocol?level: > > a?list?(subscribed)?""?"*" > > returns > ..... > *?LIST?(\Subscribed?\HasNoChildren)?"/"?Vendors/Tools > *?LIST?(\Subscribed?\HasNoChildren)?"/"?Vendors/Travel > *?LIST?(\Subscribed?\HasNoChildren)?"/"?cron just a guess, but isn't LSUB the command for listing subscribed mailboxes? I'm not actually sure it makes a difference, but you should give it a try ... Cheers, Sebastian -- .:.Sebastian Hagedorn - Weyertal 121 (Geb?ude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universit?t zu K?ln / Cologne University - ? +49-221-470-89578.:. -------------- next part -------------- A non-text attachment was scrubbed... Name: Hagedorn.vcf Type: text/x-vcard Size: 333 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5367 bytes Desc: S/MIME Cryptographic Signature URL: From zorg at probesys.com Mon Feb 3 14:23:28 2020 From: zorg at probesys.com (Zorg) Date: Mon, 3 Feb 2020 20:23:28 +0100 Subject: nginx as a proxy and https Message-ID: Hi Another question about caldav I want to server it behind a proxy with nginx Does someone have a conf example that work because I have try this, but for the moment, I manage to make it work without problem with?? davx, thunderbird, evolution? but not with? iphone (OS/13.3 ,iOS/10.3.4) I'm not really sure that it come from nginx maybe it's because i have login like myuser1 at dav.mydomain.com here is my log 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] "PROPFIND /.well-known/caldav HTTP/1.1" 301 0 "-" "iOS/10.3.4 (14G61) accountsd/1.0" 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] "PROPFIND / HTTP/1.1" 207 280 "-" "iOS/10.3.4 (14G61) accountsd/1.0" 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] "PROPFIND /principals/ HTTP/1.1" 405 347 "-" "iOS/10.3.4 (14G61) accountsd/1.0" 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] "PROPFIND /calendar/dav/myuser1%40dav.mydomain.com/user/ HTTP/1.1" 405 347 "-" "iOS/10.3.4 (14G61) accountsd/1.0" but with davx i have (the %40 is replace by @) 81.82.83.84- myuser1 at dav.mydomain.com? [03/Feb/2020:19:21:35 +0100] "PROPFIND /dav/calendars/user/myuser1 at dav.mydomain.com/ HTTP/1.1" 207 616 "-" "DAVx5/2.6.3.1-ose (2020/01/18; dav4jvm; okhttp/3.12.6) Android/9" here is my conf server { ??????? listen?????? 443 ssl; ??????? server_name? dav.mydomain.com; ??????? ssl_protocols TLSv1 TLSv1.1 TLSv1.2; ??????? ssl_prefer_server_ciphers on; ??????? ssl_ciphers "EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH"; ??????? ssl_ecdh_curve secp384r1; # Requires nginx >= 1.1.0 ??????? ssl_session_cache shared:SSL:10m; ??????? #ssl_dhparam /etc/ssl/dhparam.pem; ??????? access_log /var/log/nginx/dav.ssl.access.log; ??????? root /home/public; ??????? location / { ??? proxy_pass??????? http://192.168.12.24:8008/; ??? proxy_set_header? X-Forwarded-For $proxy_add_x_forwarded_for; ??? proxy_pass_header Authorization; ??? proxy_set_header? Host $host; ??? proxy_set_header? X-Real-IP $remote_addr; ??? proxy_set_header? X-Forwarded-For $remote_addr; ??? proxy_set_header? X-Forwarded-Host $remote_addr; ??????? } ??? ssl_certificate /etc/letsencrypt/live/dav.mydomain.com/fullchain.pem; # managed by Certbot ??? ssl_certificate_key /etc/letsencrypt/live/dav.mydomain.com/privkey.pem; # managed by Certbot } thanks From ellie at fastmail.com Mon Feb 3 16:39:30 2020 From: ellie at fastmail.com (ellie timoney) Date: Tue, 04 Feb 2020 08:39:30 +1100 Subject: Unable to subscribe to folders. In-Reply-To: <99f707d5-c12f-0abd-b018-543121f56ca4@uni-koeln.de> References: <42812_1580610940_0122ZbwZ076521_adfac391-ded2-300a-d01c-006e698d3dc8@aptalaska.net> <99f707d5-c12f-0abd-b018-543121f56ca4@uni-koeln.de> Message-ID: <78041fc8-be25-4282-817d-b1949f299582@www.fastmail.com> On Mon, Feb 3, 2020, at 11:02 PM, Sebastian Hagedorn wrote: > just a guess, but isn't LSUB the command for listing subscribed > mailboxes? I'm not actually sure it makes a difference, but you should > give it a try ... > LIST (\Subscribed) is one of the extensions we support, it should work fine (don't remember the rfc number off top of head) I would be looking at whether the ACL for that mailbox is weird (maybe you don't have permission to see it?), but right at the moment I don't have a reference handy for what you'd need to check for, so just check the docs Cheers, ellie -------------- next part -------------- An HTML attachment was scrubbed... URL: From zorg at probesys.com Wed Feb 5 11:31:25 2020 From: zorg at probesys.com (Zorg) Date: Wed, 5 Feb 2020 17:31:25 +0100 Subject: [SOLVED] nginx as a proxy and https In-Reply-To: References: Message-ID: <5190ceae-a70c-b1ff-e314-8441030c59ba@probesys.com> After searching a bit I found this in cyrus log Feb? 2 13:59:50 caldav cyrus/http[28032]: [192.168.12.240] with "Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.2 Lightning/68.4.2"; "PROPFIND /.well-known/caldav/ HTTP/1.0" (depth=0) => "HTTP/1.1 301 Moved Permanently" (location=http://dav.mydomain.com/dav/calendars/) I have notice that in the response it was "location=http" not "location=https " So to force cyrus to answer with https, I have modify cyrus conf (imap.conf and cyrus.conf) to activate? https and my nginx conf to proxy to the cyrus https port (8443) by changing this line in my conf proxy_pass??????? http://192.168.12.24:8443/; And now it work like a charm Feb? 2 14:45:52 caldav cyrus/http[28043]: [192.168.12.240] with "Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.2 Lightning/68.4.2"; "PROPFIND /.well-known/caldav/ HTTP/1.0" (depth=0) => "HTTP/1.1 301 Moved Permanently" (location=https://dav.mydomain.com/dav/calendars/) Thanks Le 03/02/2020 ? 20:23, Zorg a ?crit?: > Hi > > Another question about caldav > > I want to server it behind a proxy with nginx > > Does someone have a conf example that work > > because I have try this, but for the moment, I manage to make it work > without problem with?? davx, thunderbird, evolution? but not with? > iphone (OS/13.3 ,iOS/10.3.4) > > I'm not really sure that it come from nginx maybe it's because i have > login like myuser1 at dav.mydomain.com > > here is my log > > 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] > "PROPFIND /.well-known/caldav HTTP/1.1" 301 0 "-" "iOS/10.3.4 (14G61) > accountsd/1.0" > 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] > "PROPFIND / HTTP/1.1" 207 280 "-" "iOS/10.3.4 (14G61) accountsd/1.0" > 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] > "PROPFIND /principals/ HTTP/1.1" 405 347 "-" "iOS/10.3.4 (14G61) > accountsd/1.0" > 81.82.83.84 - myuser1 at dav.mydomain.com [03/Feb/2020:11:28:05 +0100] > "PROPFIND /calendar/dav/myuser1%40dav.mydomain.com/user/ HTTP/1.1" 405 > 347 "-" "iOS/10.3.4 (14G61) accountsd/1.0" > > but with davx i have (the %40 is replace by @) > > 81.82.83.84- myuser1 at dav.mydomain.com? [03/Feb/2020:19:21:35 +0100] > "PROPFIND /dav/calendars/user/myuser1 at dav.mydomain.com/ HTTP/1.1" 207 > 616 "-" "DAVx5/2.6.3.1-ose (2020/01/18; dav4jvm; okhttp/3.12.6) > Android/9" > > here is my conf > > server { > ??????? listen?????? 443 ssl; > ??????? server_name? dav.mydomain.com; > > > ??????? ssl_protocols TLSv1 TLSv1.1 TLSv1.2; > ??????? ssl_prefer_server_ciphers on; > ??????? ssl_ciphers "EECDH+AESGCM:EDH+AESGCM:AES256+EECDH:AES256+EDH"; > ??????? ssl_ecdh_curve secp384r1; # Requires nginx >= 1.1.0 > ??????? ssl_session_cache shared:SSL:10m; > ??????? #ssl_dhparam /etc/ssl/dhparam.pem; > > > ??????? access_log /var/log/nginx/dav.ssl.access.log; > ??????? root /home/public; > ??????? location / { > ??? proxy_pass??????? http://192.168.12.24:8008/; > ??? proxy_set_header? X-Forwarded-For $proxy_add_x_forwarded_for; > ??? proxy_pass_header Authorization; > > > ??? proxy_set_header? Host $host; > ??? proxy_set_header? X-Real-IP $remote_addr; > ??? proxy_set_header? X-Forwarded-For $remote_addr; > ??? proxy_set_header? X-Forwarded-Host $remote_addr; > ??????? } > > > ??? ssl_certificate > /etc/letsencrypt/live/dav.mydomain.com/fullchain.pem; # managed by > Certbot > ??? ssl_certificate_key > /etc/letsencrypt/live/dav.mydomain.com/privkey.pem; # managed by Certbot > } > > > thanks > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus From heiler.bemerguy at cinbesa.com.br Wed Feb 5 15:36:36 2020 From: heiler.bemerguy at cinbesa.com.br (Heiler Bemerguy) Date: Wed, 5 Feb 2020 17:36:36 -0300 Subject: squatter segfaulting Message-ID: <2966da37-cfc6-76c0-5dcd-6b0cb8bc49fd@cinbesa.com.br> Is this normal ? [2191259.566831] squatter[28914]: segfault at 7fa584008008 ip 0000563e2b9b04d9 sp 00007ffe9fed4920 error 6 in squatter[563e2b9ab000+7000] [2199792.860105] squatter[32985]: segfault at 7f3b83577008 ip 000055fa60ec64d9 sp 00007ffe6c6c1140 error 6 in squatter[55fa60ec1000+7000] [2207827.970904] squatter[38118]: segfault at 7f3d32a0c008 ip 00005612cbb614d9 sp 00007ffe71a88f70 error 6 in squatter[5612cbb5c000+7000] [2214224.052412] squatter[42190]: segfault at 7fd324b9d008 ip 000055fb547604d9 sp 00007fff69321470 error 6 in squatter[55fb5475b000+7000] [2215084.555691] squatter[41867]: segfault at 7f330be0e008 ip 000055a0e4f974d9 sp 00007ffe4863a620 error 6 in squatter[55a0e4f92000+7000] [2219506.071396] squatter[45617]: segfault at 7f1611096008 ip 000055d868dc74d9 sp 00007ffcc77dcae0 error 6 in squatter[55d868dc2000+7000] [2228006.707228] squatter[49796]: segfault at 7f94446d0008 ip 000055b1187cf4d9 sp 00007ffc4bdd8b40 error 6 in squatter[55b1187ca000+7000] [2233416.966628] squatter[69504]: segfault at 7f4d2233e008 ip 000055c3d36d24d9 sp 00007ffd34afb080 error 6 in squatter[55c3d36cd000+7000] -- Atenciosamente, Heiler Bemerguy - CINBESA Analista de Redes, Wi-Fi, Virtualiza??o e Servi?os Internet (55) 91 98151-4894 From rsto at fastmailteam.com Thu Feb 6 07:54:46 2020 From: rsto at fastmailteam.com (Robert Stepanek) Date: Thu, 06 Feb 2020 13:54:46 +0100 Subject: squatter segfaulting In-Reply-To: <2966da37-cfc6-76c0-5dcd-6b0cb8bc49fd@cinbesa.com.br> References: <2966da37-cfc6-76c0-5dcd-6b0cb8bc49fd@cinbesa.com.br> Message-ID: <753f593f-ad90-4edc-9608-75d3baf1cf50@www.fastmail.com> On Wed, Feb 5, 2020, at 9:36 PM, Heiler Bemerguy wrote: > Is this normal ? Absolutely not. Which Cyrus version are you running? Are you using the Xapian search backend? Would you be able to run this with a debug-enabled build and look at the core dump? Cheers, Robert -------------- next part -------------- An HTML attachment was scrubbed... URL: From heiler.bemerguy at cinbesa.com.br Thu Feb 6 09:16:52 2020 From: heiler.bemerguy at cinbesa.com.br (Heiler Bemerguy) Date: Thu, 6 Feb 2020 11:16:52 -0300 Subject: squatter segfaulting In-Reply-To: <753f593f-ad90-4edc-9608-75d3baf1cf50@www.fastmail.com> References: <2966da37-cfc6-76c0-5dcd-6b0cb8bc49fd@cinbesa.com.br> <753f593f-ad90-4edc-9608-75d3baf1cf50@www.fastmail.com> Message-ID: <1b7f4208-7aab-f8d1-b025-f88edb3352c8@cinbesa.com.br> An HTML attachment was scrubbed... URL: From Hagedorn at uni-koeln.de Thu Feb 6 10:49:05 2020 From: Hagedorn at uni-koeln.de (Sebastian Hagedorn) Date: Thu, 6 Feb 2020 16:49:05 +0100 Subject: Potential for data loss by running concurrent RENAMEs in cyrus-imapd 2.4 Message-ID: Hi, let me preface the following by saying that I'm an idiot, and I don't blame cyrus-imapd in the slightest. However, maybe there is potential for improved error handling here, so I'm going to report what happened last night. We are (still) running cyrus-imapd 2.4.20. I have written a script that moves users from one partition to another. It's been working fine for a long time. The script lists the users on the source partition, checks if they are active, and if they aren't, it executes "rename user/USER user/USER TARGETPARTITION". Yesterday, I was confused and accidentally managed to run two instances of the script simultaneously overnight. This caused many error messages, and also the loss of three mailboxes. In most cases no harm appears to have been done. There are some "Mailbox already exists" messsages, when the first instance of the script had already begun to move a mailbox, but as far as I can tell that didn't do any damage. In the case of the three lost mailboxes, there are the following messages in the logfile: Feb 6 02:03:06 xxx.rrz.uni-koeln.de imapv6[95539]: IOERROR: opening /var/spool/imap3/K/user/aaa/SOffice/Writer/172.: No such file or directory Feb 6 02:03:06 xxx.rrz.uni-koeln.de imapv6[95539]: IOERROR: opening /var/spool/imap3/K/user/aaa/SOffice/Writer/172.: No such file or directory Feb 6 02:36:39 xxx.rrz.uni-koeln.de imapv6[122884]: IOERROR: opening /var/spool/imap3/P/user/bbb/sent-mail/1.: No such file or directory Feb 6 02:36:39 xxx.rrz.uni-koeln.de imapv6[122884]: IOERROR: opening /var/spool/imap3/P/user/bbb/sent-mail/1.: No such file or directory Feb 6 04:49:39 xxx.rrz.uni-koeln.de imapv6[77903]: IOERROR: opening /var/spool/imap3/S/user/ccc/Templates/1.: No such file or directory Feb 6 04:49:39 xxx.rrz.uni-koeln.de imapv6[77903]: IOERROR: opening /var/spool/imap3/S/user/ccc/Templates/1.: No such file or directory /var/spool/imap3 is the source partition. My best guess is that for those three mailboxes the two concurrent renames happened exactly at the same time, so that there was some race condition with locking the mailbox(?). Anyway, these three mailboxes were just gone this morning. They were neither on the old partition nor the new, but interestingly in mailboxes.db they are listed on the new partition. I have recreated the mailboxes on disk, so all is fine now. Again, this is clearly my fault, but perhaps better error handling could avoid such scenarios anyway? Perhaps it's already fixed in newer releases? If so that's one more incentive to finally upgrade :-) I have now added a locking mechanism to my script so that it shouldn't be possible to run two instances anymore. Cheers Sebastian -- .:.Sebastian Hagedorn - Weyertal 121 (Geb?ude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universit?t zu K?ln / Cologne University - ? +49-221-470-89578.:. -------------- next part -------------- A non-text attachment was scrubbed... Name: Hagedorn.vcf Type: text/x-vcard Size: 333 bytes Desc: not available URL: From Albert.Shih at obspm.fr Thu Feb 6 11:32:33 2020 From: Albert.Shih at obspm.fr (Albert Shih) Date: Thu, 6 Feb 2020 17:32:33 +0100 Subject: ACL on root mailbox Message-ID: <20200206163233.GF3589@io.chezmoi.fr> Hi everyone, I would like to known what kind of ACL you give on a shared mailbox. My problem is : I have some users who are admin on the mailbox, it's needed because those admin-user can create sub folder. But some user make mistake time to time and move the mailbox under some other mailbox shared/mailbox1 shared/mailbox2 ---> shared/mailbox1/mailbox2 and the problem of course is the mail for mailbox2 go to /dev/null. So how can I give enough rights to someone to let he manage their mailbox but prevent this kind of wrong manipulation. Regards. -- Albert SHIH Observatoire de Paris xmpp: jas at obspm.fr Heure local/Local time: Thu 06 Feb 2020 05:24:57 PM CET From paolo.cravero at csi.it Fri Feb 7 05:35:10 2020 From: paolo.cravero at csi.it (Paolo Cravero) Date: Fri, 7 Feb 2020 11:35:10 +0100 (CET) Subject: ACL on root mailbox In-Reply-To: <20200206163233.GF3589@io.chezmoi.fr> References: <20200206163233.GF3589@io.chezmoi.fr> Message-ID: <1861424953.1467947.1581071710072@comunica.csi.it> Hello Albert. > I would like to known what kind of ACL you give on a shared mailbox. My > problem is : > > I have some users who are admin on the mailbox, it's needed because those > admin-user can create sub folder. > > But some user make mistake time to time and move the mailbox under some > other mailbox [...] > So how can I give enough rights to someone to let he manage their mailbox > but prevent this kind of wrong manipulation. See https://www.cyrusimap.org/imap/reference/admin/access-control/rights-reference.html for an explanation of ACL levels. I think "lrswc" could do in your case, for non-admin users. You may add "i" and/or "t" and "e", depending on the way they operate on the shared mailbox (copy mails into | delete mail from the folder). Greetings, Paolo From paolo.cravero at csi.it Fri Feb 7 05:43:42 2020 From: paolo.cravero at csi.it (Paolo Cravero) Date: Fri, 7 Feb 2020 11:43:42 +0100 (CET) Subject: squatter segfaulting In-Reply-To: <1b7f4208-7aab-f8d1-b025-f88edb3352c8@cinbesa.com.br> References: <2966da37-cfc6-76c0-5dcd-6b0cb8bc49fd@cinbesa.com.br> <753f593f-ad90-4edc-9608-75d3baf1cf50@www.fastmail.com> <1b7f4208-7aab-f8d1-b025-f88edb3352c8@cinbesa.com.br> Message-ID: <1353633152.1468303.1581072222637@comunica.csi.it> Hello. > Vanilla Cyrus, no Xapian. I don't know how to run a debug-enable, I only know the basics :/ > > ii cyrus-imapd 2.5.10-3+deb9u1 amd64 Cyrus mail system - IMAP support > There seems to be an open issue: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=871921 I've seen squatter segfaulting when the index file got too large (in an older Cyrus version). Can you check how large it is? How many messages are in the mailbox/folder causing the crash? How about system's ulimit? Can the cyrus user open enough files? Paolo -------------- next part -------------- An HTML attachment was scrubbed... URL: From ellie at fastmail.com Sun Feb 9 23:06:09 2020 From: ellie at fastmail.com (ellie timoney) Date: Mon, 10 Feb 2020 15:06:09 +1100 Subject: Cyrus IMAP 3.2.0-beta1 released Message-ID: The Cyrus team is proud to announce the first beta release from the new Cyrus IMAP 3.2 series: 3.2.0-beta1 While 3.2 is still in beta, the main https://www.cyrusimap.org/ website will continue to be focused on the stable 3.0 series. The 3.2 website is available at https://www.cyrusimap.org/3.2/ I'm trialling hosting the release files using Github's releases feature. Please use the Github download links if possible, and advise if you have any problems! (It may even download faster due to Github's content delivery network.) Download URLs: https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.0-beta1/cyrus-imapd-3.2.0-beta1.tar.gz https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.0-beta1/cyrus-imapd-3.2.0-beta1.tar.gz.sig https://www.cyrusimap.org/releases/cyrus-imapd-3.2.0-beta1.tar.gz https://www.cyrusimap.org/releases/cyrus-imapd-3.2.0-beta1.tar.gz.sig Please consult the release notes and upgrade documentation before upgrading to 3.2: https://cyrusimap.org/3.2/imap/download/release-notes/3.2/x/3.2.0-beta1.html https://cyrusimap.org/3.2/imap/download/upgrade.html And join us on Github at https://github.com/cyrusimap/cyrus-imapd to report issues, join in the deliberations of new features for the next Cyrus IMAP release, and to contribute to the documentation. On behalf of the Cyrus team, Kind regards, ellie timoney From Albert.Shih at obspm.fr Tue Feb 11 09:14:13 2020 From: Albert.Shih at obspm.fr (Albert Shih) Date: Tue, 11 Feb 2020 15:14:13 +0100 Subject: ACL on root mailbox In-Reply-To: <1861424953.1467947.1581071710072@comunica.csi.it> References: <20200206163233.GF3589@io.chezmoi.fr> <1861424953.1467947.1581071710072@comunica.csi.it> Message-ID: <20200211141413.GC11916@io.chezmoi.fr> Le 07/02/2020 ? 11:35:10+0100, Paolo Cravero a ?crit > Hello Albert. > > > I would like to known what kind of ACL you give on a shared mailbox. My > > problem is : > > > > I have some users who are admin on the mailbox, it's needed because those > > admin-user can create sub folder. > > > > But some user make mistake time to time and move the mailbox under some > > other mailbox > > [...] > > > So how can I give enough rights to someone to let he manage their mailbox > > but prevent this kind of wrong manipulation. > > See https://www.cyrusimap.org/imap/reference/admin/access-control/rights-reference.html for an explanation of ACL levels. > > I think "lrswc" could do in your case, for non-admin users. You may add "i" and/or "t" and "e", depending on the way they operate on the shared mailbox (copy mails into | delete mail from the folder). > Yes...I follow this documentation. Currently I run with lrswipktecd it seem that do the trick but the problem is when the user(admin) create a submailbox he cannot delete it if he make a mistake. Regards. -- Albert SHIH Observatoire de Paris France xmpp: jas at obspm.fr Heure local/Local time: Tue 11 Feb 2020 03:04:12 PM CET From ellie at fastmail.com Sun Feb 16 23:09:57 2020 From: ellie at fastmail.com (ellie timoney) Date: Mon, 17 Feb 2020 15:09:57 +1100 Subject: Cyrus IMAP 3.2.0-beta2 released Message-ID: The Cyrus team is proud to announce the second beta release from the new Cyrus IMAP 3.2 series: 3.2.0-beta2 While 3.2 is still in beta, the main https://www.cyrusimap.org/ website will continue to be focused on the stable 3.0 series. The 3.2 website is available at https://www.cyrusimap.org/3.2/ I'm trialling hosting the release files using Github's releases feature. Please use the Github download links if possible, and advise if you have any problems! (It may even download faster due to Github's content delivery network.) Download URLs: https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.0-beta2/cyrus-imapd-3.2.0-beta2.tar.gz https://github.com/cyrusimap/cyrus-imapd/releases/download/cyrus-imapd-3.2.0-beta2/cyrus-imapd-3.2.0-beta2.tar.gz.sig https://www.cyrusimap.org/releases/cyrus-imapd-3.2.0-beta2.tar.gz https://www.cyrusimap.org/releases/cyrus-imapd-3.2.0-beta2.tar.gz.sig Please consult the release notes and upgrade documentation before upgrading to 3.2: https://cyrusimap.org/3.2/imap/download/release-notes/3.2/x/3.2.0-beta2.html https://cyrusimap.org/3.2/imap/download/upgrade.html And join us on Github at https://github.com/cyrusimap/cyrus-imapd to report issues, join in the deliberations of new features for the next Cyrus IMAP release, and to contribute to the documentation. On behalf of the Cyrus team, Kind regards, ellie timoney From ruprechtsberger at volkshilfe-ooe.at Mon Feb 17 03:16:40 2020 From: ruprechtsberger at volkshilfe-ooe.at (Rainer Ruprechtsberger) Date: Mon, 17 Feb 2020 09:16:40 +0100 Subject: Sieve admin account doesn't work anymore Message-ID: Hi, I hope I got the list to post this question to right, please excuse me if I didn't.. I resently upgraded a cyrus-imap from version 2.4 to 3.0 and since then my sieve admin account is not an admin anymore: sieveshell -u admin -a admin => works sieveshell -u user -a user => works sieveshell -u user -a admin => 'PLAIN authentication failure' The account is configured admin in imapd.conf: sieve_admins: admin Since this account is used to enable / disable scheduled vaccation messages it creates some problems.. any help would be appreciated. lg, rupi -- Rainer Ruprechtsberger Volkshilfe Ober?sterreich IT 4020 Linz, Glimpfingerstrasse 48 Tel.: +43 732 3405 123 Mobil.: +43 676 8734 1123 ZVR Zahl: 064371505 Volkshilfe. Wir sind f?r die Menschen da. From kmk_pk at yahoo.com Mon Feb 17 06:17:04 2020 From: kmk_pk at yahoo.com (Khalid Mehmood Khan) Date: Mon, 17 Feb 2020 11:17:04 +0000 (UTC) Subject: cyrus murder environment and http proxy? References: <1647661880.2824091.1581938224584.ref@mail.yahoo.com> Message-ID: <1647661880.2824091.1581938224584@mail.yahoo.com> Hi! Does http proxy work in a cyrus murder environment? I keep getting ""PUT /dav/addressbooks/user/testuser/6ecc0a66-74a1412-1581679269354-210887/ef37977290d43113e709f68848aa9a8a5ff8a24f.vcf HTTP/1.1" (if-none-match=*) => "HTTP/1.1 403 Forbidden"" on the frontend while trying to add an entry into addressbook/calendar. The log on backend gives the the follwoing error. "Cyrus-SASL/2.1.27 OpenSSL/1.1 Nghttp2/1.33.0 Zlib/1.2.11 LibXML/2.9.7 SQLite/3.26.0 LibiCal/3.0 ICU4C/60.3 Jansson/2.11"; "OPTIONS * HTTP/1.1" => "HTTP/1.1 401 Unauthorized" (error=Authentication failed)" In a discrete murder setup the frontend and backend both use "http_sasl_mech_list: PLAIN" in imapd.conf. I'm running? the latest stable version of cyrus-imapd 3.0.13. Thanks. Regards. KMK From Hagedorn at uni-koeln.de Mon Feb 17 11:21:19 2020 From: Hagedorn at uni-koeln.de (Sebastian Hagedorn) Date: Mon, 17 Feb 2020 17:21:19 +0100 Subject: Sieve admin account doesn't work anymore In-Reply-To: References: Message-ID: <839613a2-e8c8-af2b-fc5c-78a264e5331a@uni-koeln.de> Am 17.02.20 um 09:16 Uhr schrieb Rainer Ruprechtsberger: > I hope I got the list to post this question to right, please excuse me > if I didn't.. > > I resently upgraded a cyrus-imap from version 2.4 to 3.0 and since then > my sieve admin account is not an admin anymore: > > sieveshell -u admin -a admin => works > sieveshell -u user -a user => works > sieveshell -u user -a admin => 'PLAIN authentication failure' > > The account is configured admin in imapd.conf: > > sieve_admins: admin > > Since this account is used to enable / disable scheduled vaccation > messages it creates some problems.. any help would be appreciated. You're trying to use "proxy authentication". That only works with some SASL mechanisms, not all of them. Perhaps try the same with imtest and observe what mechanism is used? imtest is much more verbose than sieveshell. -- .:.Sebastian Hagedorn - Weyertal 121 (Geb?ude 133), Zimmer 2.02.:. .:.Regionales Rechenzentrum (RRZK).:. .:.Universit?t zu K?ln / Cologne University - ? +49-221-470-89578.:. -------------- next part -------------- A non-text attachment was scrubbed... Name: Hagedorn.vcf Type: text/x-vcard Size: 333 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5367 bytes Desc: S/MIME Cryptographic Signature URL: From ruprechtsberger at volkshilfe-ooe.at Tue Feb 18 07:43:49 2020 From: ruprechtsberger at volkshilfe-ooe.at (Rainer Ruprechtsberger) Date: Tue, 18 Feb 2020 13:43:49 +0100 Subject: Sieve admin account doesn't work anymore In-Reply-To: <839613a2-e8c8-af2b-fc5c-78a264e5331a@uni-koeln.de> References: <839613a2-e8c8-af2b-fc5c-78a264e5331a@uni-koeln.de> Message-ID: <4558028d-99ec-64d2-d4e8-af93ac6c9f37@volkshilfe-ooe.at> Hello, > You're trying to use "proxy authentication". That only works with some > SASL mechanisms, not all of them. Yes, I know, we use "PLAIN" which does support that. > Perhaps try the same with imtest and > observe what mechanism is used? imtest is much more verbose than sieveshell. > Thank you very much - I did not know of these tools. In the end debugging with sivtest yielded results: Since the upgrade my groupware (SOGo) did not want to talk TLS with cyrus (gnutls vs. openssl problem most likely) and so I added plain listeners on the internal mailcluster network. However: sieve login works but cyrus refuses to proxy authenticate with an ssf of 0. I ended up using perdition as sort of TLS upgrade proxy. Works fine and removes the need for a second imapd.conf that I would need to keep in sync. Thanks again, rupi From Jean-Christophe.Delaye at eurecom.fr Tue Feb 18 08:09:25 2020 From: Jean-Christophe.Delaye at eurecom.fr (Jean-Christophe Delaye) Date: Tue, 18 Feb 2020 14:09:25 +0100 Subject: cyrus murder environment and http proxy? In-Reply-To: <1647661880.2824091.1581938224584@mail.yahoo.com> References: <1647661880.2824091.1581938224584.ref@mail.yahoo.com> <1647661880.2824091.1581938224584@mail.yahoo.com> Message-ID: On 2020-02-17 12:17, Khalid Mehmood Khan via Info-cyrus wrote: > Hi! > > Does http proxy work in a cyrus murder environment? I keep getting ""PUT /dav/addressbooks/user/testuser/6ecc0a66-74a1412-1581679269354-210887/ef37977290d43113e709f68848aa9a8a5ff8a24f.vcf HTTP/1.1" (if-none-match=*) => "HTTP/1.1 403 Forbidden"" on the frontend while trying to add an entry into addressbook/calendar. The log on backend gives the the follwoing error. > "Cyrus-SASL/2.1.27 OpenSSL/1.1 Nghttp2/1.33.0 Zlib/1.2.11 LibXML/2.9.7 SQLite/3.26.0 LibiCal/3.0 ICU4C/60.3 Jansson/2.11"; "OPTIONS * HTTP/1.1" => "HTTP/1.1 401 Unauthorized" (error=Authentication failed)" > In a discrete murder setup the frontend and backend both use "http_sasl_mech_list: PLAIN" in imapd.conf. > > I'm running? the latest stable version of cyrus-imapd 3.0.13. I had the same issue and posted it to the list (last April 2019) .... but can't solve the problem. I removed http services from cyrus murder and put them on a standalone server. Regards. > > Thanks. > > Regards. > > KMK > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > From fabio.montefuscolo at gmail.com Tue Feb 18 11:16:44 2020 From: fabio.montefuscolo at gmail.com (Fabio Montefuscolo) Date: Tue, 18 Feb 2020 13:16:44 -0300 Subject: Fwd: Help putting cyrus on Docker In-Reply-To: References: <4746242.IOqI4mWz6t@gongo> Message-ID: Hello! I finally got the basic stuff working on Docker and deployed through Docker swarm. That is what I learnt (or I think I learnt) * a basic mail solution having Cyrus needs 4 containers (imapd, saslauthd, rsyslog and postfix) * sharing rsyslog socket on all containers is needed to have logs * saslauthd socket needs to be shared on imapd and postfix containers, to have authentication * imapd exposes lmtp socket, that needs to be shared with postfix, to receive emails Other stuff * Saslauthd is using OpenLDAP * Postfix uses letsencrypt generated certificate Next challenges * Run OpenDKIM container and tie it o Postfix * Work with virtualdomains * Have a spam solution * Convert the docker-compose.yml to a kubernetes equivalent (so scary) If anyone have some minutes to take a look at https://github.com/fabiomontefuscolo/wikisuite-swarm/tree/master/global-services and give some thoughts, it would be awesome. Thank you!! Em qua., 15 de jan. de 2020 ?s 08:49, Fabio Montefuscolo < fabio.montefuscolo at gmail.com> escreveu: > Hi Niels > > Thank you very much for looking into this. > > Initially, I would like to get this working like I got in a real CentOS 8. > I have here a virtual machine where I did the same steps I did in > Dockerfile. But in VM I start services "*systemctl start cyrus-imapd*" > and "*systemctl start saslauthd*" and basic login works out of the box. I > could telnet on port 143 and "*. login cyrus cyrus*". That is not > happening on Docker. > > I hope other people using the image can write their own config and mount > inside the container to achieve their needs. The plan is to have some > kubernetes recipes I can repeat whenever we get a new client wondering to > have an email service. Actually I'm testing it on DO, but using kubernetes > should be simple to move to AWS, Linode or any other kubernetes hosting. > > Thank you > > Em qua., 15 de jan. de 2020 ?s 06:22, Niels Dettenbach via Info-cyrus < > info-cyrus at lists.andrew.cmu.edu> escreveu: > >> Am Dienstag, 14. Januar 2020, 16:47:52 CET schrieb Fabio Montefuscolo: >> > I'm trying to build a simple docker image based on CentOS 8, which >> brings >> > cyrus-imapd 3.0.7. I'm having troubles to authenticate on cyrus imap >> > service for unknown reasons. There is no syslog facility working inside >> > the centos image, so I don't have logs. The final idea is deploy this >> > image in a kubernetes cluster. The Dockerfile I'm using is >> > https://github.com/fabiomontefuscolo/docker-cyrusimapd >> > >> > When I jump into console and try to use cyradm, I get 2 password fields >> to >> > fulfill and at the ent, that doesn't work >> >> >> as far as i can read in that dockerfile on a first view, it does only >> install >> dependencies and "activating" SSL/TLS, but lacks any kind of further >> required >> configuration for cyrus auth etc. >> >> the flexibility and complexity of cyrus installations are not easy to >> "capsule" into a docker file or reciept for a "common usage". >> >> depending on what kind of authentication subsystem (i.e. mysql, pam, >> ldap, >> pam_mysql, sasl, saslauthd (with pam or other "backend") you want to use >> or >> even active AD or others you have to configure that by hand (or extend >> that >> docker file). >> >> a typical "easy" way is using saslauthd with -s pam to "simply" use pam >> authentication. >> >> >> hth, >> >> >> >> niels. >> >> >> -- >> --- >> Niels Dettenbach >> Syndicat IT & Internet >> http://www.syndicat.com >> PGP: https://syndicat.com/pub_key.asc >> --- >> >> >> >> >> >> >> >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From nic at nicbernstein.com Tue Feb 18 12:24:09 2020 From: nic at nicbernstein.com (Nic Bernstein) Date: Tue, 18 Feb 2020 11:24:09 -0600 Subject: Fwd: Help putting cyrus on Docker In-Reply-To: References: <4746242.IOqI4mWz6t@gongo> Message-ID: <99c1f3e9-dbc7-f231-5475-c6f36a619971@nicbernstein.com> Fabio, Very interesting stuff.? I would encourage you to add Readme.md to your repository, containing at least what you've summarized here. This would make for a nice addition to the Cyrus documentation, but would need a bit more explanation on your part, first, so whomever prepares the docs for the Cyrus project doesn't misrepresent anything you've done. Some questions: * You've gone to the trouble to add the certificate infrastructure for Postfix, but not for Cyrus. Any reason for that? o What I'm referring to here is the nginx proxy support for the Let's Encrypt stuff (at least I assume that's what you're using) * Your Postfix configuration contains support for the deprecated Cyrus 'deliver' program as well as LMTP. o If Postfix & Cyrus are separate containers, then 'deliver' won't work. Nice work! ??? -nic On 2/18/20 10:16 AM, Fabio Montefuscolo wrote: > Hello! > > I finally got the basic stuff working on Docker and deployed through > Docker swarm. That is what I learnt (or I think I learnt) > > * a basic mail solution having Cyrus needs 4 containers (imapd, > saslauthd, rsyslog and postfix) > * sharing rsyslog socket on all containers is needed to have logs > * saslauthd socket needs to be shared on imapd and postfix containers, > to have authentication > * imapd exposes lmtp socket, that needs to be shared with postfix, to > receive emails > > Other stuff > > * Saslauthd is using OpenLDAP > * Postfix uses letsencrypt generated certificate > > Next challenges > > * Run OpenDKIM container and tie it o Postfix > * Work with virtualdomains > * Have a spam solution > * Convert the docker-compose.yml to a kubernetes equivalent (so scary) > > If anyone have some minutes to take a look at > https://github.com/fabiomontefuscolo/wikisuite-swarm/tree/master/global-services > and give some thoughts, it would be awesome. > > Thank you!! > > > Em qua., 15 de jan. de 2020 ?s 08:49, Fabio Montefuscolo > > > escreveu: > > Hi Niels > > Thank you very much for looking into this. > > Initially, I would like to get this working like I got in a real > CentOS 8. I have here a virtual machine where I did the same steps > I did in Dockerfile. But in VM I start services "*systemctl start > cyrus-imapd*" and "*systemctl start saslauthd*" and basic login > works out of the box. I could telnet on port 143 and "*. login > cyrus cyrus*". That is not happening on Docker. > > I hope other people using the image can write their own config and > mount inside the container to achieve their needs. The plan is to > have some kubernetes recipes I can repeat whenever we get a new > client wondering to have an email service. Actually I'm testing it > on DO, but using kubernetes should be simple to move to AWS, > Linode or any other kubernetes hosting. > > Thank you > > Em qua., 15 de jan. de 2020 ?s 06:22, Niels Dettenbach via > Info-cyrus > escreveu: > > Am Dienstag, 14. Januar 2020, 16:47:52 CET schrieb Fabio > Montefuscolo: > > I'm trying to build a simple docker image based on CentOS 8, > which brings > > cyrus-imapd 3.0.7. I'm having troubles to authenticate on > cyrus imap > > service for unknown reasons. There is no syslog facility > working inside > > the centos image, so I don't have logs. The final idea is > deploy this > > image in a kubernetes cluster. The Dockerfile I'm using is > > https://github.com/fabiomontefuscolo/docker-cyrusimapd > > > > When I jump into console and try to use cyradm, I get 2 > password fields to > > fulfill and at the ent, that doesn't work > > > as far as i can read in that dockerfile on a first view, it > does only install > dependencies and "activating" SSL/TLS, but lacks any kind of > further required > configuration for cyrus auth etc. > > the flexibility and complexity of cyrus installations are not > easy to > "capsule" into a docker file or reciept for a "common usage". > > depending on what kind of authentication subsystem (i.e. > mysql, pam, ldap, > pam_mysql, sasl, saslauthd (with pam or other "backend") you > want to use or > even active AD or others you have to configure that by hand > (or extend that > docker file). > > a typical "easy" way is using saslauthd with -s pam to > "simply" use pam > authentication. > > > hth, > > > > niels. > > > -- > ?--- > ?Niels Dettenbach > ?Syndicat IT & Internet > http://www.syndicat.com > ?PGP: https://syndicat.com/pub_key.asc > ?--- > > > > > > > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: > http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > ---- > Cyrus Home Page:http://www.cyrusimap.org/ > List Archives/Info:http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Nic Bernstein nic at nicbernstein.com mobile: +1 414 807 1734 snail: 1111 N Astor St Apt A5, Milwaukee, WI 53202-3319 https://www.nicbernstein.com https://www.linkedin.com/in/nic-b-26577a178/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From fabio.montefuscolo at gmail.com Tue Feb 18 14:38:07 2020 From: fabio.montefuscolo at gmail.com (Fabio Montefuscolo) Date: Tue, 18 Feb 2020 16:38:07 -0300 Subject: Fwd: Help putting cyrus on Docker In-Reply-To: <99c1f3e9-dbc7-f231-5475-c6f36a619971@nicbernstein.com> References: <4746242.IOqI4mWz6t@gongo> <99c1f3e9-dbc7-f231-5475-c6f36a619971@nicbernstein.com> Message-ID: Hi Nic! I'm super happy with your response! Honestly, I added that while I was getting 550 from lmtp, but that probably should be removed. But lmtp, do you think I can remove that line from the master? Actually, that line came turned on by default on CentOS 8, that is the base image I'm using. I will turn that off and check if all runs ok. I will write a README for this recipe and all containers I made. I would be very happy to see that in the Cyrus docs :) Em ter., 18 de fev. de 2020 ?s 14:24, Nic Bernstein escreveu: > Fabio, > Very interesting stuff. I would encourage you to add Readme.md to your > repository, containing at least what you've summarized here. This would > make for a nice addition to the Cyrus documentation, but would need a bit > more explanation on your part, first, so whomever prepares the docs for the > Cyrus project doesn't misrepresent anything you've done. > > Some questions: > > - You've gone to the trouble to add the certificate infrastructure for > Postfix, but not for Cyrus. Any reason for that? > - What I'm referring to here is the nginx proxy support for the > Let's Encrypt stuff (at least I assume that's what you're using) > - Your Postfix configuration contains support for the deprecated > Cyrus 'deliver' program as well as LMTP. > - If Postfix & Cyrus are separate containers, then 'deliver' won't > work. > > > Nice work! > -nic > > On 2/18/20 10:16 AM, Fabio Montefuscolo wrote: > > Hello! > > I finally got the basic stuff working on Docker and deployed through > Docker swarm. That is what I learnt (or I think I learnt) > > * a basic mail solution having Cyrus needs 4 containers (imapd, saslauthd, > rsyslog and postfix) > * sharing rsyslog socket on all containers is needed to have logs > * saslauthd socket needs to be shared on imapd and postfix containers, to > have authentication > * imapd exposes lmtp socket, that needs to be shared with postfix, to > receive emails > > Other stuff > > * Saslauthd is using OpenLDAP > * Postfix uses letsencrypt generated certificate > > Next challenges > > * Run OpenDKIM container and tie it o Postfix > * Work with virtualdomains > * Have a spam solution > * Convert the docker-compose.yml to a kubernetes equivalent (so scary) > > If anyone have some minutes to take a look at > https://github.com/fabiomontefuscolo/wikisuite-swarm/tree/master/global-services > and give some thoughts, it would be awesome. > > Thank you!! > > > Em qua., 15 de jan. de 2020 ?s 08:49, Fabio Montefuscolo < > fabio.montefuscolo at gmail.com> escreveu: > >> Hi Niels >> >> Thank you very much for looking into this. >> >> Initially, I would like to get this working like I got in a real CentOS >> 8. I have here a virtual machine where I did the same steps I did in >> Dockerfile. But in VM I start services "*systemctl start cyrus-imapd*" >> and "*systemctl start saslauthd*" and basic login works out of the box. >> I could telnet on port 143 and "*. login cyrus cyrus*". That is not >> happening on Docker. >> >> I hope other people using the image can write their own config and mount >> inside the container to achieve their needs. The plan is to have some >> kubernetes recipes I can repeat whenever we get a new client wondering to >> have an email service. Actually I'm testing it on DO, but using kubernetes >> should be simple to move to AWS, Linode or any other kubernetes hosting. >> >> Thank you >> >> Em qua., 15 de jan. de 2020 ?s 06:22, Niels Dettenbach via Info-cyrus < >> info-cyrus at lists.andrew.cmu.edu> escreveu: >> >>> Am Dienstag, 14. Januar 2020, 16:47:52 CET schrieb Fabio Montefuscolo: >>> > I'm trying to build a simple docker image based on CentOS 8, which >>> brings >>> > cyrus-imapd 3.0.7. I'm having troubles to authenticate on cyrus imap >>> > service for unknown reasons. There is no syslog facility working inside >>> > the centos image, so I don't have logs. The final idea is deploy this >>> > image in a kubernetes cluster. The Dockerfile I'm using is >>> > https://github.com/fabiomontefuscolo/docker-cyrusimapd >>> > >>> > When I jump into console and try to use cyradm, I get 2 password >>> fields to >>> > fulfill and at the ent, that doesn't work >>> >>> >>> as far as i can read in that dockerfile on a first view, it does only >>> install >>> dependencies and "activating" SSL/TLS, but lacks any kind of further >>> required >>> configuration for cyrus auth etc. >>> >>> the flexibility and complexity of cyrus installations are not easy to >>> "capsule" into a docker file or reciept for a "common usage". >>> >>> depending on what kind of authentication subsystem (i.e. mysql, pam, >>> ldap, >>> pam_mysql, sasl, saslauthd (with pam or other "backend") you want to use >>> or >>> even active AD or others you have to configure that by hand (or extend >>> that >>> docker file). >>> >>> a typical "easy" way is using saslauthd with -s pam to "simply" use pam >>> authentication. >>> >>> >>> hth, >>> >>> >>> >>> niels. >>> >>> >>> -- >>> --- >>> Niels Dettenbach >>> Syndicat IT & Internet >>> http://www.syndicat.com >>> PGP: https://syndicat.com/pub_key.asc >>> --- >>> >>> >>> >>> >>> >>> >>> >>> ---- >>> Cyrus Home Page: http://www.cyrusimap.org/ >>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >>> >> > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe:https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > > -- > Nic Bernstein nic at nicbernstein.com > mobile: +1 414 807 1734 > snail: 1111 N Astor St Apt A5, Milwaukee, WI 53202-3319https://www.nicbernstein.comhttps://www.linkedin.com/in/nic-b-26577a178/ > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jwade at oakton.edu Tue Feb 18 17:35:26 2020 From: jwade at oakton.edu (John Wade) Date: Tue, 18 Feb 2020 16:35:26 -0600 Subject: MFA (Multi Factor Authentication), SSO, and Cyrus Message-ID: Hi Cyrus Users, We are currently using Cyrus IMAP with Roundcube webmail, and are looking to implement both SAML or CAS Single Sign-on and Multifactor Authentication (MFA) for all applications.?? Currently Cyrus users authenticate back to Active Directory via SASL ldap_auth and this remains one of the few applications not setup with Single Sign-On (SSO). Has anyone looked at doing SSO and MFA with Cyrus and any available webmail client??? ? (This ignores the complexity of also offering direct IMAP access.) ? The challenge with SAML and CAS SSO is that the SP application (webmail is this case) does not have access to the user's password. It seems like this could theoretically be set up to work for webmail with proxy authentication, or with an LDAP proxy from the MFA vendor for MFA without SSO, but I don't see any solutions that wouldn't require extensive customization/rewriting. Has anyone put a solution like this into production?? My google-fu has failed me on this one. Thanks in advance, John Wade Oakton Community College From kmk_pk at yahoo.com Wed Feb 19 05:39:54 2020 From: kmk_pk at yahoo.com (Khalid Mehmood Khan) Date: Wed, 19 Feb 2020 10:39:54 +0000 (UTC) Subject: cyrus murder environment and http proxy? In-Reply-To: References: <1647661880.2824091.1581938224584.ref@mail.yahoo.com> <1647661880.2824091.1581938224584@mail.yahoo.com> Message-ID: <640043385.3642935.1582108794203@mail.yahoo.com> Thanks for the help, I'll give it another try in a couple of days, and if it didn't workout, I might go for the same solution or try nginx. Regards. KMK On Tuesday, February 18, 2020, 6:09:28 PM GMT+5, Jean-Christophe Delaye wrote: On 2020-02-17 12:17, Khalid Mehmood Khan via Info-cyrus wrote: > Hi! > > Does http proxy work in a cyrus murder environment? I keep getting ""PUT /dav/addressbooks/user/testuser/6ecc0a66-74a1412-1581679269354-210887/ef37977290d43113e709f68848aa9a8a5ff8a24f.vcf HTTP/1.1" (if-none-match=*) => "HTTP/1.1 403 Forbidden"" on the frontend while trying to add an entry into addressbook/calendar. The log on backend gives the the follwoing error. > "Cyrus-SASL/2.1.27 OpenSSL/1.1 Nghttp2/1.33.0 Zlib/1.2.11 LibXML/2.9.7 SQLite/3.26.0 LibiCal/3.0 ICU4C/60.3 Jansson/2.11"; "OPTIONS * HTTP/1.1" => "HTTP/1.1 401 Unauthorized" (error=Authentication failed)" > In a discrete murder setup the frontend and backend both use "http_sasl_mech_list: PLAIN" in imapd.conf. > > I'm running? the latest stable version of cyrus-imapd 3.0.13. I had the same issue and posted it to the list (last April 2019) .... but can't solve the problem. I removed http services from cyrus murder and put them on a standalone server. Regards. > > Thanks. > > Regards. > > KMK > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > From ml at netfence.it Fri Feb 21 06:09:53 2020 From: ml at netfence.it (Andrea Venturoli) Date: Fri, 21 Feb 2020 12:09:53 +0100 Subject: Migrating calendars to Cyrus Message-ID: Hello. I've been using CyrusIMAP for a long time, since before it supported CalDAV/CardDAV. At a site, I had installed DAVical, but I'd like to get rid of it, now that Cyrus can do what it does. I've migrated most calendars and I'm left with only one user, who, unfortunately, has more than 2k items in his calendar. Doing it via a client is a pain. Is there something like imapsync I can use? bye & Thanks av. From nic at nicbernstein.com Fri Feb 21 07:31:44 2020 From: nic at nicbernstein.com (Nic Bernstein) Date: Fri, 21 Feb 2020 06:31:44 -0600 Subject: Migrating calendars to Cyrus In-Reply-To: References: Message-ID: On 2/21/20 5:09 AM, Andrea Venturoli wrote: > Hello. > > I've been using CyrusIMAP for a long time, since before it supported > CalDAV/CardDAV. > At a site, I had installed DAVical, but I'd like to get rid of it, now > that Cyrus can do what it does. > > I've migrated most calendars and I'm left with only one user, who, > unfortunately, has more than 2k items in his calendar. > Doing it via a client is a pain. > > Is there something like imapsync I can use? > Andrea, Yes, there is something very much like imapsync that you can use, it's called sync-remote-caldav.php and it's in the 'scripts' directory of the Davical distribution.? I used this to migrate from Davical to Cyrus, and it works like a charm.? If you no longer have your Davical distribution directory, just download again. One thing about using this is that it uses relative paths to load parts of the davical library, so you need to run it from within the operational davical location. Good luck! ??? -nic -- Nic Bernstein nic at nicbernstein.com https://www.nicbernstein.com https://www.linkedin.com/in/nic-b-26577a178/ From frederik at frehi.be Sun Feb 23 06:11:13 2020 From: frederik at frehi.be (Frederik Himpe) Date: Sun, 23 Feb 2020 12:11:13 +0100 Subject: Xapian index not being used for message search in Roundcube Message-ID: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> I have configured Cyrus 3.0.13 with the Xapian search engine and enabled search_fuzzy_always. This appears to work fine when I search in the message body using the Evolution mail client, as I get a response quickly: <15824537091582453713>* SEARCH 226927 226929 226964 226974 226999 227215 227238 [...] L03163 OK Completed (643 msgs in 0.970 secs) However when I search messages using the Roundcube webmail client, Roundcube does not get a response in time and shows no results. An strace of the imapd proceess indicates it is STATing, OPENing and MMAPing all files in the mailbox. This is the log: <15824555811582455723>* THREAD (229566)(229570)(229574)(229599)(229618)(229639)[...] A0004 OK Completed (157 msgs in 11.340 secs) So it appears Roundcube is using a different command to search. Is it expected that this command does not use the Xapian search engine? Is there a way to make it use it? Some relevant snippets from imapd.conf: sync_log: on sync_log_channels: squatter conversations: 1 search_engine: xapian search_index_headers: no search_batchsize: 8192 search_fuzzy_always: 1 defaultsearchtier: temp tempsearchpartition-default: /var/lib/cyrus/search.temp datasearchpartition-default: /var/lib/cyrus/search.data cyrus.conf: EVENTS { squatter1 cmd="/usr/bin/nice -n 19 /usr/sbin/cyrus squatter -z data -t temp,data" at=0517 } DAEMON { squatter cmd="squatter -R" } Regards, -- Frederik Himpe From ellie at fastmail.com Sun Feb 23 17:54:44 2020 From: ellie at fastmail.com (ellie timoney) Date: Mon, 24 Feb 2020 09:54:44 +1100 Subject: Xapian index not being used for message search in Roundcube In-Reply-To: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> References: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> Message-ID: <0cea22bf-3544-4b5b-8637-888bf49ac5ed@www.fastmail.com> I don't really understand search in any depth, but it's interesting to observe that, in addition to the different command (SEARCH vs THREAD), those two searches are also using different search criteria ("BODY linux" vs "TEXT linux"). It might be informative to try do the SEARCH search with "TEXT linux" instead of "BODY linux", to narrow down whether the difference is due to the use of the SEARCH vs THREAD command, or the use of the "BODY" vs "TEXT" search key? Looking at the source on master, SEARCH and THREAD both seem to be using the same search API, so at a glance it seems like they should both be using Xapian if either is. And looking at the commit dates on those functions, it doesn't look like it's changed substantially since 3.0, at least not at a level I can easily see. I had a quick look at the RFC, and "BODY" searches just the message body, whereas "TEXT" searches both body and headers. So I wonder if the difference is that TEXT needs to open all the message files to read the headers, whereas BODY can just return results straight from the Xapian index? I'm not sure if there's been changes to header searching (like, maybe we index more of the header content?) since 3.0, but this is getting beyond what I know off the cuff or can just casually look up. Anyway, if you could try "UID SEARCH TEXT linux" and see if that's similarly slow to the THREAD version, that would give us a definite pointer in the right direction. Cheers, ellie On Sun, Feb 23, 2020, at 10:11 PM, Frederik Himpe via Info-cyrus wrote: > I have configured Cyrus 3.0.13 with the Xapian search engine and > enabled search_fuzzy_always. This appears to work fine when I search in > the message body using the Evolution mail client, as I get a response > quickly: > > <1582453709 >1582453713>* SEARCH 226927 > 226929 226964 226974 226999 227215 227238 [...] > L03163 OK Completed (643 > msgs in 0.970 secs) > > However when I search messages using the Roundcube webmail client, > Roundcube does not get a response in time and shows no results. An > strace of the imapd proceess indicates it is STATing, OPENing and > MMAPing all files in the mailbox. > > This is the log: > <1582455581 >1582455723>* THREAD > (229566)(229570)(229574)(229599)(229618)(229639)[...] > A0004 OK Completed (157 msgs in 11.340 secs) > > So it appears Roundcube is using a different command to search. Is it > expected that this command does not use the Xapian search engine? Is > there a way to make it use it? > > Some relevant snippets from imapd.conf: > sync_log: on > sync_log_channels: squatter > > conversations: 1 > search_engine: xapian > search_index_headers: no > search_batchsize: 8192 > search_fuzzy_always: 1 > defaultsearchtier: temp > tempsearchpartition-default: /var/lib/cyrus/search.temp > datasearchpartition-default: /var/lib/cyrus/search.data > > cyrus.conf: > > EVENTS { > squatter1 cmd="/usr/bin/nice -n 19 /usr/sbin/cyrus > squatter -z data -t temp,data" at=0517 > > } > DAEMON { > squatter cmd="squatter -R" > } > > > Regards, > > -- > Frederik Himpe > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > From egoitz at sarenet.es Mon Feb 24 05:04:53 2020 From: egoitz at sarenet.es (egoitz at sarenet.es) Date: Mon, 24 Feb 2020 11:04:53 +0100 Subject: Xapian index not being used for message search in Roundcube In-Reply-To: <0cea22bf-3544-4b5b-8637-888bf49ac5ed@www.fastmail.com> References: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> <0cea22bf-3544-4b5b-8637-888bf49ac5ed@www.fastmail.com> Message-ID: <5B4055BE-5AF0-4454-AA8D-3E98E899F5C9@sarenet.es> Hi Simon, Try selecting the non conversation view before doing the search. It seems Roundcube has something weird there? but I could assure you it uses it when you set the non-conversation (non thread view). I think really it does even there, but perhaps it enter in a non-controlled loop with all the messages of the conversations or something similar? I think this is an issue in Roundcube rather than in Cyrus? We had this same doubt some time ago, Cheers, > El 23 feb 2020, a las 23:54, ellie timoney escribi?: > > I don't really understand search in any depth, but it's interesting to observe that, in addition to the different command (SEARCH vs THREAD), those two searches are also using different search criteria ("BODY linux" vs "TEXT linux"). > > It might be informative to try do the SEARCH search with "TEXT linux" instead of "BODY linux", to narrow down whether the difference is due to the use of the SEARCH vs THREAD command, or the use of the "BODY" vs "TEXT" search key? > > Looking at the source on master, SEARCH and THREAD both seem to be using the same search API, so at a glance it seems like they should both be using Xapian if either is. And looking at the commit dates on those functions, it doesn't look like it's changed substantially since 3.0, at least not at a level I can easily see. > > I had a quick look at the RFC, and "BODY" searches just the message body, whereas "TEXT" searches both body and headers. So I wonder if the difference is that TEXT needs to open all the message files to read the headers, whereas BODY can just return results straight from the Xapian index? > > I'm not sure if there's been changes to header searching (like, maybe we index more of the header content?) since 3.0, but this is getting beyond what I know off the cuff or can just casually look up. > > Anyway, if you could try "UID SEARCH TEXT linux" and see if that's similarly slow to the THREAD version, that would give us a definite pointer in the right direction. > > Cheers, > > ellie > > On Sun, Feb 23, 2020, at 10:11 PM, Frederik Himpe via Info-cyrus wrote: >> I have configured Cyrus 3.0.13 with the Xapian search engine and >> enabled search_fuzzy_always. This appears to work fine when I search in >> the message body using the Evolution mail client, as I get a response >> quickly: >> >> <1582453709>> 1582453713>* SEARCH 226927 >> 226929 226964 226974 226999 227215 227238 [...] >> L03163 OK Completed (643 >> msgs in 0.970 secs) >> >> However when I search messages using the Roundcube webmail client, >> Roundcube does not get a response in time and shows no results. An >> strace of the imapd proceess indicates it is STATing, OPENing and >> MMAPing all files in the mailbox. >> >> This is the log: >> <1582455581>> 1582455723>* THREAD >> (229566)(229570)(229574)(229599)(229618)(229639)[...] >> A0004 OK Completed (157 msgs in 11.340 secs) >> >> So it appears Roundcube is using a different command to search. Is it >> expected that this command does not use the Xapian search engine? Is >> there a way to make it use it? >> >> Some relevant snippets from imapd.conf: >> sync_log: on >> sync_log_channels: squatter >> >> conversations: 1 >> search_engine: xapian >> search_index_headers: no >> search_batchsize: 8192 >> search_fuzzy_always: 1 >> defaultsearchtier: temp >> tempsearchpartition-default: /var/lib/cyrus/search.temp >> datasearchpartition-default: /var/lib/cyrus/search.data >> >> cyrus.conf: >> >> EVENTS { >> squatter1 cmd="/usr/bin/nice -n 19 /usr/sbin/cyrus >> squatter -z data -t temp,data" at=0517 >> >> } >> DAEMON { >> squatter cmd="squatter -R" >> } >> >> >> Regards, >> >> -- >> Frederik Himpe >> >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From egoitz at sarenet.es Mon Feb 24 06:02:17 2020 From: egoitz at sarenet.es (egoitz at sarenet.es) Date: Mon, 24 Feb 2020 12:02:17 +0100 Subject: Migrating calendars to Cyrus In-Reply-To: References: Message-ID: <27F9AACF-B1B8-4F75-AF2D-840491CC7125@sarenet.es> Hi! Yes it exists. It?s called Vdirsyncer. Cherrs! Egoitz Aurrekoetxea Dpto. de sistemas 944 209 470 Parque Tecnol?gico. Edificio 103 48170 Zamudio (Bizkaia) egoitz at sarenet.es www.sarenet.es Antes de imprimir este correo electr?nico piense si es necesario hacerlo. > El 21 feb 2020, a las 12:09, Andrea Venturoli escribi?: > > Hello. > > I've been using CyrusIMAP for a long time, since before it supported CalDAV/CardDAV. > At a site, I had installed DAVical, but I'd like to get rid of it, now that Cyrus can do what it does. > > I've migrated most calendars and I'm left with only one user, who, unfortunately, has more than 2k items in his calendar. > Doing it via a client is a pain. > > Is there something like imapsync I can use? > > bye & Thanks > av. > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From laganarendra at gmail.com Tue Feb 25 04:41:18 2020 From: laganarendra at gmail.com (Laga Narendra) Date: Tue, 25 Feb 2020 15:11:18 +0530 Subject: Fwd: cyrus-imapd issue In-Reply-To: References: Message-ID: Hi, Can any one help me, we are getting freqently below error. please suggest me to resolve this issue. *cyrus-imapd version:* cyrus-imapd-2.5.13.36-0 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:3156.678s pid:5253 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:3099.016s pid:5297 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:3098.915s pid:5298 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:3065.456s pid:5317 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:2782.163s pid:5564 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:2531.806s pid:5750 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:2531.788s pid:5752 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:2531.780s pid:5753 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:2531.678s pid:5755 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1978.227s pid:6270 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1977.701s pid:6276 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1976.319s pid:6278 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1976.312s pid:6279 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1976.305s pid:6280 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1976.255s pid:6281 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1963.599s pid:6291 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1954.837s pid:6302 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1430.551s pid:6870 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1354.811s pid:6961 exited, status 75 Feb 25 05:36:02 mail master[30107]: process type:SERVICE name:imaps path:/usr/lib/cyrus-imapd/imapd age:1323.638s pid:6994 exited, status 75 Thanks, Narendra Laga -------------- next part -------------- An HTML attachment was scrubbed... URL: From egoitz at ramattack.net Tue Feb 25 15:47:47 2020 From: egoitz at ramattack.net (Egoitz Aurrekoetxea) Date: Tue, 25 Feb 2020 21:47:47 +0100 Subject: Xapian index not being used for message search in Roundcube In-Reply-To: <5B4055BE-5AF0-4454-AA8D-3E98E899F5C9@sarenet.es> References: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> <0cea22bf-3544-4b5b-8637-888bf49ac5ed@www.fastmail.com> <5B4055BE-5AF0-4454-AA8D-3E98E899F5C9@sarenet.es> Message-ID: Hi, Please try disabling the threads or conversaci?n view in Roundcube and repleta the search, Cheers! Egoitz, > El 24 feb 2020, a las 11:04, "egoitz at sarenet.es" escribi?: > > Hi Simon, > > Try selecting the non conversation view before doing the search. It seems Roundcube has something weird there? but I could assure you it uses it when you set the non-conversation (non thread view). I think really it does even there, but perhaps it enter in a non-controlled loop with all the messages of the conversations or something similar? I think this is an issue in Roundcube rather than in Cyrus? We had this same doubt some time ago, > > Cheers, > > >> El 23 feb 2020, a las 23:54, ellie timoney escribi?: >> >> I don't really understand search in any depth, but it's interesting to observe that, in addition to the different command (SEARCH vs THREAD), those two searches are also using different search criteria ("BODY linux" vs "TEXT linux"). >> >> It might be informative to try do the SEARCH search with "TEXT linux" instead of "BODY linux", to narrow down whether the difference is due to the use of the SEARCH vs THREAD command, or the use of the "BODY" vs "TEXT" search key? >> >> Looking at the source on master, SEARCH and THREAD both seem to be using the same search API, so at a glance it seems like they should both be using Xapian if either is. And looking at the commit dates on those functions, it doesn't look like it's changed substantially since 3.0, at least not at a level I can easily see. >> >> I had a quick look at the RFC, and "BODY" searches just the message body, whereas "TEXT" searches both body and headers. So I wonder if the difference is that TEXT needs to open all the message files to read the headers, whereas BODY can just return results straight from the Xapian index? >> >> I'm not sure if there's been changes to header searching (like, maybe we index more of the header content?) since 3.0, but this is getting beyond what I know off the cuff or can just casually look up. >> >> Anyway, if you could try "UID SEARCH TEXT linux" and see if that's similarly slow to the THREAD version, that would give us a definite pointer in the right direction. >> >> Cheers, >> >> ellie >> >>> On Sun, Feb 23, 2020, at 10:11 PM, Frederik Himpe via Info-cyrus wrote: >>> I have configured Cyrus 3.0.13 with the Xapian search engine and >>> enabled search_fuzzy_always. This appears to work fine when I search in >>> the message body using the Evolution mail client, as I get a response >>> quickly: >>> >>> <1582453709>>> 1582453713>* SEARCH 226927 >>> 226929 226964 226974 226999 227215 227238 [...] >>> L03163 OK Completed (643 >>> msgs in 0.970 secs) >>> >>> However when I search messages using the Roundcube webmail client, >>> Roundcube does not get a response in time and shows no results. An >>> strace of the imapd proceess indicates it is STATing, OPENing and >>> MMAPing all files in the mailbox. >>> >>> This is the log: >>> <1582455581>>> 1582455723>* THREAD >>> (229566)(229570)(229574)(229599)(229618)(229639)[...] >>> A0004 OK Completed (157 msgs in 11.340 secs) >>> >>> So it appears Roundcube is using a different command to search. Is it >>> expected that this command does not use the Xapian search engine? Is >>> there a way to make it use it? >>> >>> Some relevant snippets from imapd.conf: >>> sync_log: on >>> sync_log_channels: squatter >>> >>> conversations: 1 >>> search_engine: xapian >>> search_index_headers: no >>> search_batchsize: 8192 >>> search_fuzzy_always: 1 >>> defaultsearchtier: temp >>> tempsearchpartition-default: /var/lib/cyrus/search.temp >>> datasearchpartition-default: /var/lib/cyrus/search.data >>> >>> cyrus.conf: >>> >>> EVENTS { >>> squatter1 cmd="/usr/bin/nice -n 19 /usr/sbin/cyrus >>> squatter -z data -t temp,data" at=0517 >>> >>> } >>> DAEMON { >>> squatter cmd="squatter -R" >>> } >>> >>> >>> Regards, >>> >>> -- >>> Frederik Himpe >>> >>> ---- >>> Cyrus Home Page: http://www.cyrusimap.org/ >>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >>> >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: From egoitz at sarenet.es Wed Feb 26 02:44:34 2020 From: egoitz at sarenet.es (egoitz at sarenet.es) Date: Wed, 26 Feb 2020 08:44:34 +0100 Subject: Xapian index not being used for message search in Roundcube In-Reply-To: References: <3594bd756a05cafda57c33a0ae9160ad7b91a935.camel@frehi.be> <0cea22bf-3544-4b5b-8637-888bf49ac5ed@www.fastmail.com> <5B4055BE-5AF0-4454-AA8D-3E98E899F5C9@sarenet.es> Message-ID: Mmm I?ll try too to take a look at these when I have a little time? We though all could came from a Roundcube bug when dealing with mail threads? apart from that, we didn?t really know too how these search commands (that a THREAD command existed) worked too? we should have tried seeing it by ngreping the IMAP conversation, thing that we didn?t? it?s true? Thanks mates :) Bye! Antes de imprimir este correo electr?nico piense si es necesario hacerlo. > El 25 feb 2020, a las 21:47, Egoitz Aurrekoetxea via Info-cyrus escribi?: > > Hi, > > Please try disabling the threads or conversaci?n view in Roundcube and repleta the search, > > Cheers! > > Egoitz, > > El 24 feb 2020, a las 11:04, "egoitz at sarenet.es " > escribi?: > >> Hi Simon, >> >> Try selecting the non conversation view before doing the search. It seems Roundcube has something weird there? but I could assure you it uses it when you set the non-conversation (non thread view). I think really it does even there, but perhaps it enter in a non-controlled loop with all the messages of the conversations or something similar? I think this is an issue in Roundcube rather than in Cyrus? We had this same doubt some time ago, >> >> Cheers, >> >> >>> El 23 feb 2020, a las 23:54, ellie timoney > escribi?: >>> >>> I don't really understand search in any depth, but it's interesting to observe that, in addition to the different command (SEARCH vs THREAD), those two searches are also using different search criteria ("BODY linux" vs "TEXT linux"). >>> >>> It might be informative to try do the SEARCH search with "TEXT linux" instead of "BODY linux", to narrow down whether the difference is due to the use of the SEARCH vs THREAD command, or the use of the "BODY" vs "TEXT" search key? >>> >>> Looking at the source on master, SEARCH and THREAD both seem to be using the same search API, so at a glance it seems like they should both be using Xapian if either is. And looking at the commit dates on those functions, it doesn't look like it's changed substantially since 3.0, at least not at a level I can easily see. >>> >>> I had a quick look at the RFC, and "BODY" searches just the message body, whereas "TEXT" searches both body and headers. So I wonder if the difference is that TEXT needs to open all the message files to read the headers, whereas BODY can just return results straight from the Xapian index? >>> >>> I'm not sure if there's been changes to header searching (like, maybe we index more of the header content?) since 3.0, but this is getting beyond what I know off the cuff or can just casually look up. >>> >>> Anyway, if you could try "UID SEARCH TEXT linux" and see if that's similarly slow to the THREAD version, that would give us a definite pointer in the right direction. >>> >>> Cheers, >>> >>> ellie >>> >>> On Sun, Feb 23, 2020, at 10:11 PM, Frederik Himpe via Info-cyrus wrote: >>>> I have configured Cyrus 3.0.13 with the Xapian search engine and >>>> enabled search_fuzzy_always. This appears to work fine when I search in >>>> the message body using the Evolution mail client, as I get a response >>>> quickly: >>>> >>>> <1582453709>>>> 1582453713>* SEARCH 226927 >>>> 226929 226964 226974 226999 227215 227238 [...] >>>> L03163 OK Completed (643 >>>> msgs in 0.970 secs) >>>> >>>> However when I search messages using the Roundcube webmail client, >>>> Roundcube does not get a response in time and shows no results. An >>>> strace of the imapd proceess indicates it is STATing, OPENing and >>>> MMAPing all files in the mailbox. >>>> >>>> This is the log: >>>> <1582455581>>>> 1582455723>* THREAD >>>> (229566)(229570)(229574)(229599)(229618)(229639)[...] >>>> A0004 OK Completed (157 msgs in 11.340 secs) >>>> >>>> So it appears Roundcube is using a different command to search. Is it >>>> expected that this command does not use the Xapian search engine? Is >>>> there a way to make it use it? >>>> >>>> Some relevant snippets from imapd.conf: >>>> sync_log: on >>>> sync_log_channels: squatter >>>> >>>> conversations: 1 >>>> search_engine: xapian >>>> search_index_headers: no >>>> search_batchsize: 8192 >>>> search_fuzzy_always: 1 >>>> defaultsearchtier: temp >>>> tempsearchpartition-default: /var/lib/cyrus/search.temp >>>> datasearchpartition-default: /var/lib/cyrus/search.data >>>> >>>> cyrus.conf: >>>> >>>> EVENTS { >>>> squatter1 cmd="/usr/bin/nice -n 19 /usr/sbin/cyrus >>>> squatter -z data -t temp,data" at=0517 >>>> >>>> } >>>> DAEMON { >>>> squatter cmd="squatter -R" >>>> } >>>> >>>> >>>> Regards, >>>> >>>> -- >>>> Frederik Himpe > >>>> >>>> ---- >>>> Cyrus Home Page: http://www.cyrusimap.org/ >>>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>>> To Unsubscribe: >>>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >>>> >>> ---- >>> Cyrus Home Page: http://www.cyrusimap.org/ >>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >>> To Unsubscribe: >>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus >> >> ---- >> Cyrus Home Page: http://www.cyrusimap.org/ >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ >> To Unsubscribe: >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus ---- > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -------------- next part -------------- An HTML attachment was scrubbed... URL: