From stockton at netbg.com Fri Aug 1 05:32:42 2008 From: stockton at netbg.com (Stoyan Tzalev) Date: Fri, 1 Aug 2008 12:32:42 +0300 Subject: Skiplist errors on Cyrus 2.3.12 In-Reply-To: <20080714071057.GA13835@rzdspc6.informatik.uni-hamburg.de> References: <20080711093751.GA19670@rzdspc6.informatik.uni-hamburg.de> <20080711125500.GA21954@brong.net> <20080714071057.GA13835@rzdspc6.informatik.uni-hamburg.de> Message-ID: <200808011232.42751.stockton@netbg.com> Hi guys, sorry to confirm this,but it looks like I ran into the same issue on my testing machine, even with safeunlock and readlock patches applied: Aug 1 11:39:26 newmail imap[26804]: Deleted mailbox user.stockton Aug 1 11:39:26 newmail last message repeated 3 times Aug 1 11:39:26 newmail imap[26804]: Deleted mailbox user Aug 1 11:39:26 newmail imap[26804]: can not unlink /var/lib/imap/user/s/stockton.mboxkey: No such file or directory Aug 1 11:39:26 newmail imap[26804]: Fatal error: Internal error: assertion failed: cyrusdb_skiplist.c: 622: db->lock_status == UNLOCKED Aug 1 11:39:26 newmail imap[26804]: skiplist: closed while still locked Aug 1 11:39:26 newmail master[26792]: process 26804 exited, status 75 Aug 1 11:39:26 newmail master[26792]: service imap pid 26804 in BUSY state: terminated abnormally All I did was to login as the cyrus admin user, set the appropriate acl to allow deletion of a mailbox, and then delete it. OS is CentOS 5.2 i386, Cyrus built from source RPM obtained from http://www.invoca.ch/pub/packages/cyrus-imapd/ with the safeunlock and readlocktracking patches applied additionally. imapd.conf is attached. Best regards, Stoyan On Monday 14 July 2008 10:10:58 Reinhard Zierke wrote: > > hmm... and I realise I haven't updated the website for a while. > > Doing that now... ok: > > > > http://cyrus.brong.fastmail.fm/patches/cyrus-skiplist-safeunlock-2.3.12.d > >iff > > http://cyrus.brong.fastmail.fm/patches/cyrus-skiplist-readlocktracking-2. > >3.12.diff > > > > I'd be interested to know if the issue still exists with these. > > They tidy up the logic for locks even more. I needed it to make > > the fast_rename and folder_limit stuff work again. > > These patches didn't help. I still get the same error message on my test > machine: > Jul 14 09:04:16 rzdspc11 cyradm[27124]: [ID 637875 local6.error] Fatal > error: Internal error: assertion failed: cyrusdb_skiplist.c: 622: > db->lock_status == UNLOCKED Jul 14 09:04:16 rzdspc11 cyradm[27124]: [ID > 558109 local6.error] skiplist: closed while still locked > > Sorry, > Reinhard -------------- next part -------------- configdirectory: /var/lib/imap #partition-default: /var/spool/imap partition-default: /cyrus admins: cyrus cyradmin sievedir: /var/lib/imap/sieve sendmail: /usr/sbin/sendmail hashimapspool: true sasl_pwcheck_method: saslauthd sasl_mech_list: PLAIN LOGIN tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt #create options createonpost: 1 autocreatequota: 1048576 autocreateinboxfolders: Sent|Drafts|Trash|Spam duplicatesuppression: 1 expunge_mode: delayed loginuseacl: 1 unixhierarchysep: 1 #popminpoll: 1 popsubfolders: 1 poppollpadding: 3 singleinstancestore: 1 username_tolower: 1 unix_group_enable: 0 virtdomains: userid normalizeuid: 1 allowplaintext: 1 allowplainwithouttls: 1 defaultdomain: digitalsol.net #DB types annotation_db: skiplist duplicate_db: skiplist mboxlist_db: skiplist ptscache_db: skiplist quota_db: skiplist seenstate_db: skiplist #subscription_db: flat subscription_db: skiplist #tlscache_db: berkeley-nosync tlscache_db: skiplist #DB tuning berkeley_cachesize: 10240 berkeley_locks_max: 5000 berkeley_txns_max: 1000 #security imapidresponse: 0 #softfail if over quota lmtp_over_quota_perm_failure: 0 #accept any size? ### maxmessagesize: 0 # FM stuff internaldate_heuristic: receivedheader # sieve features sieve_extensions: fileinto reject vacation imapflags notify include envelope body relational regex subaddress copy sieve_maxscripts: 1024 From boutilpj at ednet.ns.ca Fri Aug 1 18:13:55 2008 From: boutilpj at ednet.ns.ca (Patrick Boutilier) Date: Fri, 01 Aug 2008 19:13:55 -0300 Subject: Several cyrus instances on same host. In-Reply-To: <200807311232.21349.carles@unlimitedmail.org> References: <200807311232.21349.carles@unlimitedmail.org> Message-ID: UnlimitedMail.net - Carles Xavier Munyoz Bald? wrote: > Hello, > Is it possible to run several cyrus imap instances (with different cyrus.conf > and imapd.conf files) on the same server? > > I will like to have all related files for imap server A in one directory > (/imapA) and all the related files for imap server B in another directory > (/imapB). Is it possible? From "man master" . Configure your alternate config files to point to different directories. OPTIONS -C alternate imapd.conf Specifies an alternate imapd.conf for use by master (note that this will not affect any sub-processes spawned by master, you should specify those specifically in the respective entries in cyrus.conf). -M alternate cyrus.conf Specifies an alternate cyrus.conf for use by master. > > Best regards. > --- > UnlimitedMail.net - Carles Xavier Munyoz Bald? > cmunyoz at unlimitedmail.net > http://www.unlimitedmail.net/ > --- > > --- > La informaci?n contenida en este e-mail es confidencial, > siendo para uso exclusivo del destinatario arriba mencionado. > Le informamos que est? totalmente prohibida cualquier > utilizaci?n, divulgaci?n, distribuci?n y/o reproducci?n de > esta comunicaci?n sin autorizaci?n expresa en virtud de la > legislaci?n vigente. Si ha recibido este mensaje por error, > le rogamos nos lo notifique inmediatamente por la misma v?a > y proceda a su eliminaci?n. > --- > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html From robm at fastmail.fm Fri Aug 1 22:26:48 2008 From: robm at fastmail.fm (Rob Mueller) Date: Sat, 2 Aug 2008 12:26:48 +1000 Subject: Several cyrus instances on same host. References: <200807311232.21349.carles@unlimitedmail.org> Message-ID: <1af101c8f447$39817560$0b01a8c0@robmhp> > Is it possible to run several cyrus imap instances (with different > cyrus.conf > and imapd.conf files) on the same server? > > I will like to have all related files for imap server A in one directory > (/imapA) and all the related files for imap server B in another directory > (/imapB). Is it possible? No problem at all. We run up to 20 different instances of cyrus on some of our machines. You just have to setup separate cyrus.conf and imapd.conf files, separate start/stop scripts, and use the -C option on every command you run. The main thing I'd recommend is that you create separate instance files like: /etc/cyrus-a.conf and /etc/imapd-a.conf /etc/cyrus-b.conf and /etc/imapd-b.conf And completely delete /etc/cyrus.conf and /etc/imapd.conf. That way if you run "reconstruct" or any other tool on it's own, it'll complain that it couldn't find a imapd.conf file. You have to specify the -C option, so that you explicitly tell the command which instance you want to work with. By not having a "default" install, this will avoids mistakes with running the wrong command. One other thing you'll have to do is bind each instance to different port numbers, or different IP addresses. Rob From dimma at higis.ru Sun Aug 3 01:45:49 2008 From: dimma at higis.ru (Dmitriy Kirhlarov) Date: Sun, 03 Aug 2008 09:45:49 +0400 Subject: ptloader problem Message-ID: <4895460D.6030103@higis.ru> Hi, list We find a problem -- when ptloader build with ldap support by gcc4 on amd64 platform it's doesn't work. After investigation ptloader core with gdb we find a problem. (I'm sorry, for possible unpropper problem description) 1. ldap.h have hints: ---- #if LDAP_DEPRECATED LDAP_F( char ** ) ldap_get_values LDAP_P(( /* deprecated, use ldap_get_values_len */ LDAP *ld, LDAPMessage *entry, LDAP_CONST char *target )); ---- 2. cyrus building without "-DLDAP_DEPRECATED", by default and ldap_get_values is "int32" 3. ptloader running 3.1 call libldap 3.2 libldap get values from server 3.3 return pointer to ptloader as int64 3.4 ptloader get it as _int32_ and core dumping My test configuration: cyrus-imapd-2.3.{8,11} with ldap support cyrus-sasl-saslauthd-2.1.22 with ldap support openldap 2.{3,4} FreeBSD 7.0 amd64 This configuration work very good on FreeBSD 6.x amd64. userbase in ldap, authentication over saslauthd, authorization over ptloader. How I can report a but to developers? I can provide my configs and detalize test procedure, if needed. WBR Dmitriy From mcnutt at buffalo.edu Tue Aug 5 14:24:15 2008 From: mcnutt at buffalo.edu (James M McNutt) Date: Tue, 5 Aug 2008 14:24:15 -0400 (EDT) Subject: upgraded to v2.3.12p2 Message-ID: not sure why we get "Unknown code imap 54" any help, thanks, -jim before upgrade we got: ====================== telnet mailhost 143 Connected to mailhost Escape character is '^]'. * OK mailhost Cyrus IMAP4 v2.2.12 server ready . login cyrus sercert . OK User logged in . capability * CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ MAILBOX-REFERRALS NAMESPACE UIDPLUS ID NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE IDLE LOGINDISABLED . OK Completed . logout * BYE LOGOUT received . OK Completed Connection closed by foreign host. after upgrade to v2.3.12p2 we get: ====================== telnet mailhost 143 Connected to mailhost Escape character is '^]'. * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID STARTTLS AUTH=PLAIN SASL-IR] mailhost Cyrus IMAP v2.3.12p2 server ready * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID STARTTLS AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE URLAUTH . OK Unknown code imap 54 . logout * BYE Unknown code imap 53 . OK Unknown code imap 54 Connection to mailhost closed by foreign host. this is on solaris9 for cyrus-2.2.12 ./configure --with-auth=unix \ --with-cyrus-group=mail \ --prefix=/global/mail6/cyrus-2.2.12 --with-cyrus-prefix=/global/mail6/cyrus-2.2.12 --with-cyrus-user=cyrus \ --disable-murder \ --with-dbdir=/usr/local/BerkeleyDB.4.2 \ --with-bdb-incdir=/usr/local/BerkeleyDB.4.2/include \ --with-bdb-libdir=/usr/local/BerkeleyDB.4.2/lib \ --with-duplicate-db=skiplist \ --with-mboxlist-db=skiplist \ --with-seen-db=skiplist \ --with-subs-db=flat \ --with-tls-db=skiplist \ --with-openssl=/usr/local/ssl \ --with-perl=/usr/local/bin/perl \ --with-sasl=/usr/local \ --with-statedir=/global/mail6/cyrus-2.2.12/var \ --disable-sieve \ --with-libwrap=no \ --with-ucdsnmp=no for cyrus-2.3.12p2 ./configure --with-auth=unix \ --with-cyrus-group=mail \ --prefix=/global/mail6/cyrus-2.3.12p2 \ --with-cyrus-prefix=/global/mail6/cyrus-2.3.12p2 \ --with-cyrus-user=cyrus \ --with-dbdir=/usr/local/BerkeleyDB.4.2 \ --with-bdb-incdir=/usr/local/BerkeleyDB.4.2/include \ --with-bdb-libdir=/usr/local/BerkeleyDB.4.2/lib \ --with-duplicate-db=skiplist \ --with-mboxlist-db=skiplist \ --with-seen-db=skiplist \ --with-subs-db=flat \ --with-tls-db=skiplist \ --with-openssl=/usr/local/ssl \ --with-perl=/usr/local/bin/perl \ --with-sasl=/usr/local/sasl2 \ --enable-replication --with-statedir=/global/mail6/cyrus-2.3.12p2/var \ --with-libwrap=no \ --with-ucdsnmp=no From paul at vandervlis.nl Thu Aug 7 04:51:21 2008 From: paul at vandervlis.nl (Paul van der Vlis) Date: Thu, 07 Aug 2008 10:51:21 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences Message-ID: <489AB789.4080003@vandervlis.nl> Hello. I did an upgrade from Cyrus 2.1 tot 2.2, both packages in Debian Etch. The documentation is a bit poor, that's why I wrote about my experiences. Maybe somebody else likes it. And I would like to hear critics, because I have to upgrade another 8 machines... But I have no problems with the 2 machines I did this way. First I stopped the services: /etc/init.d/postfix stop /etc/init.d/cyrus21 stop check if it worked: ps ax|grep cyr; ps ax|grep imapd; ps ax|grep pop3d kill open processes. close the firewall for pop3 and IMAP. close local mailprogramms close webmail make backups: cp -a /var/lib/cyrus /var/lib/cyrus-backup cp -a /var/spool/sieve /var/spool/sieve-backup cp -a /usr/lib/cyrus/ /usr/lib/cyrus-backup cp -a /var/spool/cyrus /var/spool/cyrus-backup The last one takes long... remove packages: apt-get remove cyrus21-common cyrus21-admin cyrus21-clients libcyrus-imap-perl21 dpkg --get-selections | grep cyrus backup config-files: mv /etc/imapd.conf /etc/imapd.conf.backup mv /etc/cyrus.conf /etc/cyrus.conf.backup install packages: apt-get install cyrus-imapd-2.2 cyrus-admin-2.2 cyrus-clients-2.2 libcyrus-imap-perl22 db4.2-util cyrus-pop3d-2.2 choose to overwrite cyrus.conf and imapd.conf (I wonder why this files are still there). You will see this and Cyrus will not start. --------- Database backends have changed! Comparison between /usr/lib/cyrus/cyrus-db-types.txt and /usr/lib/cyrus/cyrus-db-types.active shows that database backends for Cyrus IMAPd have been changed. This means that those databases for which the database backends changed might need to be converted manually to the new format, using the cvt_cyrusdb(8) utility. Please refer to /usr/share/doc/cyrus-common-2.2/README.Debian.database for more information. Do not start cyrmaster until you have converted the databases to the new format. --------- edit /etc/imapd.conf, in my case I had to do this: admins: cyrus sasl_mech_list: PLAIN sasl_minimum_layer: 0 sasl_pwcheck_method: saslauthd then convert the databases (on one line): find /var/lib/cyrus/ -name \*.db -print -exec /usr/bin/db4.2_upgrade {} \; this was my output: ---------- /var/lib/cyrus/mailboxes.db db_upgrade: /var/lib/cyrus/mailboxes.db: unrecognized file type db_upgrade: DB->upgrade: /var/lib/cyrus/mailboxes.db: Invalid argument /var/lib/cyrus/tls_sessions.db /var/lib/cyrus/deliver.db /var/lib/cyrus/db.backup1/mailboxes.db db_upgrade: /var/lib/cyrus/db.backup1/mailboxes.db: unrecognized file type db_upgrade: DB->upgrade: /var/lib/cyrus/db.backup1/mailboxes.db: Invalid argument /var/lib/cyrus/db.backup2/mailboxes.db db_upgrade: /var/lib/cyrus/db.backup2/mailboxes.db: unrecognized file type db_upgrade: DB->upgrade: /var/lib/cyrus/db.backup2/mailboxes.db: Invalid argument ---------- So "mailboxes.db" did not work, but the other databases did. Because I use sieve, I also had to convert this to bytecode: su cyrus /usr/lib/cyrus/upgrade/masssievec /usr/lib/cyrus/bin/sievec /etc/imapd.conf exit this was the output: -------- you are using /var/spool/sieve as your sieve directory. processing user .... processing user .... processing user .... (...) ---------- Then I studied the texts in UPGRADE.Debian and README.Debian.database and "upgrading from previous versions" from Cyrus, and I even wrote a little script to convert mailboxes.db and seen.db, but in practice every mailbox says: "Warning: apparently empty database converted.". So in pratice I did nothing to convert the seen.db and the mailboxes.db (I used the backup to go-back). I will add the script on the end of this message, maybe it can be good to mass-convert databases in another situation. Then copy the cyrus-db-types.active out of the way (one line): mv /usr/lib/cyrus/cyrus-db-types.active /usr/lib/cyrus/cyrus-db-types.active.old Reconfigure the package: dpkg-reconfigure cyrus-common-2.2 It says: ------- Stopping Cyrus IMAPd: . Creating/updating cyrus user account... The user `cyrus' is already a member of `sasl'. Creating cyrus control directories in /var/lib/cyrus... Creating partition spool /var/spool/cyrus/mail... Creating partition spool /var/spool/cyrus/news... Trying to optimize Cyrus partitions, edit /etc/default/cyrus2.2 to disable... Starting Cyrus IMAPd: cyrmaster. --------- After this, Cyrus is running again. I did a reconstruct (but it takes time, you can also do it when everything is ready). su cyrus cd /var/spool/cyrus /usr/sbin/cyrreconstruct -r user.* exit Then I tested the IMAP, without Postfix. Maybe you will need to open the firewall for your IP. I did this, because I can go back to the backup situation now. Once I start Postfix or open IMAP or POP3 for the public, I cannot go back. In first instance I found Cyrus 2.2 not so fast as 2.1, but after some time testing it became better. After the tests, start postfix, webmail, change your firewall. and remove backups: rm -r/var/lib/cyrus-backup rm -r /var/spool/sieve-backup rm -r /usr/lib/cyrus-backup rm -r /var/spool/cyrus-backup rm /etc/imapd.conf.backup rm /etc/cyrus.conf.backup With regards, Paul van der Vlis. the script I did not use, at the end. But maybe useable in another situation: --------- su cyrus cd / mv /var/lib/cyrus/mailboxes.db /var/lib/cyrus/mailboxes.db.old \ /usr/sbin/cvt_cyrusdb /var/lib/cyrus/mailboxes.db.old flat \ /var/lib/cyrus/mailboxes.db skiplist chown cyrus:mail /var/lib/cyrus/mailboxes.db rm -f /var/lib/cyrus/mailboxes.db.old find /var/lib/cyrus/ -name \*.seen -print -exec mv {} {}.old \; \ -exec /usr/sbin/cvt_cyrusdb {}.old flat {} skiplist \; \ -exec chown cyrus:mail {} \; find /var/lib/cyrus/ -name \*.seen.old -print -exec rm {} \; -------- -- http://www.vandervlis.nl/ From chitnis.ashay at gmail.com Sat Aug 9 14:08:17 2008 From: chitnis.ashay at gmail.com (Ashay Chitnis) Date: Sat, 9 Aug 2008 23:38:17 +0530 Subject: sasl canon_user Message-ID: Hi all, I am having cyrus-imapd and cyrus-sasl running on the Mail Server with saslauthd passing the authentication to ldap server. This is working fine. I have to integrate it with my AD server. The problem is my ldap server uses the uid as "abc at xyz.com" to authenticate. But the AD server takes the user name as "abc". Is there any way i can use mapping in saslauthd so that abc at xyz.com is take by imapd but ONLY for authentication abc at xyz.com is mapped to abc? On net i saw there is a canon_user plugin in cyrus sasl, anyone has idea how to use it to achieve the above objective? regards, Ashay. -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080809/c0ab3332/attachment.html From dwhite at olp.net Sat Aug 9 17:08:30 2008 From: dwhite at olp.net (Dan White) Date: Sat, 09 Aug 2008 16:08:30 -0500 Subject: sasl canon_user In-Reply-To: References: Message-ID: <489E074E.5020405@olp.net> Ashay Chitnis wrote: > Hi all, > > I am having cyrus-imapd and cyrus-sasl running on the Mail Server with > saslauthd passing the authentication to ldap server. This is working fine. > > I have to integrate it with my AD server. The problem is my ldap > server uses the uid as "abc at xyz.com " to > authenticate. But the AD server takes the user name as "abc". Is > there any way i can use mapping in saslauthd so that abc at xyz.com > is take by imapd but ONLY for authentication > abc at xyz.com is mapped to abc? > > On net i saw there is a canon_user plugin in cyrus sasl, anyone has > idea how to use it to achieve the above objective? Ashay, You may be able to accomplish this by specifying a defaultdomain of xyz.com, assuming that you have virtdomains: userid' set. If not, there is an ldapdb canon_user plugin in CVS (sasl). Documentation is included in the doc/options.html file. It requires that your ldap server support authc/authz (proxy) authentication and the 'whoami' extended operation. It works independently of your authentication configuration, so you should not have to use the ldapdb auxprop plugin (but you may want to). My imapd.conf looks like: sasl_ldapdb_uri: ldap://ldap.example.net sasl_ldapdb_mech: GSSAPI sasl_ldapdb_canon_attr: uid imap_sasl_canon_user_plugin: ldapdb pop3_sasl_canon_user_plugin: ldapdb The ldapdb canon_user plugin works by authenticating as a user with escalated permissions (in my case a GSSAPI user) and using the submitted username 'abc' as the authorization identity. It will search for the attribute you specified in 'ldapdb_canon_attr' within the user's (abc's) entry, and return it as the canonicalized username. imapd with use the canonicalized username (abc at xyz.com) when searching for the user's mailbox. - Dan From peo at intersonic.se Sun Aug 10 10:56:26 2008 From: peo at intersonic.se (Per olof Ljungmark) Date: Sun, 10 Aug 2008 16:56:26 +0200 Subject: sync: DELSUB on non-existant mailbox Message-ID: <489F019A.30306@intersonic.se> On a sync job running from cron to the tape backup server I get this on a few mailboxes. Problem is, the ones below are nowhere to be found on master or slave. Where does sync_client fetch the mailbox info from? DELSUB username INBOX^INBOX^Drafts DELSUB username INBOX^INBOX^Sent DELSUB username INBOX^INBOX^Trash DELSUB username INBOX^Trash^INBOX^Drafts DELSUB username INBOX^Trash^INBOX^Sent DELSUB username INBOX^Trash^INBOX^Trash From wes at umich.edu Sun Aug 10 13:47:55 2008 From: wes at umich.edu (Wesley Craig) Date: Sun, 10 Aug 2008 13:47:55 -0400 Subject: sync: DELSUB on non-existant mailbox In-Reply-To: <489F019A.30306@intersonic.se> References: <489F019A.30306@intersonic.se> Message-ID: The user's subscription DB, on either the master or the replica. :wes On 10 Aug 2008, at 10:56, Per olof Ljungmark wrote: > Where does sync_client fetch the mailbox info from? > > DELSUB username INBOX^INBOX^Drafts > DELSUB username INBOX^INBOX^Sent > DELSUB username INBOX^INBOX^Trash > DELSUB username INBOX^Trash^INBOX^Drafts > DELSUB username INBOX^Trash^INBOX^Sent > DELSUB username INBOX^Trash^INBOX^Trash From peo at intersonic.se Sun Aug 10 14:01:29 2008 From: peo at intersonic.se (Per olof Ljungmark) Date: Sun, 10 Aug 2008 20:01:29 +0200 Subject: sync: DELSUB on non-existant mailbox In-Reply-To: References: <489F019A.30306@intersonic.se> Message-ID: <489F2CF9.4080104@intersonic.se> Wesley Craig wrote: > The user's subscription DB, on either the master or the replica. Yes, indeed, it was on the replica. Thanks a lot! > On 10 Aug 2008, at 10:56, Per olof Ljungmark wrote: >> Where does sync_client fetch the mailbox info from? >> >> DELSUB username INBOX^INBOX^Drafts >> DELSUB username INBOX^INBOX^Sent >> DELSUB username INBOX^INBOX^Trash >> DELSUB username INBOX^Trash^INBOX^Drafts >> DELSUB username INBOX^Trash^INBOX^Sent >> DELSUB username INBOX^Trash^INBOX^Trash From mathieu.kretchner at sophia.inria.fr Mon Aug 11 02:32:55 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Mon, 11 Aug 2008 08:32:55 +0200 Subject: Cyrus vs Dovecot Message-ID: <489FDD17.6090705@sophia.inria.fr> First of all : forgive me for my poor English Hello all, I've to compare cyrus with dovecot for my work. Because these are the only solutions that could fit our needs. Unfortunately I really don't know cyrus and I would like to have some of its assets. Here are the properties of the versus table I've done : dovecot cyrus Installation: Update: Migration from cyrus : Migration from dovecot : functionalities : Management : Local Delivery : availability : Security : Indexes management : NFS compatibility : Scalability : Configuration : interoperability : Sieve filter : Documentation : Quota capability : Performance : IMAP capability : So I know this can scared you, but If you have some asset for cyrus, It could be great and a lot more FAIR !! Thank you in advance for your advice. -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080811/228cd54e/attachment.vcf From aspineux at gmail.com Mon Aug 11 07:22:16 2008 From: aspineux at gmail.com (Alain Spineux) Date: Mon, 11 Aug 2008 13:22:16 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <489FDD17.6090705@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> Message-ID: <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> 2008/8/11 Mathieu Kretchner : > First of all : forgive me for my poor English > > Hello all, > > I've to compare cyrus with dovecot for my work. Because these are the only > solutions that could fit our needs. > Unfortunately I really don't know cyrus and I would like to have some of its > assets. what do you need ? how many mailbox ? how many users ? what is in use now ? what kind of access ? IMAP, POP3, webmail ? how many server ? Do you already have a database with your user ? in wich format ? > Here are the properties of the versus table I've done : > dovecot cyrus > Installation: > Update: > Migration from cyrus : > Migration from dovecot : > functionalities : > Management : > Local Delivery : > availability : > Security : > Indexes management : > NFS compatibility : > Scalability : > Configuration : > interoperability : > Sieve filter : > Documentation : > Quota capability : > Performance : > IMAP capability : > > So I know this can scared you, but If you have some asset for cyrus, It > could be great and a lot more FAIR !! > > Thank you in advance for your advice. > > > > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From mathieu.kretchner at sophia.inria.fr Mon Aug 11 08:57:33 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Mon, 11 Aug 2008 14:57:33 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> Message-ID: <48A0373D.6040703@sophia.inria.fr> Alain Spineux a ?crit : > 2008/8/11 Mathieu Kretchner : >> First of all : forgive me for my poor English >> >> Hello all, >> >> I've to compare cyrus with dovecot for my work. Because these are the only >> solutions that could fit our needs. >> Unfortunately I really don't know cyrus and I would like to have some of its >> assets. > > what do you need ? A secure / reliable / fast / easy to configure Imap server ! > how many mailbox ? 5000 > how many users ? 6000 > what is in use now ? Cyrus > what kind of access ? IMAP, POP3, webmail ? All of them! > how many server ? 2 > Do you already have a database with your user ? in wich format ? YES : LDAP / NIS The real question is because we have only 2 options : Why should I choose Cyrus instead of dovecot ? > > >> Here are the properties of the versus table I've done : >> dovecot cyrus >> Installation: >> Update: >> Migration from cyrus : >> Migration from dovecot : >> functionalities : >> Management : >> Local Delivery : >> availability : >> Security : >> Indexes management : >> NFS compatibility : >> Scalability : >> Configuration : >> interoperability : >> Sieve filter : >> Documentation : >> Quota capability : >> Performance : >> IMAP capability : >> >> So I know this can scared you, but If you have some asset for cyrus, It >> could be great and a lot more FAIR !! >> >> Thank you in advance for your advice. >> >> >> >> ---- >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >> > > > -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080811/db1621d8/attachment.vcf From wes at umich.edu Mon Aug 11 09:38:48 2008 From: wes at umich.edu (Wesley Craig) Date: Mon, 11 Aug 2008 09:38:48 -0400 Subject: Cyrus vs Dovecot In-Reply-To: <48A0373D.6040703@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> Message-ID: <613A8E58-31A6-4854-9B40-858836CB2E08@umich.edu> On 11 Aug 2008, at 08:57, Mathieu Kretchner wrote: >> what is in use now ? > Cyrus > > Why should I choose Cyrus instead of dovecot ? Are you having a problem with Cyrus? Migrating from any server to any other is likely to be challenging (to say the least), so you ought to have a pretty compelling reason to migrate before you decide to. :wes From adam at morrison-ind.com Mon Aug 11 10:12:59 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Mon, 11 Aug 2008 10:12:59 -0400 Subject: Cyrus vs Dovecot In-Reply-To: <48A0373D.6040703@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> Message-ID: <1218463979.8286.1.camel@linux-nnci.site> > The real question is because we have only 2 options : > Why should I choose Cyrus instead of dovecot ? Features like delayed expunge, message expiration, etc... that allow you to have a managed mail store. Cyrus is the only Open Source IMAP/POP server I know of with any capacity to support data-retention policies. From mathieu.kretchner at sophia.inria.fr Mon Aug 11 10:44:45 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Mon, 11 Aug 2008 16:44:45 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <613A8E58-31A6-4854-9B40-858836CB2E08@umich.edu> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <613A8E58-31A6-4854-9B40-858836CB2E08@umich.edu> Message-ID: <48A0505D.4020805@sophia.inria.fr> Wesley Craig a ?crit : > On 11 Aug 2008, at 08:57, Mathieu Kretchner wrote: >>> what is in use now ? >> Cyrus >> >> Why should I choose Cyrus instead of dovecot ? > > Are you having a problem with Cyrus? Migrating from any server to any > other is likely to be challenging (to say the least), so you ought to > have a pretty compelling reason to migrate before you decide to. > > :wes Not realy, we have an old hardware with an old imap server and we want to reconsider our choice ! My question is explicitly open to have multiple answers An I'm having only new questions ! :-/ -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080811/19ad1443/attachment.vcf From peo at intersonic.se Mon Aug 11 10:57:49 2008 From: peo at intersonic.se (Per olof Ljungmark) Date: Mon, 11 Aug 2008 16:57:49 +0200 Subject: sync: DELSUB on non-existant mailbox In-Reply-To: References: <489F019A.30306@intersonic.se> Message-ID: <48A0536D.9030706@intersonic.se> Wesley Craig wrote: > The user's subscription DB, on either the master or the replica. But then why does ADDSUB work but not DELSUB? I've got the feeling I'm missing something here... ADD/DELSUB both works for the online replica with rolling replication... The command is sync_client -l -S -u -f --per From schweizer.martin at gmail.com Mon Aug 11 11:48:26 2008 From: schweizer.martin at gmail.com (Martin Schweizer) Date: Mon, 11 Aug 2008 17:48:26 +0200 Subject: sync_client / sasldb Message-ID: <380ccfd60808110848ka2de8ecj5ee61b95e94c81cb@mail.gmail.com> Hello I have two mail server (FreeBSD 7.0, sendmail/cyrus v2.3.12p2), incl. replication with sync_client/-master. Until now they works perfect. Now I changed on the sync_server from sasldb (Berkeley db1.85) to saslauthd (with saslauthd -a getpwent, the Unix password file). All works but not the replication (but the login to cyrus imapd works). So I tracked down the problem to the sasldb file. I seems that the sync mechanism needs the sync_authname in the sasldb (it not check the password file). Is this correct? Regards, -- Martin Schweizer schweizer.martin at gmail.com Tel.: +41 32 512 48 54 (VoIP) Fax: +1 619 3300587 From dimma at higis.ru Mon Aug 11 14:04:28 2008 From: dimma at higis.ru (Dmitriy Kirhlarov) Date: Mon, 11 Aug 2008 22:04:28 +0400 Subject: ptloader problem In-Reply-To: References: <48903AEF.6070506@higis.ru> Message-ID: <48A07F2C.2000005@higis.ru> I can't do it. I try to create new login for my e-mail. Register it. Waiting several days for confirmation link without success. Could you, please, open this bug report? Wesley Craig wrote: > You can add it to the bugzilla here: > > https://bugzilla.andrew.cmu.edu/ > > Thanks! > > :wes > > On 30 Jul 2008, at 05:57, Dmitriy Kirhlarov wrote: >> We find a problem -- when ptloader build with ldap support by gcc4 on >> amd64 platform it's doesn't work. >> >> After investigation ptloader core with gdb we find a problem. (I'm >> sorry, for possible unpropper problem description) >> >> 1. ldap.h have hints: >> ---- >> #if LDAP_DEPRECATED >> LDAP_F( char ** ) >> ldap_get_values LDAP_P(( /* deprecated, use ldap_get_values_len */ >> LDAP *ld, >> LDAPMessage *entry, >> LDAP_CONST char *target )); >> ---- >> >> 2. cyrus building without "-DLDAP_DEPRECATED", by default and >> ldap_get_values is "int32" >> >> 3. ptloader running >> 3.1 call libldap >> 3.2 libldap get values from server >> 3.3 return pointer to ptloader as int64 >> 3.4 ptloader get it as _int32_ and core dumping >> >> My test configuration: >> cyrus-imapd-2.3.{8,11} with ldap support >> cyrus-sasl-saslauthd-2.1.22 with ldap support >> openldap 2.{3,4} >> FreeBSD 7.0 amd64 >> >> This configuration work very good on FreeBSD 6.x amd64. >> userbase in ldap, authentication over saslauthd, authorization over >> ptloader. >> >> How I can report a but to developers? >> I can provide my configs and detalize test procedure, if needed. > WBR Dmitriy From davidk at cs.umass.edu Mon Aug 11 15:30:39 2008 From: davidk at cs.umass.edu (David Korpiewski) Date: Mon, 11 Aug 2008 15:30:39 -0400 Subject: Admin functions not working when logging into cyradm Message-ID: <48A0935F.8090609@cs.umass.edu> I'm having a problem when I log into the cyradm interface (/usr/bin/cyrus/admin/cyradm) as an administrator I don't get the list of the 'Other Users/username'. I really don't understand why. Can someone help me? Imapd.conf: ---------- admins: davidk, cyrusimap, cyrusadministrator, steve configdirectory: /var/imap partition-default: /var/spool/imap (rest clipped).... Example: ---------- server:admin root# ./cyradm -u davidk server.cs.umass.edu Password: server.cs.umass.edu> lm INBOX (\Noinferiors) Trash (\HasNoChildren) server.cs.umass.edu> Example 2: ---------- server:admin root# ./cyradm -u cyrusadministrator server.cs.umass.edu Password: server.cs.umass.edu> lm INBOX (\Noinferiors) server.cs.umass.edu> I should be seeing 'Other Users/steve' and other mailboxes, but unfortunately I'm not. I can use any one of the list of administrators listed in the Imapd.conf but none of them work :-( Why? -- =========================================== David Korpiewski Software Specialist I CSCF - Computer Science Computing Facility Department of Computer Science Phone: 413-545-4319 Fax: 413-577-2285 =========================================== From morgan at orst.edu Mon Aug 11 16:08:31 2008 From: morgan at orst.edu (Andrew Morgan) Date: Mon, 11 Aug 2008 13:08:31 -0700 (PDT) Subject: Admin functions not working when logging into cyradm In-Reply-To: <48A0935F.8090609@cs.umass.edu> References: <48A0935F.8090609@cs.umass.edu> Message-ID: On Mon, 11 Aug 2008, David Korpiewski wrote: > I'm having a problem when I log into the cyradm interface > (/usr/bin/cyrus/admin/cyradm) as an administrator I don't get the list > of the 'Other Users/username'. I really don't understand why. Can > someone help me? > > Imapd.conf: > ---------- > admins: davidk, cyrusimap, cyrusadministrator, steve > configdirectory: /var/imap > partition-default: /var/spool/imap > (rest clipped).... > > > Example: > ---------- > server:admin root# ./cyradm -u davidk server.cs.umass.edu > Password: > server.cs.umass.edu> lm > INBOX (\Noinferiors) Trash (\HasNoChildren) > server.cs.umass.edu> > > Example 2: > ---------- > server:admin root# ./cyradm -u cyrusadministrator server.cs.umass.edu > Password: > server.cs.umass.edu> lm > INBOX (\Noinferiors) > server.cs.umass.edu> > > I should be seeing 'Other Users/steve' and other mailboxes, but > unfortunately I'm not. I can use any one of the list of administrators > listed in the Imapd.conf but none of them work :-( Why? It sounds like you have unixhierarchysep:1 and altnamespace:1 set. The manpage says: ----------------------------------------------- altnamespace: 0 Use the alternate IMAP namespace, where personal folders reside at the same level in the hierarchy as INBOX. This option ONLY applies where interaction takes place with the client/user. Currently this is limited to the IMAP protocol (imapd) and Sieve scripts (lmtpd). This option does NOT apply to admin tools such as cyradm (admins ONLY), reconstruct, quota, etc., NOR does it affect LMTP delivery of messages directly to mailboxes via plus-addressing. ----------------------------------------------- You need to use the standard internal namespace notation when using cyradm. Try the command "lm user/%". I recommend reading the altnamespace documentation. Here is my local copy: http://admin.onid.oregonstate.edu/cyrus-imapd-2.3.11/altnamespace.html Generally speaking, your administrators should NOT have mailboxes of their own... Your regular email client can do funny things when it can see and modify all mailboxes on the system. Andy From thiagoh at digirati.com.br Mon Aug 11 17:10:07 2008 From: thiagoh at digirati.com.br (Thiago Henrique) Date: Mon, 11 Aug 2008 18:10:07 -0300 Subject: timsieved float comparison Message-ID: <1218489007.6171.22.camel@henrique> Hi, About timsieved: Is there comparison of float numbers in timsieved? I know the "i; ascii-numeric", but it compares only positive integers. ?Thank you all in advance. Best Regards -- []'s Thiago Henrique Network Administration Digirati Networks K8 Networks From michael.menge at zdv.uni-tuebingen.de Tue Aug 12 04:06:14 2008 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Tue, 12 Aug 2008 10:06:14 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A0505D.4020805@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <613A8E58-31A6-4854-9B40-858836CB2E08@umich.edu> <48A0505D.4020805@sophia.inria.fr> Message-ID: <20080812100614.h37f8g085cwook4o@webmail.uni-tuebingen.de> Hi, Quoting Mathieu Kretchner : > Wesley Craig a ?crit : >> On 11 Aug 2008, at 08:57, Mathieu Kretchner wrote: >>>> what is in use now ? >>> Cyrus >>> >>> Why should I choose Cyrus instead of dovecot ? >> >> Are you having a problem with Cyrus? Migrating from any server to >> any other is likely to be challenging (to say the least), so you >> ought to have a pretty compelling reason to migrate before you >> decide to. >> >> :wes > > Not realy, we have an old hardware with an old imap server and we want > to reconsider our choice ! > > My question is explicitly open to have multiple answers > > An I'm having only new questions ! :-/ As i don't know your environment and which features of Cyrus are usefull for you, i can give olny some genneral hints. And as i don't know the feature of dovecot i won't compare cyrus and dovecot. 1. Upgrading to an newer version of Cyrus is easier as Migrating to an other Software. See install-upgrade.html in your cyrus/doc for details. One common problem with system upgrades is a changed version of Berkeley DB so you should dump the databases on the old system and import them in the new. 2. You know the Cyrus Administration, you don't need to change the interfaces to your Usermanagement. 3. With the new "Delayed expunge" feature, you won't miss emails in backup which where recieved and delete between backups. Restoring emails still in delayed expunge is much easier and faster as recovering the mail form backup. 4. The new replication system allows you to keep a copy of your mailstore you can failover to in case of a systemcrash. 5. There have been additions to the Sieve and IMAP extensions and many other changes. See changes.html in your cyrus/doc for details -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de Waechterstrasse 76 72074 Tuebingen From mathieu.kretchner at sophia.inria.fr Tue Aug 12 06:53:47 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Tue, 12 Aug 2008 12:53:47 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <1218463979.8286.1.camel@linux-nnci.site> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> Message-ID: <48A16BBB.6070707@sophia.inria.fr> Adam Tauno Williams a ?crit : >> The real question is because we have only 2 options : >> Why should I choose Cyrus instead of dovecot ? > > Features like delayed expunge, message expiration, etc... that allow you > to have a managed mail store. Cyrus is the only Open Source IMAP/POP > server I know of with any capacity to support data-retention policies. > > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Ok thanks ! A good point on the cyrus side ! What about the performance ? Does my next configuration will run correctly ? Which hardware should I buy for this activity ? At present, we have a lot of I/O, we wonder if the last version of cyrus is improved for this point ? regards. -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080812/a7268aad/attachment.vcf From ian.batten at uk.fujitsu.com Tue Aug 12 07:08:06 2008 From: ian.batten at uk.fujitsu.com (Ian G Batten) Date: Tue, 12 Aug 2008 12:08:06 +0100 Subject: SASL MySQL Backend Considered Beneficial In-Reply-To: <380ccfd60808110848ka2de8ecj5ee61b95e94c81cb@mail.gmail.com> References: <380ccfd60808110848ka2de8ecj5ee61b95e94c81cb@mail.gmail.com> Message-ID: <5AEB2B2B-B9D8-40A2-9EB2-97064971078E@uk.fujitsu.com> On 11 Aug 08, at 1648, Martin Schweizer wrote: > Hello > > I have two mail server (FreeBSD 7.0, sendmail/cyrus v2.3.12p2), incl. > replication with sync_client/-master. Until now they works perfect. > Now I changed on the sync_server from sasldb (Berkeley db1.85) to > saslauthd (with saslauthd -a getpwent, the Unix password file). All > works but not the replication (but the login to cyrus imapd works). So > I tracked down the problem to the sasldb file. I seems that the sync > mechanism needs the sync_authname in the sasldb (it not check the > password file). Is this correct? In passing, and for what it's worth, one of the best moves I ever made on my private Cyrus server, which I'm working myself up to do for my day job Cyrus server, was to switch over to using the mysql backend to SASL and divorcing it both from the password file and from the /etc/ sasldb mechanism. I did it because it means I can operate mail accounts disjoint from real user accounts: I can log in, but my wife, kids, parents etc only have the ability to send and receive email. But most importantly it means I have an authentication database which I can secure on a per- subsystem basis while sharing records. Trying to use /etc/sasldb with the same authenticators shared between cyrus (running as uid cyrus) and sendmail (running as uid smmta) is a living hell, whereas with MySQL I just use imapd.conf settings: sasl_pwcheck_method: auxprop sasl_auxprop_plugin: sql sasl_auto_transition: yes sasl_sql_engine: mysql sasl_sql_hostnames: localhost sasl_sql_user: cyrus sasl_sql_passwd: xxxx sasl_sql_database: cyrussasl sasl_sql_select: select %p from users where username = '%u' sasl_sql_insert: insert into users (username, realm, %p) values ('%u', '%r', '%v') sasl_sql_update: update users set %p='%v' where username='%u' and in Sendmail.conf (in my case in /opt/sasl2/lib/sasl2, but your mileage will vary): pwcheck_method: auxprop auxprop_plugin: sql sql_engine: mysql sql_hostnames: localhost sql_user: sendmail sql_passwd: xxxx sql_database: cyrussasl sql_select: SELECT userPassword FROM users WHERE username = '%u' mech_list: digest-md5 cram-md5 sql_verbose: yes My database has accreted columns, so when I commission users I have to put their secret into several of them, which I should fix one day: CREATE TABLE `users` ( `username` varchar(64) NOT NULL default '', `realm` varchar(64) default NULL, `userPassword` varchar(64) default NULL, `cmusaslsecretPLAIN` varchar(64) default NULL, `cmusaslsecretDIGEST` varchar(64) default NULL, `MD5` varchar(64) default NULL, `cmusaslsecretCRAM` varchar(64) default NULL, PRIMARY KEY (`username`) ) TYPE=InnoDB Not the question you asked, I know, but I'm been meaning to mention just how flexible this setup is. ian From adam at morrison-ind.com Tue Aug 12 09:27:15 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Tue, 12 Aug 2008 09:27:15 -0400 Subject: Cyrus vs Dovecot In-Reply-To: <48A16BBB.6070707@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> Message-ID: <1218547635.6086.6.camel@linux-nnci.site> On Tue, 2008-08-12 at 12:53 +0200, Mathieu Kretchner wrote: > Adam Tauno Williams a ?crit : > >> The real question is because we have only 2 options : > >> Why should I choose Cyrus instead of dovecot ? > > Features like delayed expunge, message expiration, etc... that allow you > > to have a managed mail store. Cyrus is the only Open Source IMAP/POP > > server I know of with any capacity to support data-retention policies. > Ok thanks ! A good point on the cyrus side ! > What about the performance ? Cyrus performance is excellent. Is there a specific problem? Personally I don't think anything is faster than Cyrus. > Does my next configuration will run correctly ? Which hardware should I > buy for this activity ? Beats me. > At present, we have a lot of I/O, we wonder if the last version of cyrus > is improved for this point ? If you have allot of users and allot of mail you are going to have allot of I/O. No way around that, regardless of the server. Cyrus' indexes headers better now, so that might help. But you still need adequate through-put. I've found that /var/lib/imap (meta-data) needs fast I/O but /var/spool/imap (message store) doesn't due too bad tossed onto a SAN or slower disks. From Pascal.Gienger at uni-konstanz.de Tue Aug 12 10:00:53 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Tue, 12 Aug 2008 16:00:53 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A16BBB.6070707@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> Message-ID: <1788B4F56F09E426F1902B62@priscilla.rz.uni-konstanz.de> Mathieu Kretchner wrote: > Ok thanks ! A good point on the cyrus side ! > > What about the performance ? Depends on which size your scenario will be. > Does my next configuration will run correctly ? Which hardware should I > buy for this activity ? That's like asking a crystal sphere whether the woman you love is the right one to marry... How many users did use your old server? How many incoming messages per second? How much storage was used? How many clients did connect simulteanously to your old Cyrus server? > At present, we have a lot of I/O, we wonder if the last version of cyrus > is improved for this point ? We stored (before using graylisting) 30 messages/sec via Cyrus on two mirrored SAN volumes. 1200 imapd are running on peak times. No murder. 8 TB storage; 2TB used. 58,000 mailboxes; 12,000 users. 20 GB RAM, 14 GB ARC (zfs cache). SAN via Sun MPxIO (scsi_vhci). You see, without knowing the size of your old Cyrus solution it is not possible to say whether it is "enough" or not. From mathieu.kretchner at sophia.inria.fr Tue Aug 12 10:38:56 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Tue, 12 Aug 2008 16:38:56 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <1218547635.6086.6.camel@linux-nnci.site> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <1218547635.6086.6.camel@linux-nnci.site> Message-ID: <48A1A080.9080206@sophia.inria.fr> Adam Tauno Williams a ?crit : > On Tue, 2008-08-12 at 12:53 +0200, Mathieu Kretchner wrote: >> Adam Tauno Williams a ?crit : >>>> The real question is because we have only 2 options : >>>> Why should I choose Cyrus instead of dovecot ? >>> Features like delayed expunge, message expiration, etc... that allow you >>> to have a managed mail store. Cyrus is the only Open Source IMAP/POP >>> server I know of with any capacity to support data-retention policies. >> Ok thanks ! A good point on the cyrus side ! >> What about the performance ? > > Cyrus performance is excellent. Is there a specific problem? > Personally I don't think anything is faster than Cyrus. > >> Does my next configuration will run correctly ? Which hardware should I >> buy for this activity ? > > Beats me. > >> At present, we have a lot of I/O, we wonder if the last version of cyrus >> is improved for this point ? > > If you have allot of users and allot of mail you are going to have allot > of I/O. No way around that, regardless of the server. Cyrus' indexes > headers better now, so that might help. But you still need adequate > through-put. I've found that /var/lib/imap (meta-data) needs fast I/O > but /var/spool/imap (message store) doesn't due too bad tossed onto a > SAN or slower disks. Ok I got it, thanks for your experience feed back ! > > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 268 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080812/8f7be8bd/attachment.vcf From Pascal.Gienger at uni-konstanz.de Tue Aug 12 11:51:46 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Tue, 12 Aug 2008 17:51:46 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <1218547635.6086.6.camel@linux-nnci.site> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <1218547635.6086.6.camel@linux-nnci.site> Message-ID: <16E8DEB3FC4B4ADA3CE28F4A@schnucki.djehoulou.com> Adam Tauno Williams wrote: > If you have allot of users and allot of mail you are going to have allot > of I/O. No way around that, regardless of the server. Cyrus' indexes > headers better now, so that might help. But you still need adequate > through-put. I've found that /var/lib/imap (meta-data) needs fast I/O > but /var/spool/imap (message store) doesn't due too bad tossed onto a > SAN or slower disks. That depends how many mails per second you will have to deliver. Normally you are right, the meta partition is heavy random i/o. With high mail receiving rates you need a fast write storage for your imap spool as well. Filesystems like ZFS which write their contents nearly sequentially are ideal for this kind of work. And: Use a 64bit system and add much RAM. Your OS will (hopefully) cache all metadata which is heavily used in RAM. We are having 98% hits on our meta partition. From wes at umich.edu Tue Aug 12 12:03:54 2008 From: wes at umich.edu (Wesley Craig) Date: Tue, 12 Aug 2008 12:03:54 -0400 Subject: Cyrus vs Dovecot In-Reply-To: <48A16BBB.6070707@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> Message-ID: On 12 Aug 2008, at 06:53, Mathieu Kretchner wrote: > At present, we have a lot of I/O, we wonder if the last version of > cyrus is improved for this point ? Recent versions have several features designed to allow very large scaling of I/O. In addition to optimization to the old architecture, header, index, cache, expunge, and squat can be moved to a separate metapartition. That means you have (effectively) three possible I/O paths -- the mail, the indices, and the mailboxes.db. Each can be on separate storage with optimal price vs performance characteristics for the proposed load. With only 5000 users on two machines, I suspect simply replacing the old machines with new machines will be such a performance increase that very little optimization would be required. :wes From mathieu.kretchner at sophia.inria.fr Wed Aug 13 02:26:49 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Wed, 13 Aug 2008 08:26:49 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <1788B4F56F09E426F1902B62@priscilla.rz.uni-konstanz.de> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <1788B4F56F09E426F1902B62@priscilla.rz.uni-konstanz.de> Message-ID: <48A27EA9.7080809@sophia.inria.fr> Pascal Gienger a ?crit : > Mathieu Kretchner wrote: > >> Ok thanks ! A good point on the cyrus side ! >> >> What about the performance ? > > Depends on which size your scenario will be. > >> Does my next configuration will run correctly ? Which hardware should I >> buy for this activity ? > > That's like asking a crystal sphere whether the woman you love is the > right one to marry... How many users did use your old server? How many > incoming messages per second? How much storage was used? How many > clients did connect simulteanously to your old Cyrus server? > >> At present, we have a lot of I/O, we wonder if the last version of cyrus >> is improved for this point ? > > We stored (before using graylisting) 30 messages/sec via Cyrus on two > mirrored SAN volumes. 1200 imapd are running on peak times. No murder. 8 > TB storage; 2TB used. 58,000 mailboxes; 12,000 users. > > 20 GB RAM, 14 GB ARC (zfs cache). SAN via Sun MPxIO (scsi_vhci). > > You see, without knowing the size of your old Cyrus solution it is not > possible to say whether it is "enough" or not. I thanks you for your participation but not for the way you do it because if you had read my second mail on this topic you wouldn't have to ask your crystal sphere to wonder what is my configuration !! My questions are septics because we have performance problem with our cyrus configuration. We must do something and I'm here trying to compare what will be the best solution for us. I can do some mistakes because it will be temporary but if I find the good server with one try It will be better for our next architecture. Thanks again for your help. -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/8c7777ff/attachment.vcf From Pascal.Gienger at uni-konstanz.de Wed Aug 13 04:44:36 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Wed, 13 Aug 2008 10:44:36 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A27EA9.7080809@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <1788B4F56F09E426F1902B62@priscilla.rz.uni-konstanz.de> <48A27EA9.7080809@sophia.inria.fr> Message-ID: Mathieu Kretchner wrote: > I thanks you for your participation but not for the way you do it because > if you had read my second mail on this topic you wouldn't have to ask > your crystal sphere to wonder what is my configuration !! I did miss your 2nd post, I am sorry. J'ai manqu? votre 2?me message, pri?re de m'excuser. From torlasz at xenia.sote.hu Wed Aug 13 05:38:55 2008 From: torlasz at xenia.sote.hu (Tornoci Laszlo) Date: Wed, 13 Aug 2008 11:38:55 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A0373D.6040703@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> Message-ID: <48A2ABAF.1010206@xenia.sote.hu> Mathieu Kretchner wrote: > Alain Spineux a ?crit : >> 2008/8/11 Mathieu Kretchner : >>> First of all : forgive me for my poor English >>> >>> Hello all, >>> >>> I've to compare cyrus with dovecot for my work. Because these are the >>> only >>> solutions that could fit our needs. >>> Unfortunately I really don't know cyrus and I would like to have some >>> of its >>> assets. >> >> what do you need ? > A secure / reliable / fast / easy to configure Imap server ! > >> how many mailbox ? > 5000 > >> how many users ? > 6000 > >> what is in use now ? > Cyrus > > >> what kind of access ? IMAP, POP3, webmail ? > All of them! > >> how many server ? > 2 > >> Do you already have a database with your user ? in wich format ? > YES : LDAP / NIS > > The real question is because we have only 2 options : > > Why should I choose Cyrus instead of dovecot ? Hi, I happen to use both Dovecot and Cyrus. Dovecot is an excellent choice, if you want to migrate from an old imap box with mbox or maildir based mailstore. Dovecot knows these formats, so the migration is very easy. Dovecot is very easy to set up, reliable, has nice features. However, if you currently use Cyrus, it seems quite foolish to switch to Dovecot. This means all sorts of headaches without gaining anything. You would have to migrate all your Cyrus mailstore to another (probably maildir) format. I would do this only, if I had a really compelling reason. As others have already pointed out, Cyrus has more features, and I haven't heard of major differences between Dovecot and Cyrus in terms of speed or reliability either. Cyrus scales better, too. Yours: Laszlo From ian.batten at uk.fujitsu.com Wed Aug 13 05:57:11 2008 From: ian.batten at uk.fujitsu.com (Ian G Batten) Date: Wed, 13 Aug 2008 10:57:11 +0100 Subject: Cyrus vs Dovecot In-Reply-To: References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> Message-ID: <576DF165-9CE2-415F-9F42-9FBE65A6BB51@uk.fujitsu.com> > the mail, the indices, and the mailboxes.db. Each can be on > separate storage with optimal price vs performance characteristics > for the proposed load. We have 48000 mailboxes on behalf of 2000 users, with typically 1700 imapd processes during the day and ~1000 overnight. There's about 3.4TB of mail stored. We run Cyrus 2.3.9 (12p1 is due for the next time the machine has a maintenance window) in a Solaris zone (container) on a Sun T2000 with 16GB of RAM. The load on the machine is typically low: -------------- next part -------------- A non-text attachment was scrubbed... Name: graph_image.php.png Type: image/png Size: 23532 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/16785f39/attachment-0001.png -------------- next part -------------- We have mailboxes.db and the metapartitions on ZFS, along with the zone iteself. The pool is drawn from space on four 10000rpm SAS drives internal to the machine: NAME STATE READ WRITE CKSUM pool1 ONLINE 0 0 0 mirror ONLINE 0 0 0 c0t0d0s4 ONLINE 0 0 0 c0t1d0s4 ONLINE 0 0 0 mirror ONLINE 0 0 0 c0t2d0s4 ONLINE 0 0 0 c0t3d0s4 ONLINE 0 0 0 They're fairly busy, mostly with writes (1 second resolution): capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- pool1 39.4G 38.6G 10 77 472K 509K pool1 39.4G 38.6G 0 65 0 1.09M pool1 39.4G 38.6G 2 521 1.98K 3.03M pool1 39.4G 38.6G 2 170 255K 951K pool1 39.4G 38.6G 0 37 0 249K pool1 39.4G 38.6G 0 35 0 310K pool1 39.4G 38.6G 2 22 16.3K 430K pool1 39.4G 38.6G 9 660 284K 4.65M pool1 39.4G 38.6G 0 118 506 296K pool1 39.4G 38.6G 0 2 0 27.7K pool1 39.4G 38.6G 4 39 96.0K 990K pool1 39.4G 38.6G 1 89 1013 997K pool1 39.4G 38.6G 3 775 56.4K 5.06M pool1 39.4G 38.6G 0 160 0 531K pool1 39.4G 38.6G 0 20 0 118K pool1 39.4G 38.6G 0 11 0 83.2K pool1 39.4G 38.6G 0 41 0 595K pool1 39.4G 38.6G 0 624 1013 3.46M This indicates that most client-side reads are being serviced from cache (as you'd expect with 16GB of RAM). We have 21.4GB of meta data on disk, which we run with ZFS compression to reduce IO bandwidth (at the expense of CPU utilisation, of which we have plenty spare). The ZFS compression ratio is about 1.7x: cyrus.cache, in particular, is very compressible. The message store is out on the `archive' QoS of a Pillar Axiom AX500, so the data's living in the slow regions of SATA drives, that would otherwise go to waste. We see ~20ms for all reads, because they are essentially random and have to come up from the spindle of the NFS server. Writes go to mirrored RAM on the server at take ~2ms. Because most clients cache content these days, the load on those partitions is much lower. Ten seconds' of sar output yields: 10:47:34 device %busy avque r+w/s blks/s avwait avserv [...] nfs73 16 0.2 10 84 0.0 15.6 nfs86 43 0.4 24 205 0.0 18.5 nfs87 1 0.0 3 152 0.0 7.2 nfs96 2 0.0 6 369 0.0 6.9 nfs101 0 0.0 1 35 0.0 5.0 nfs102 0 0.0 0 0 0.0 0.0 ian From carles at unlimitedmail.org Wed Aug 13 06:22:48 2008 From: carles at unlimitedmail.org (UnlimitedMail.net - Carles Xavier Munyoz =?utf-8?q?Bald=C3=B3?=) Date: Wed, 13 Aug 2008 12:22:48 +0200 Subject: Several problems with mupdate master. Message-ID: <200808131222.49149.carles@unlimitedmail.org> Hello, I'm setting up a Cyrus Aggregator system with SUSE 10 SP2 and cyrus-imapd-2.2.12. (1) One of the problems I have is that the mupdate master process generates too many logs lines like these: [...] Worker thread finished, for a total of 5 (5 spare) New worker thread started, for a total of 6 Worker thread finished, for a total of 5 (5 spare) New worker thread started, for a total of 6 Worker thread finished, for a total of 5 (5 spare) New worker thread started, for a total of 6 [...] Is it possible to avoid that mupdate generates this logs? How? (2) I have setup two backend servers with more than 4000 mailboxes on each one of them. When I start the ctl_mboxlist on the backends with the -m option, at the begining it goes fine but, suddenly it stops with the error: permanant failure storing 'user.myuser.Trash' In the /var/log/messages file I see the errors: [...] mupdate[22275]: cmd_find(fd:10, user.myuser.Trash) master[5709]: process 22275 exited, signaled to death by 6 master[5709]: service mupdate pid 22275 in READY state: terminated abnormally master[6867]: about to exec /usr/lib/cyrus/bin/mupdate mupdate[6867]: executed [...] If I restart the ctl_mboxlist command it continues from the stop point but after some time it stops again with the same error. Why is happeninig that? How may I solve it? Thank you very much for your time and help. --- UnlimitedMail.net - Carles Xavier Munyoz Bald? cmunyoz at unlimitedmail.net http://www.unlimitedmail.net/ --- --- La informaci?n contenida en este e-mail es confidencial, siendo para uso exclusivo del destinatario arriba mencionado. Le informamos que est? totalmente prohibida cualquier utilizaci?n, divulgaci?n, distribuci?n y/o reproducci?n de esta comunicaci?n sin autorizaci?n expresa en virtud de la legislaci?n vigente. Si ha recibido este mensaje por error, le rogamos nos lo notifique inmediatamente por la misma v?a y proceda a su eliminaci?n. --- From leonk at construct.haifa.ac.il Wed Aug 13 07:48:23 2008 From: leonk at construct.haifa.ac.il (Leon Kolchinsky) Date: Wed, 13 Aug 2008 14:48:23 +0300 Subject: Web-cyradm and Zimbra maybe? Message-ID: <20080813115232.2687720@mail.edu.haifa.ac.il> Hello All, I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix integration) for years and very happy with it. Now we need some implementation for shared calendars (let's say calendar solution for all our users). What would you recommend? Web-cyradm and Zimbra integration? Anyone have any experience with it? How would you handle authentication issue? Any other suggestions? Thanks, Leon From mathieu.kretchner at sophia.inria.fr Wed Aug 13 07:59:52 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Wed, 13 Aug 2008 13:59:52 +0200 Subject: Cyrus vs Dovecot In-Reply-To: References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <1788B4F56F09E426F1902B62@priscilla.rz.uni-konstanz.de> <48A27EA9.7080809@sophia.inria.fr> Message-ID: <48A2CCB8.6020006@sophia.inria.fr> Pascal Gienger a ?crit : > Mathieu Kretchner wrote: > >> I thanks you for your participation but not for the way you do it because >> if you had read my second mail on this topic you wouldn't have to ask >> your crystal sphere to wonder what is my configuration !! > > I did miss your 2nd post, I am sorry. > J'ai manqu? votre 2?me message, pri?re de m'excuser. > That's ok ! sorry for this mail a little bit violent... -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 268 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/eccad405/attachment.vcf From mathieu.kretchner at sophia.inria.fr Wed Aug 13 08:09:24 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Wed, 13 Aug 2008 14:09:24 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A2ABAF.1010206@xenia.sote.hu> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <48A2ABAF.1010206@xenia.sote.hu> Message-ID: <48A2CEF4.1090003@sophia.inria.fr> Tornoci Laszlo a ?crit : > Mathieu Kretchner wrote: >> Alain Spineux a ?crit : >>> 2008/8/11 Mathieu Kretchner : >>>> First of all : forgive me for my poor English >>>> >>>> Hello all, >>>> >>>> I've to compare cyrus with dovecot for my work. Because these are the >>>> only >>>> solutions that could fit our needs. >>>> Unfortunately I really don't know cyrus and I would like to have some >>>> of its >>>> assets. >>> what do you need ? >> A secure / reliable / fast / easy to configure Imap server ! >> >>> how many mailbox ? >> 5000 >> >>> how many users ? >> 6000 >> >>> what is in use now ? >> Cyrus >> >> >>> what kind of access ? IMAP, POP3, webmail ? >> All of them! >> >>> how many server ? >> 2 >> >>> Do you already have a database with your user ? in wich format ? >> YES : LDAP / NIS >> >> The real question is because we have only 2 options : >> >> Why should I choose Cyrus instead of dovecot ? > > Hi, > > I happen to use both Dovecot and Cyrus. Dovecot is an excellent choice, > if you want to migrate from an old imap box with mbox or maildir based > mailstore. Dovecot knows these formats, so the migration is very easy. > Dovecot is very easy to set up, reliable, has nice features. > > However, if you currently use Cyrus, it seems quite foolish to switch to > Dovecot. This means all sorts of headaches without gaining anything. You > would have to migrate all your Cyrus mailstore to another (probably > maildir) format. I would do this only, if I had a really compelling > reason. As others have already pointed out, Cyrus has more features, and > I haven't heard of major differences between Dovecot and Cyrus in terms > of speed or reliability either. Cyrus scales better, too. > > Yours: Laszlo > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html That's right ! It's a really important point in which we have to focus and do the better choice for sysadmin and users too. So I'm happy to see that you use the two imap server of this topic and your point of view of "not switch to dovecot" because of our old cyrus architecture is quite interesting. regards -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/ae3e821d/attachment.vcf From kbajwa at tibonline.net Wed Aug 13 10:31:55 2008 From: kbajwa at tibonline.net (kbajwa) Date: Wed, 13 Aug 2008 08:31:55 -0600 Subject: Cyrus vs Dovecot In-Reply-To: <48A27EA9.7080809@sophia.inria.fr> Message-ID: <80307EBE75234C35A06E502D4887FE86@Sunshine> Hello: I think you are missing a point which is most important, i.e., what type of support Cyrus vs Dovecot offers. In my experience: Cyrus = 0 Dovecot = 100 My personal experience. Kirt From thiagoh at digirati.com.br Wed Aug 13 10:40:14 2008 From: thiagoh at digirati.com.br (Thiago Henrique) Date: Wed, 13 Aug 2008 11:40:14 -0300 Subject: timsieved float comparison Message-ID: <1218638414.6983.0.camel@henrique> Hi, About timsieved: Is there comparison of float numbers in timsieved? I know the "i; ascii-numeric", but it compares only positive integers. ?Thank you all in advance. Best Regards -- []'s Thiago Henrique Network Administration Digirati Networks K8 Networks From mathieu.kretchner at sophia.inria.fr Wed Aug 13 11:38:52 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Wed, 13 Aug 2008 17:38:52 +0200 Subject: [Dovecot] Cyrus vs Dovecot In-Reply-To: <80307EBE75234C35A06E502D4887FE86@Sunshine> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> Message-ID: <48A3000C.4080506@sophia.inria.fr> kbajwa a ?crit : > Hello: > > I think you are missing a point which is most important, i.e., what type of > support Cyrus vs Dovecot offers. In my experience: > > Cyrus = 0 > Dovecot = 100 > > > My personal experience. > > Kirt > I guess you've right but I can't post this answer at Cyrus mailing list. I'm just trying to have my own opinion of imap server and I already have sarcastic answer on the cyrus mailing list ! regards -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/45cd1add/attachment.vcf From Pascal.Gienger at uni-konstanz.de Wed Aug 13 11:47:52 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Wed, 13 Aug 2008 17:47:52 +0200 Subject: [Dovecot] Cyrus vs Dovecot In-Reply-To: <48A3000C.4080506@sophia.inria.fr> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> <48A3000C.4080506@sophia.inria.fr> Message-ID: <0346A1105D5A8E683C524F65@tmo-044-17.customers.d1-online.com> Mathieu Kretchner wrote: > kbajwa a ?crit : >> Cyrus = 0 >> Dovecot = 100 > I guess you've right but I can't post this answer at Cyrus mailing list. > I'm just trying to have my own opinion of imap server and I already have > sarcastic answer on the cyrus mailing list ! Stop. What's this? a) crossposing content to the dovecot mailing list b) talking about "sarcastic" answers when users try to help you saying that migrating from an old cyrus release to a new one is easier then migrating to a new system? c) many users here have described their running configuration to help you. d) starting an advocacy war? What are you trying to do? From raj at csub.edu Wed Aug 13 12:08:25 2008 From: raj at csub.edu (Russell Jackson) Date: Wed, 13 Aug 2008 09:08:25 -0700 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <20080813115232.2687720@mail.edu.haifa.ac.il> References: <20080813115232.2687720@mail.edu.haifa.ac.il> Message-ID: <48A306F9.3090905@csub.edu> Leon Kolchinsky wrote: > Hello All, > > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > integration) for years and very happy with it. > Now we need some implementation for shared calendars (let's say calendar > solution for all our users). > > What would you recommend? > Web-cyradm and Zimbra integration? Anyone have any experience with it? How > would you handle authentication issue? > > Any other suggestions? > Bedework[1] seems interesting. [1] http://www.bedework.org/ -- Russell A. Jackson Network Analyst California State University, Bakersfield Nobody can be as agreeable as an uninvited guest. -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/x-pkcs7-signature Size: 4291 bytes Desc: S/MIME Cryptographic Signature Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080813/8c637521/attachment.bin From wes at umich.edu Wed Aug 13 13:07:34 2008 From: wes at umich.edu (Wesley Craig) Date: Wed, 13 Aug 2008 13:07:34 -0400 Subject: Cyrus vs Dovecot In-Reply-To: <80307EBE75234C35A06E502D4887FE86@Sunshine> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> Message-ID: <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> On 13 Aug 2008, at 10:31, kbajwa wrote: > I think you are missing a point which is most important, i.e., what > type of > support Cyrus vs Dovecot offers. In my experience: > > Cyrus = 0 > Dovecot = 100 As someone who answers many help requests for cyrus (and I'm very far from the only one), I can honestly say I've never seen a requests from you. Perhaps you've had a lot of occasion to ask for help with Dovecot. I'm happy to hear you've gotten that help. Community is a lot of what open source software is about. As for your experience with the cyrus imapd community, perhaps your sample size is too small. Or perhaps you're thinking of paid support? Because I know very well that you can get that for cyrus imap. :wes From adam at morrison-ind.com Wed Aug 13 14:01:22 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Wed, 13 Aug 2008 14:01:22 -0400 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <20080813115232.2687720@mail.edu.haifa.ac.il> References: <20080813115232.2687720@mail.edu.haifa.ac.il> Message-ID: <1218650482.4721.5.camel@linux-nnci.site> On Wed, 2008-08-13 at 14:48 +0300, Leon Kolchinsky wrote: > Hello All, > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > integration) for years and very happy with it. > Now we need some implementation for shared calendars (let's say calendar > solution for all our users). > What would you recommend? > Web-cyradm and Zimbra integration? Anyone have any experience with it? How > would you handle authentication issue? > Any other suggestions? OpenGroupware. From peo at intersonic.se Wed Aug 13 18:40:13 2008 From: peo at intersonic.se (Per olof Ljungmark) Date: Thu, 14 Aug 2008 00:40:13 +0200 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <20080813115232.2687720@mail.edu.haifa.ac.il> References: <20080813115232.2687720@mail.edu.haifa.ac.il> Message-ID: <48A362CD.3000802@intersonic.se> Leon Kolchinsky wrote: > Hello All, > > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > integration) for years and very happy with it. > Now we need some implementation for shared calendars (let's say calendar > solution for all our users). > > What would you recommend? > Web-cyradm and Zimbra integration? Anyone have any experience with it? How > would you handle authentication issue? We use Horde here with LDAP for domains+cyrus+postfix+calendars but it works equally well with SQL. Got excellent webmail interface as well as shared calendar support. http://www.horde.org/ --per From brong at fastmail.fm Wed Aug 13 21:10:03 2008 From: brong at fastmail.fm (Bron Gondwana) Date: Thu, 14 Aug 2008 11:10:03 +1000 Subject: Cyrus vs Dovecot In-Reply-To: <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> Message-ID: <20080814011003.GA13266@brong.net> On Wed, Aug 13, 2008 at 01:07:34PM -0400, Wesley Craig wrote: > On 13 Aug 2008, at 10:31, kbajwa wrote: > > I think you are missing a point which is most important, i.e., what > > type of > > support Cyrus vs Dovecot offers. In my experience: > > > > Cyrus = 0 > > Dovecot = 100 > > As someone who answers many help requests for cyrus (and I'm very far > from the only one), I can honestly say I've never seen a requests > from you. Perhaps you've had a lot of occasion to ask for help with > Dovecot. I'm happy to hear you've gotten that help. Community is a > lot of what open source software is about. As for your experience > with the cyrus imapd community, perhaps your sample size is too small. Yeah, there are a few of us here answering help requests, and even helping debugging in some cases. I'd be interested to see where that '0' comes from too. Still, I think Cyrus and Dovecot are the best two imap servers out there, so it's going to be a question of which integrates best with your usage pattern. For a small server, starting with no experience in either, I would probably choose Dovecot. Now that I know Cyrus inside out, back to front, warts and all - well, I'd choose Cyrus because I know how to make it play nice. It's more of a "total system" in itself though, that you write support stuff around. Dovecot integrates more with other tools in a unix-daemon'y way. Enjoy, Bron ( now if someone came along with a compelling competitior for SASL... ) From joon at radleys.co.za Thu Aug 14 00:56:27 2008 From: joon at radleys.co.za (Joon Radley) Date: Thu, 14 Aug 2008 06:56:27 +0200 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <48A306F9.3090905@csub.edu> References: <20080813115232.2687720@mail.edu.haifa.ac.il> <48A306F9.3090905@csub.edu> Message-ID: <003901c8fdca$1e87da60$5b978f20$@co.za> > Leon Kolchinsky wrote: > > Hello All, > > > > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > > integration) for years and very happy with it. > > Now we need some implementation for shared calendars (let's say > > calendar solution for all our users). > > > > What would you recommend? > > Web-cyradm and Zimbra integration? Anyone have any experience with > it? > > How would you handle authentication issue? > > > > Any other suggestions? > > > > Bedework[1] seems interesting. > > [1] http://www.bedework.org/ http://www.kolab.org Best Regards Joon From mathieu.kretchner at sophia.inria.fr Thu Aug 14 03:49:36 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Thu, 14 Aug 2008 09:49:36 +0200 Subject: [Dovecot] Cyrus vs Dovecot In-Reply-To: <0346A1105D5A8E683C524F65@tmo-044-17.customers.d1-online.com> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> <48A3000C.4080506@sophia.inria.fr> <0346A1105D5A8E683C524F65@tmo-044-17.customers.d1-online.com> Message-ID: <48A3E390.1020203@sophia.inria.fr> Pascal Gienger a ?crit : > Mathieu Kretchner wrote: > >> kbajwa a ?crit : > >>> Cyrus = 0 >>> Dovecot = 100 > >> I guess you've right but I can't post this answer at Cyrus mailing list. >> I'm just trying to have my own opinion of imap server and I already have >> sarcastic answer on the cyrus mailing list ! > > Stop. What's this? > > a) crossposing content to the dovecot mailing list > b) talking about "sarcastic" answers when users try to help you saying > that migrating from an old cyrus release to a new one is easier then > migrating to a new system? > c) many users here have described their running configuration to help you. > d) starting an advocacy war? > > What are you trying to do? > Sorry but your manners on cyrus list have been disrespectful and hurt me... I do not want an "advocacy war" so I'll stop here this discussion and focus on technical aspect. -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 268 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080814/389cb1dd/attachment.vcf From Pascal.Gienger at uni-konstanz.de Thu Aug 14 04:37:48 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Thu, 14 Aug 2008 10:37:48 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: <489AB789.4080003@vandervlis.nl> References: <489AB789.4080003@vandervlis.nl> Message-ID: Paul van der Vlis wrote: > then convert the databases (on one line): > find /var/lib/cyrus/ -name \*.db -print -exec /usr/bin/db4.2_upgrade {} \; > db_upgrade: /var/lib/cyrus/mailboxes.db: unrecognized file type > So "mailboxes.db" did not work, but the other databases did. Just a side note: I am pretty sure your mailboxes.db is a skiplist database which is AFAIK the default for mailboxes.db in Cyrus IMAP 2.1 and 2.2. No conversion is necessary. Do you have any database type declarations in your imapd.conf? Pascal From mathieu.kretchner at sophia.inria.fr Thu Aug 14 04:52:52 2008 From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner) Date: Thu, 14 Aug 2008 10:52:52 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <576DF165-9CE2-415F-9F42-9FBE65A6BB51@uk.fujitsu.com> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <576DF165-9CE2-415F-9F42-9FBE65A6BB51@uk.fujitsu.com> Message-ID: <48A3F264.2000404@sophia.inria.fr> Ian G Batten a ?crit : >> the mail, the indices, and the mailboxes.db. Each can be on >> separate storage with optimal price vs performance characteristics >> for the proposed load. > > > We have 48000 mailboxes on behalf of 2000 users, with typically 1700 > imapd processes during the day and ~1000 overnight. There's about 3.4TB > of mail stored. > > We run Cyrus 2.3.9 (12p1 is due for the next time the machine has a > maintenance window) in a Solaris zone (container) on a Sun T2000 with > 16GB of RAM. The load on the machine is typically low: > > > ------------------------------------------------------------------------ > > > > > We have mailboxes.db and the metapartitions on ZFS, along with the zone > iteself. The pool is drawn from space on four 10000rpm SAS drives > internal to the machine: > > > NAME STATE READ WRITE CKSUM > pool1 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c0t0d0s4 ONLINE 0 0 0 > c0t1d0s4 ONLINE 0 0 0 > mirror ONLINE 0 0 0 > c0t2d0s4 ONLINE 0 0 0 > c0t3d0s4 ONLINE 0 0 0 > > They're fairly busy, mostly with writes (1 second resolution): > > capacity operations bandwidth > pool used avail read write read write > ---------- ----- ----- ----- ----- ----- ----- > pool1 39.4G 38.6G 10 77 472K 509K > pool1 39.4G 38.6G 0 65 0 1.09M > pool1 39.4G 38.6G 2 521 1.98K 3.03M > pool1 39.4G 38.6G 2 170 255K 951K > pool1 39.4G 38.6G 0 37 0 249K > pool1 39.4G 38.6G 0 35 0 310K > pool1 39.4G 38.6G 2 22 16.3K 430K > pool1 39.4G 38.6G 9 660 284K 4.65M > pool1 39.4G 38.6G 0 118 506 296K > pool1 39.4G 38.6G 0 2 0 27.7K > pool1 39.4G 38.6G 4 39 96.0K 990K > pool1 39.4G 38.6G 1 89 1013 997K > pool1 39.4G 38.6G 3 775 56.4K 5.06M > pool1 39.4G 38.6G 0 160 0 531K > pool1 39.4G 38.6G 0 20 0 118K > pool1 39.4G 38.6G 0 11 0 83.2K > pool1 39.4G 38.6G 0 41 0 595K > pool1 39.4G 38.6G 0 624 1013 3.46M > > This indicates that most client-side reads are being serviced from cache > (as you'd expect with 16GB of RAM). We have 21.4GB of meta data on > disk, which we run with ZFS compression to reduce IO bandwidth (at the > expense of CPU utilisation, of which we have plenty spare). The ZFS > compression ratio is about 1.7x: cyrus.cache, in particular, is very > compressible. > > The message store is out on the `archive' QoS of a Pillar Axiom AX500, > so the data's living in the slow regions of SATA drives, that would > otherwise go to waste. We see ~20ms for all reads, because they are > essentially random and have to come up from the spindle of the NFS > server. Writes go to mirrored RAM on the server at take ~2ms. Because > most clients cache content these days, the load on those partitions is > much lower. Ten seconds' of sar output yields: > > 10:47:34 device %busy avque r+w/s blks/s avwait avserv > [...] > nfs73 16 0.2 10 84 0.0 15.6 > nfs86 43 0.4 24 205 0.0 18.5 > nfs87 1 0.0 3 152 0.0 7.2 > nfs96 2 0.0 6 369 0.0 6.9 > nfs101 0 0.0 1 35 0.0 5.0 > nfs102 0 0.0 0 0 0.0 0.0 > > ian > Thank you, it gives me a good comparison point with a big configuration I saw on dovecot mailing list. Your architecture seems to be well hacked. It's a good start if we had to choose cyrus. Regards -------------- next part -------------- A non-text attachment was scrubbed... Name: mathieu_kretchner.vcf Type: text/x-vcard Size: 258 bytes Desc: not available Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080814/227c49ef/attachment.vcf From Pascal.Gienger at uni-konstanz.de Thu Aug 14 05:17:00 2008 From: Pascal.Gienger at uni-konstanz.de (Pascal Gienger) Date: Thu, 14 Aug 2008 11:17:00 +0200 Subject: Cyrus vs Dovecot In-Reply-To: <48A3F264.2000404@sophia.inria.fr> References: <489FDD17.6090705@sophia.inria.fr> <71fe4e760808110422k30db70fel4b438a46cf0beb@mail.gmail.com> <48A0373D.6040703@sophia.inria.fr> <1218463979.8286.1.camel@linux-nnci.site> <48A16BBB.6070707@sophia.inria.fr> <576DF165-9CE2-415F-9F42-9FBE65A6BB51@uk.fujitsu.com> <48A3F264.2000404@sophia.inria.fr> Message-ID: <80425F9251840791D10826BC@tmo-032-2.customers.d1-online.com> Mathieu Kretchner wrote: > Ian G Batten a ?crit : >> We have mailboxes.db and the metapartitions on ZFS, along with the zone >> iteself. The pool is drawn from space on four 10000rpm SAS drives >> internal to the machine: To give (hopefully) comparable comparison: We have our meta files and spool files also on ZFS, with mirrored pools: # zpool status pool: cyrus state: ONLINE scrub: resilver completed with 0 errors on Sun May 25 12:17:46 2008 config: NAME STATE READ WRITE CKSUM cyrus ONLINE 0 0 0 mirror ONLINE 0 0 0 c6t600D0230006B66680C50AB4F92F61000d0 ONLINE 0 0 0 c6t600D0230006C1C4C0C50BE4DFE511B00d0 ONLINE 0 0 0 errors: No known data errors pool: mail state: ONLINE scrub: resilver completed with 0 errors on Sun May 25 01:05:02 2008 config: NAME STATE READ WRITE CKSUM mail ONLINE 0 0 0 mirror ONLINE 0 0 0 c6t600D0230006B66680C50AB0F36ADF100d0 ONLINE 0 0 0 c6t600D0230006C1C4C0C50BE57396E9F00d0 ONLINE 0 0 0 mirror ONLINE 0 0 0 c6t600D0230006B66680C50AB5675F91300d0 ONLINE 0 0 0 c6t600D0230006C1C4C0C50BE16FF1FE200d0 ONLINE 0 0 0 errors: No known data errors "cyrus" is our log pool, "mail" our imap spool pool. IO ist mostly write: # zpool iostat mail 2 capacity operations bandwidth pool used avail read write read write ---------- ----- ----- ----- ----- ----- ----- mail 2.08T 6.02T 226 163 1.36M 1.67M mail 2.08T 6.02T 358 10 1.35M 94.4K mail 2.08T 6.02T 234 599 1.08M 10.0M mail 2.08T 6.02T 77 0 425K 3.98K mail 2.08T 6.02T 85 306 484K 3.39M mail 2.08T 6.02T 95 8 405K 75.6K mail 2.08T 6.02T 107 6 798K 47.8K mail 2.08T 6.02T 73 232 281K 2.30M mail 2.08T 6.02T 77 2 304K 9.95K mail 2.08T 6.02T 66 469 254K 5.84M mail 2.08T 6.02T 83 4 409K 17.9K As with Ian's setup, most read requests are serviced from ARC. We have BOTH data (meta and spool) on this ZFS pool, however we defined an extra ZFS filesystem for metadata to make distinct snapshots. cyrus.header remains on the imap spool partition. Raw Disk I/O is different as ZFS pulls out up to "recordsize" from disk per request (128k by default). Load is 0.47 at the moment, 1355 imapd processes, 10 lmtpd processes (limited by delivering gateway), 34 pop3d processes. The machine is a two-processor Opteron (dualcore) machine, so 4 cores are available. It has 20 GB ram and ARC (zfs) uses: # kstat zfs:0:arcstats:size module: zfs instance: 0 name: arcstats class: misc size 9308832256 9 GB zfs file cache. Hope this helps you a little bit. Pascal From paul at vandervlis.nl Thu Aug 14 05:49:43 2008 From: paul at vandervlis.nl (Paul van der Vlis) Date: Thu, 14 Aug 2008 11:49:43 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: References: <489AB789.4080003@vandervlis.nl> Message-ID: <48A3FFB7.2030402@vandervlis.nl> Pascal Gienger schreef: > Paul van der Vlis wrote: > >> then convert the databases (on one line): >> find /var/lib/cyrus/ -name \*.db -print -exec /usr/bin/db4.2_upgrade >> {} \; > >> db_upgrade: /var/lib/cyrus/mailboxes.db: unrecognized file type > >> So "mailboxes.db" did not work, but the other databases did. > > Just a side note: I am pretty sure your mailboxes.db is a skiplist > database which is AFAIK the default for mailboxes.db in Cyrus IMAP 2.1 > and 2.2. No conversion is necessary. I think that's correct, but I don't know for sure how to check the type. The conversed machines are working fine. The file /usr/lib/cyrus/cyrus-db-types.active of the old systems says: DBENGINE BerkeleyDB3.2 DUPLICATE db3_nosync MBOX skiplist SEEN skiplist SUBS flat TLS db3_nosync The file cyrus-db-types.txt is the same. The new systems are working fine, and this is the cyrus-db-types.active: ANNOTATION skiplist DBENGINE BerkeleyDB4.2 DUPLICATE berkeley-nosync MBOX skiplist PTS berkeley QUOTA quotalegacy SEEN skiplist SUBS flat TLS berkeley-nosync > Do you have any database type declarations in your imapd.conf? No, I did nothing special, and I did not found anything like that in my imapd.conf. Some of the systems did use Cyrus 1.5 before. The conversion was difficult I can remember. But the file cyrus-db-types.active is the same as the other old systems. And I used everywhere Debian-packages. With regards, Paul van der Vlis. -- http://www.vandervlis.nl/ From gombasg at sztaki.hu Thu Aug 14 07:03:35 2008 From: gombasg at sztaki.hu (Gabor Gombas) Date: Thu, 14 Aug 2008 13:03:35 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: <48A3FFB7.2030402@vandervlis.nl> References: <489AB789.4080003@vandervlis.nl> <48A3FFB7.2030402@vandervlis.nl> Message-ID: <20080814110335.GA24558@boogie.lpds.sztaki.hu> On Thu, Aug 14, 2008 at 11:49:43AM +0200, Paul van der Vlis wrote: > > Just a side note: I am pretty sure your mailboxes.db is a skiplist > > database which is AFAIK the default for mailboxes.db in Cyrus IMAP 2.1 > > and 2.2. No conversion is necessary. > > I think that's correct, but I don't know for sure how to check the type. > The conversed machines are working fine. # file mailboxes.db mailboxes.db: Cyrus skiplist DB Gabor -- --------------------------------------------------------- MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences --------------------------------------------------------- From gombasg at sztaki.hu Thu Aug 14 07:21:31 2008 From: gombasg at sztaki.hu (Gabor Gombas) Date: Thu, 14 Aug 2008 13:21:31 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: <489AB789.4080003@vandervlis.nl> References: <489AB789.4080003@vandervlis.nl> Message-ID: <20080814112131.GB24558@boogie.lpds.sztaki.hu> On Thu, Aug 07, 2008 at 10:51:21AM +0200, Paul van der Vlis wrote: > make backups: > cp -a /var/lib/cyrus /var/lib/cyrus-backup > cp -a /var/spool/sieve /var/spool/sieve-backup > cp -a /usr/lib/cyrus/ /usr/lib/cyrus-backup > cp -a /var/spool/cyrus /var/spool/cyrus-backup > The last one takes long... Don't you have regular backups? If you don't, you should better start doing them... Anyway, you can use rsync to make an initial copy while the old service is still running and a much quicker update when the old service is stopped. > remove packages: > apt-get remove cyrus21-common cyrus21-admin cyrus21-clients > libcyrus-imap-perl21 > dpkg --get-selections | grep cyrus > > backup config-files: > mv /etc/imapd.conf /etc/imapd.conf.backup > mv /etc/cyrus.conf /etc/cyrus.conf.backup I'd do that _before_ removing the packages... > install packages: > apt-get install cyrus-imapd-2.2 cyrus-admin-2.2 cyrus-clients-2.2 > libcyrus-imap-perl22 db4.2-util cyrus-pop3d-2.2 > > choose to overwrite cyrus.conf and imapd.conf (I wonder why this files > are still there). Because you've used "apt-get remove" instead of "apt-get purge". See the dpkg manual for the description of the difference between the two operations. Note: "purge" may also remove the spool directory if you've choosen to do so, so be careful. > then convert the databases (on one line): > find /var/lib/cyrus/ -name \*.db -print -exec /usr/bin/db4.2_upgrade {} \; > > this was my output: > ---------- > /var/lib/cyrus/mailboxes.db > db_upgrade: /var/lib/cyrus/mailboxes.db: unrecognized file type > db_upgrade: DB->upgrade: /var/lib/cyrus/mailboxes.db: Invalid argument > /var/lib/cyrus/tls_sessions.db > /var/lib/cyrus/deliver.db > /var/lib/cyrus/db.backup1/mailboxes.db > db_upgrade: /var/lib/cyrus/db.backup1/mailboxes.db: unrecognized file type > db_upgrade: DB->upgrade: /var/lib/cyrus/db.backup1/mailboxes.db: Invalid > argument > /var/lib/cyrus/db.backup2/mailboxes.db > db_upgrade: /var/lib/cyrus/db.backup2/mailboxes.db: unrecognized file type > db_upgrade: DB->upgrade: /var/lib/cyrus/db.backup2/mailboxes.db: Invalid > argument > ---------- > > So "mailboxes.db" did not work, but the other databases did. This was my recipe for a 2.1 -> 2.3 (from experimental) migration: cd /var/lib/cyrus/db db3_recover cd /var/lib/cyrus db4.X_upgrade deliver.db rm tls*db cd db db4.X_checkpoint -1 (replace 'X' with the correct BDB version) Gabor -- --------------------------------------------------------- MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences --------------------------------------------------------- From paul at vandervlis.nl Thu Aug 14 07:24:03 2008 From: paul at vandervlis.nl (Paul van der Vlis) Date: Thu, 14 Aug 2008 13:24:03 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: <20080814110335.GA24558@boogie.lpds.sztaki.hu> References: <489AB789.4080003@vandervlis.nl> <48A3FFB7.2030402@vandervlis.nl> <20080814110335.GA24558@boogie.lpds.sztaki.hu> Message-ID: <48A415D3.1090500@vandervlis.nl> Gabor Gombas schreef: > On Thu, Aug 14, 2008 at 11:49:43AM +0200, Paul van der Vlis wrote: > >>> Just a side note: I am pretty sure your mailboxes.db is a skiplist >>> database which is AFAIK the default for mailboxes.db in Cyrus IMAP 2.1 >>> and 2.2. No conversion is necessary. >> I think that's correct, but I don't know for sure how to check the type. >> The conversed machines are working fine. > > # file mailboxes.db > mailboxes.db: Cyrus skiplist DB > > Gabor > On an old server: elo:/var/lib/cyrus# file mailboxes.db mailboxes.db: Apple QuickTime movie (modified) ??? When I use "strings mailboxes.db" the first line says: skiplist file So I think it's a skiplist file. Thanks for your help! It still gives an correct answer on some other databases. Met vriendelijke groet, Paul van der Vlis. -- http://www.vandervlis.nl/ From paul at vandervlis.nl Thu Aug 14 07:36:50 2008 From: paul at vandervlis.nl (Paul van der Vlis) Date: Thu, 14 Aug 2008 13:36:50 +0200 Subject: Conversion Debian Cyrus 2.1 to 2.2, experiences In-Reply-To: <20080814112131.GB24558@boogie.lpds.sztaki.hu> References: <489AB789.4080003@vandervlis.nl> <20080814112131.GB24558@boogie.lpds.sztaki.hu> Message-ID: <48A418D2.4040707@vandervlis.nl> Gabor Gombas schreef: > On Thu, Aug 07, 2008 at 10:51:21AM +0200, Paul van der Vlis wrote: > >> make backups: >> cp -a /var/lib/cyrus /var/lib/cyrus-backup >> cp -a /var/spool/sieve /var/spool/sieve-backup >> cp -a /usr/lib/cyrus/ /usr/lib/cyrus-backup >> cp -a /var/spool/cyrus /var/spool/cyrus-backup >> The last one takes long... > > Don't you have regular backups? If you don't, you should better start > doing them... I do have regular backups, but if I do something like this I like a way back to the old situation, without the loss of the mail since the last backup. > Anyway, you can use rsync to make an initial copy while > the old service is still running and a much quicker update when the old > service is stopped. Correct, that's better. >> remove packages: >> apt-get remove cyrus21-common cyrus21-admin cyrus21-clients >> libcyrus-imap-perl21 >> dpkg --get-selections | grep cyrus >> >> backup config-files: >> mv /etc/imapd.conf /etc/imapd.conf.backup >> mv /etc/cyrus.conf /etc/cyrus.conf.backup > > I'd do that _before_ removing the packages... Without --purge, the configfiles are not removed. But maybe your way is better. >> install packages: >> apt-get install cyrus-imapd-2.2 cyrus-admin-2.2 cyrus-clients-2.2 >> libcyrus-imap-perl22 db4.2-util cyrus-pop3d-2.2 >> >> choose to overwrite cyrus.conf and imapd.conf (I wonder why this files >> are still there). > > Because you've used "apt-get remove" instead of "apt-get purge". I did also a "mv /etc/imapd.conf /etc/imapd.conf.backup" etc. > This was my recipe for a 2.1 -> 2.3 (from experimental) migration: > > cd /var/lib/cyrus/db > db3_recover > cd /var/lib/cyrus > db4.X_upgrade deliver.db > rm tls*db > cd db > db4.X_checkpoint -1 > > (replace 'X' with the correct BDB version) Thanks for the information! With regards, Paul van der Vlis. -- http://www.vandervlis.nl/ From leonk at construct.haifa.ac.il Thu Aug 14 08:03:54 2008 From: leonk at construct.haifa.ac.il (Leon Kolchinsky) Date: Thu, 14 Aug 2008 15:03:54 +0300 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <003901c8fdca$1e87da60$5b978f20$@co.za> Message-ID: <20080814120807.ABEDD2996C@mail.edu.haifa.ac.il> > > > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > > > integration) for years and very happy with it. > > > Now we need some implementation for shared calendars (let's say > > > calendar solution for all our users). > > > > > > What would you recommend? > > > Web-cyradm and Zimbra integration? Anyone have any experience with > > it? > > > How would you handle authentication issue? > > > > > > Any other suggestions? > > > > > > > Bedework[1] seems interesting. > > > > [1] http://www.bedework.org/ > > http://www.kolab.org > > Best Regards > > Joon Thanks guys for all the answers :) I'll check them all. Best Regards, Leon From adam at morrison-ind.com Thu Aug 14 09:18:25 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Thu, 14 Aug 2008 09:18:25 -0400 Subject: Web-cyradm and Zimbra maybe? In-Reply-To: <48A362CD.3000802@intersonic.se> References: <20080813115232.2687720@mail.edu.haifa.ac.il> <48A362CD.3000802@intersonic.se> Message-ID: <1218719905.5930.3.camel@linux-nnci.site> > > I'm using web-cyradm (mysql frontend for virt. domains+cyrus+postfix > > integration) for years and very happy with it. > > Now we need some implementation for shared calendars (let's say calendar > > solution for all our users). > > What would you recommend? > > Web-cyradm and Zimbra integration? Anyone have any experience with it? How > > would you handle authentication issue? > We use Horde here with LDAP for domains+cyrus+postfix+calendars but it > works equally well with SQL. Got excellent webmail interface as well as > shared calendar support. > http://www.horde.org/ I second the vote for Horde. We've use'd Horde for webmail for a very long time - it is simply the best webmail interface available and does a very good job at dealing with the dorked or thrashed messages produced by some mail clients. In our testing [at the time] it was the only webmail interface that could deal reliably with messages from Lotus Notes/Domino that some of our customers sent. Also the Horde suite can front-end almost any data-store or database, it really is amazingly configurable. While we use OpenGroupware as the backend for our scheduling (calendering) and CRM, etc... we use Horde for providing webmail and interconnect the addressbook to our groupware system. From adam at morrison-ind.com Thu Aug 14 10:31:34 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Thu, 14 Aug 2008 10:31:34 -0400 Subject: Auto setting an expiration Message-ID: <1218724294.5930.12.camel@linux-nnci.site> Via autocreateinboxfolders and autocreatequota a user's mailbox/mailboxes can automatically be created when they authenticate to the server. Is there any way to automatically assign an "expire" value to newly created mailboxes? We automatically create a sent-mail folder when the user logs in and would like to set the expire value of that mailbox to 365. From david.lang at digitalinsight.com Thu Aug 14 14:30:57 2008 From: david.lang at digitalinsight.com (David Lang) Date: Thu, 14 Aug 2008 11:30:57 -0700 (PDT) Subject: Cyrus vs Dovecot In-Reply-To: <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> References: <80307EBE75234C35A06E502D4887FE86@Sunshine> <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> Message-ID: On Wed, 13 Aug 2008, Wesley Craig wrote: > On 13 Aug 2008, at 10:31, kbajwa wrote: >> I think you are missing a point which is most important, i.e., what >> type of >> support Cyrus vs Dovecot offers. In my experience: >> >> Cyrus = 0 >> Dovecot = 100 > > As someone who answers many help requests for cyrus (and I'm very far > from the only one), I can honestly say I've never seen a requests > from you. Perhaps you've had a lot of occasion to ask for help with > Dovecot. I'm happy to hear you've gotten that help. Community is a > lot of what open source software is about. As for your experience > with the cyrus imapd community, perhaps your sample size is too small. > > Or perhaps you're thinking of paid support? Because I know very well > that you can get that for cyrus imap. can you provide links to where from? David Lang From damm at yazzy.org Fri Aug 15 05:12:39 2008 From: damm at yazzy.org (Scott Likens) Date: Fri, 15 Aug 2008 02:12:39 -0700 Subject: Cyrus vs Dovecot In-Reply-To: References: <80307EBE75234C35A06E502D4887FE86@Sunshine> <264CB3BA-0545-434E-87F3-F97343FACB37@umich.edu> Message-ID: <6E9906C8-2EE4-47F1-8766-ECC8DA729548@yazzy.org> Can we please stop this thread? No offense, but it's absolutely disgusting and should have never gone on this long. This Mailing list is Dedicated to Cyrus, we do not need the rhetoric about Dovecot, or Courier, or Exchange. If you have questions, ask them, if you need help, ask. There is absolutely no need to bad mouth Dovecot, Cyrus, Exchange, etc. It has no place on this mailing list what so ever. I will end this email on, there are people here like Bron Godwana and others who have helped everyone who asked a question and spent a great deal of time fixing bugs. Now, please if we can end this rhetoric and go back to our normal day please? Thanks. On Aug 14, 2008, at 11:30 AM, David Lang wrote: > On Wed, 13 Aug 2008, Wesley Craig wrote: > >> On 13 Aug 2008, at 10:31, kbajwa wrote: >>> I think you are missing a point which is most important, i.e., what >>> type of >>> support Cyrus vs Dovecot offers. In my experience: >>> >>> Cyrus = 0 >>> Dovecot = 100 >> >> As someone who answers many help requests for cyrus (and I'm very far >> from the only one), I can honestly say I've never seen a requests >> from you. Perhaps you've had a lot of occasion to ask for help with >> Dovecot. I'm happy to hear you've gotten that help. Community is a >> lot of what open source software is about. As for your experience >> with the cyrus imapd community, perhaps your sample size is too >> small. >> >> Or perhaps you're thinking of paid support? Because I know very well >> that you can get that for cyrus imap. > > can you provide links to where from? > > David Lang > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > > > !DSPAM:48a4930e231921909919347! > > From mailist at sokol-web.de Mon Aug 18 05:21:02 2008 From: mailist at sokol-web.de (Peter Lokus) Date: Mon, 18 Aug 2008 11:21:02 +0200 Subject: migrate to virtual domains Message-ID: <20080818092101.86D82BE6B@m11s13.vlinux.de> Hi list, I using cyrus imap for two domains without virtual domains. Say, my folder structure look like /var/spool/cyrus/mail/user/user1 domain: example.net /var/spool/cyrus/mail/user/user2 domain: example.com Every user has its own folders under the INBOX. In order to enhance the administration and migrate new domains easier I want to switch to virtual domains. It should look like /var/spool/cyrus/mail/domain/example.net/user/user1 /var/spool/cyrus/mail/domain/example.com/user/user2 How do I move the user folders' to the new folder structure? My approach was to copy these folder's to the new folder structure and run reconstruct. However, I can see only mails in the INBOX. Any recommendations? Peter From aspineux at gmail.com Mon Aug 18 05:58:31 2008 From: aspineux at gmail.com (Alain Spineux) Date: Mon, 18 Aug 2008 11:58:31 +0200 Subject: migrate to virtual domains In-Reply-To: <20080818092101.86D82BE6B@m11s13.vlinux.de> References: <20080818092101.86D82BE6B@m11s13.vlinux.de> Message-ID: <71fe4e760808180258h542782b4v7888d3a2606cf09c@mail.gmail.com> On Mon, Aug 18, 2008 at 11:21 AM, Peter Lokus wrote: > Hi list, > > I using cyrus imap for two domains without virtual domains. > Say, my folder structure look like > > /var/spool/cyrus/mail/user/user1 domain: example.net > /var/spool/cyrus/mail/user/user2 domain: example.com > > Every user has its own folders under the INBOX. > > In order to enhance the administration and migrate new domains easier I want > to switch to virtual domains. It should look like > > /var/spool/cyrus/mail/domain/example.net/user/user1 > /var/spool/cyrus/mail/domain/example.com/user/user2 > > How do I move the user folders' to the new folder structure? > My approach was to copy these folder's to the new folder structure and run > reconstruct. However, I can see only mails in the INBOX. If I had to do it myself : (it could be uncomplete, sorry) - first in imapd.conf set 'virtdomains' to what you want, - create new user1 at example.net and user2 at example.com - try to login as user1, user2, user1 at example.net and user2 at example.com, check that the first have a not empty mailbox and the last have an empty one. - Use "imapsync" to copy all the emails from user1 to user1 at example.net, continue with all your other user. - update your SMTP configuration to deliver to user1 at example.net instead of user1 Be carefiull to have enough spece to do all you user at once, or do it one by one, removing old user Hope this help > > Any recommendations? > > Peter > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From mangoo at wpkg.org Mon Aug 18 07:23:17 2008 From: mangoo at wpkg.org (Tomasz Chmielewski) Date: Mon, 18 Aug 2008 13:23:17 +0200 Subject: limit user access to certain IP addresses? Message-ID: <48A95BA5.1060009@wpkg.org> It it possible to limit POP3/IMAP access for chosen users only to certain IP addresses? For example, I'd like to allow some users only access from 127.0.0.1 (or, Squirrelmail running on the same address as Cyrus); those users shouldn't have public access to POP3/IMAP from the whole Internet. At the same time, though, I would like to allow access for some other users via POP3/IMAP as well. Is it somehow possible with Cyrus? If it is, it would be great if it could be used to limit access to SMTP as well. As SMTP is different than what Cyrus does, this would perhaps suggest some additional PAM library? Any ideas? -- Tomasz Chmielewski http://wpkg.org From michael.menge at zdv.uni-tuebingen.de Mon Aug 18 08:52:55 2008 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Mon, 18 Aug 2008 14:52:55 +0200 Subject: limit user access to certain IP addresses? In-Reply-To: <48A95BA5.1060009@wpkg.org> References: <48A95BA5.1060009@wpkg.org> Message-ID: <20080818145255.lrt7hlk924g0ow4c@webmail.uni-tuebingen.de> Hi, I tried this some thime ago with pam, but without a success. SASL does not pass the ip-addres to PAM so you can't use pam_access, nor can you change/configure the PAM service name to run an other instance of cyrus using an other pam configuration. You may have success by running too instances of cyrus, one listening on 127.0.0.1 and one on your normal IP und using different sasl_options in your imapd.conf configurations Quoting Tomasz Chmielewski : > It it possible to limit POP3/IMAP access for chosen users only to > certain IP addresses? > > For example, I'd like to allow some users only access from 127.0.0.1 > (or, Squirrelmail running on the same address as Cyrus); those users > shouldn't have public access to POP3/IMAP from the whole Internet. > > At the same time, though, I would like to allow access for some other > users via POP3/IMAP as well. > > > Is it somehow possible with Cyrus? If it is, it would be great if it > could be used to limit access to SMTP as well. As SMTP is different than > what Cyrus does, this would perhaps suggest some additional PAM library? > > Any ideas? > > > -- > Tomasz Chmielewski > http://wpkg.org > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de Waechterstrasse 76 72074 Tuebingen -------------- next part -------------- A non-text attachment was scrubbed... Name: smime.p7s Type: application/pkcs7-signature Size: 5339 bytes Desc: S/MIME krytographische Unterschrift Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080818/466ad5b5/attachment.bin From gbeekmans at achillesmedia.com Mon Aug 18 17:35:20 2008 From: gbeekmans at achillesmedia.com (Gerard Beekmans) Date: Mon, 18 Aug 2008 15:35:20 -0600 Subject: Deleting messages "marked for deletion" older than X days Message-ID: <48A9EB18.40805@achillesmedia.com> Hi, I am looking for a way to run a daily script on the Cyrus IMAP server that processes every user's mail folders and deletes every message marked for deletion older than X days. I realize the proper way to do this is client-side and have the client program purge/expunge the mailboxes periodically in some fashion. Unfortunately in the corporate world there are many clients who still use old versions of Outlook that only marks a message for deletion and will not automatically purge the folder. To force users to manually purge every single folder they have, one folder at a time as some versions of Outlook can't do this recursively, is not a feasible option. Users just stopped doing this because it becomes too time consuming a task. So I'm looking for a server-side solution that analyzes every mail folder on the system, finds marked messages older than X days and purges/deletes them on the client's behalf. Some pointers are appreciated. I can write the scripts (shell, perl, whatever) myself if need be, just need to know how to start going about obtaining such a specific list of messages. Thanks, -- Gerard Beekmans IT Manager Achilles Media Tel: 403-678-1216 ext. 102 Email: gbeekmans at achillesmedia.com From ktm at rice.edu Mon Aug 18 17:48:11 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Mon, 18 Aug 2008 16:48:11 -0500 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <48A9EB18.40805@achillesmedia.com> References: <48A9EB18.40805@achillesmedia.com> Message-ID: <20080818214811.GE18572@it.is.rice.edu> I think that the cyr_expire command may be what you are searching for. Ken On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: > Hi, > > I am looking for a way to run a daily script on the Cyrus IMAP server > that processes every user's mail folders and deletes every message > marked for deletion older than X days. > > I realize the proper way to do this is client-side and have the client > program purge/expunge the mailboxes periodically in some fashion. > > Unfortunately in the corporate world there are many clients who still > use old versions of Outlook that only marks a message for deletion and > will not automatically purge the folder. > > To force users to manually purge every single folder they have, one > folder at a time as some versions of Outlook can't do this recursively, > is not a feasible option. Users just stopped doing this because it > becomes too time consuming a task. > > So I'm looking for a server-side solution that analyzes every mail > folder on the system, finds marked messages older than X days and > purges/deletes them on the client's behalf. > > Some pointers are appreciated. I can write the scripts (shell, perl, > whatever) myself if need be, just need to know how to start going about > obtaining such a specific list of messages. > > Thanks, > > -- > Gerard Beekmans > IT Manager > Achilles Media > Tel: 403-678-1216 ext. 102 > Email: gbeekmans at achillesmedia.com > > > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > From gbeekmans at achillesmedia.com Mon Aug 18 17:53:31 2008 From: gbeekmans at achillesmedia.com (Gerard Beekmans) Date: Mon, 18 Aug 2008 15:53:31 -0600 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080818214811.GE18572@it.is.rice.edu> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> Message-ID: <48A9EF5B.5020907@achillesmedia.com> Hi Ken, From the description it seems like cyr_expire will apply to every email in a mailbox. I don't want to delete any regular emails other than the ones already marked for deletion by an email client who is lacking a decent purge feature. Gerard Beekmans IT Manager Achilles Media Tel: 403-678-1216 ext. 102 Email: gbeekmans at achillesmedia.com Kenneth Marshall wrote: > I think that the cyr_expire command may be what you are searching > for. > > Ken > > On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: > >> Hi, >> >> I am looking for a way to run a daily script on the Cyrus IMAP server >> that processes every user's mail folders and deletes every message >> marked for deletion older than X days. >> >> I realize the proper way to do this is client-side and have the client >> program purge/expunge the mailboxes periodically in some fashion. >> >> Unfortunately in the corporate world there are many clients who still >> use old versions of Outlook that only marks a message for deletion and >> will not automatically purge the folder. >> >> To force users to manually purge every single folder they have, one >> folder at a time as some versions of Outlook can't do this recursively, >> is not a feasible option. Users just stopped doing this because it >> becomes too time consuming a task. >> >> So I'm looking for a server-side solution that analyzes every mail >> folder on the system, finds marked messages older than X days and >> purges/deletes them on the client's behalf. >> >> Some pointers are appreciated. I can write the scripts (shell, perl, >> whatever) myself if need be, just need to know how to start going about >> obtaining such a specific list of messages. >> >> Thanks, >> >> -- >> Gerard Beekmans >> IT Manager >> Achilles Media >> Tel: 403-678-1216 ext. 102 >> Email: gbeekmans at achillesmedia.com >> >> >> ---- >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >> >> From ktm at rice.edu Mon Aug 18 18:09:53 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Mon, 18 Aug 2008 17:09:53 -0500 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <48A9EF5B.5020907@achillesmedia.com> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> Message-ID: <20080818220953.GG18572@it.is.rice.edu> In the manual page, the definition of the '-X' option seems to do what you want: -X expunge-days Expunge previously deleted messages older than expunge-days (when using the "delayed" expunge mode). The default is 0 (zero) days, which will expunge all previously deleted messages. Ken On Mon, Aug 18, 2008 at 03:53:31PM -0600, Gerard Beekmans wrote: > Hi Ken, > > From the description it seems like cyr_expire will apply to every email > in a mailbox. I don't want to delete any regular emails other than the > ones already marked for deletion by an email client who is lacking a > decent purge feature. > > > Gerard Beekmans > IT Manager > Achilles Media > Tel: 403-678-1216 ext. 102 > Email: gbeekmans at achillesmedia.com > > > > > Kenneth Marshall wrote: > > I think that the cyr_expire command may be what you are searching > > for. > > > > Ken > > > > On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: > > > >> Hi, > >> > >> I am looking for a way to run a daily script on the Cyrus IMAP server > >> that processes every user's mail folders and deletes every message > >> marked for deletion older than X days. > >> > >> I realize the proper way to do this is client-side and have the client > >> program purge/expunge the mailboxes periodically in some fashion. > >> > >> Unfortunately in the corporate world there are many clients who still > >> use old versions of Outlook that only marks a message for deletion and > >> will not automatically purge the folder. > >> > >> To force users to manually purge every single folder they have, one > >> folder at a time as some versions of Outlook can't do this recursively, > >> is not a feasible option. Users just stopped doing this because it > >> becomes too time consuming a task. > >> > >> So I'm looking for a server-side solution that analyzes every mail > >> folder on the system, finds marked messages older than X days and > >> purges/deletes them on the client's behalf. > >> > >> Some pointers are appreciated. I can write the scripts (shell, perl, > >> whatever) myself if need be, just need to know how to start going about > >> obtaining such a specific list of messages. > >> > >> Thanks, > >> > >> -- > >> Gerard Beekmans > >> IT Manager > >> Achilles Media > >> Tel: 403-678-1216 ext. 102 > >> Email: gbeekmans at achillesmedia.com > >> > >> > >> ---- > >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > >> > >> > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > From gbeekmans at achillesmedia.com Mon Aug 18 18:21:29 2008 From: gbeekmans at achillesmedia.com (Gerard Beekmans) Date: Mon, 18 Aug 2008 16:21:29 -0600 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080818220953.GG18572@it.is.rice.edu> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> Message-ID: <48A9F5E9.2030907@achillesmedia.com> I'll do some more checking then. My cyr_expire version doesn't even have the -X option (I'm testing this on a system that has cyrus imap 2.2.13 as its recent version). Gerard Beekmans IT Manager Achilles Media Tel: 403-678-1216 ext. 102 Email: gbeekmans at achillesmedia.com Kenneth Marshall wrote: > In the manual page, the definition of the '-X' option seems to > do what you want: > > -X expunge-days > Expunge previously deleted messages older than expunge-days > (when using the "delayed" expunge mode). The default is > 0 (zero) days, which will expunge all previously deleted messages. > > Ken > > > On Mon, Aug 18, 2008 at 03:53:31PM -0600, Gerard Beekmans wrote: > >> Hi Ken, >> >> From the description it seems like cyr_expire will apply to every email >> in a mailbox. I don't want to delete any regular emails other than the >> ones already marked for deletion by an email client who is lacking a >> decent purge feature. >> >> >> Gerard Beekmans >> IT Manager >> Achilles Media >> Tel: 403-678-1216 ext. 102 >> Email: gbeekmans at achillesmedia.com >> >> >> >> >> Kenneth Marshall wrote: >> >>> I think that the cyr_expire command may be what you are searching >>> for. >>> >>> Ken >>> >>> On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: >>> >>> >>>> Hi, >>>> >>>> I am looking for a way to run a daily script on the Cyrus IMAP server >>>> that processes every user's mail folders and deletes every message >>>> marked for deletion older than X days. >>>> >>>> I realize the proper way to do this is client-side and have the client >>>> program purge/expunge the mailboxes periodically in some fashion. >>>> >>>> Unfortunately in the corporate world there are many clients who still >>>> use old versions of Outlook that only marks a message for deletion and >>>> will not automatically purge the folder. >>>> >>>> To force users to manually purge every single folder they have, one >>>> folder at a time as some versions of Outlook can't do this recursively, >>>> is not a feasible option. Users just stopped doing this because it >>>> becomes too time consuming a task. >>>> >>>> So I'm looking for a server-side solution that analyzes every mail >>>> folder on the system, finds marked messages older than X days and >>>> purges/deletes them on the client's behalf. >>>> >>>> Some pointers are appreciated. I can write the scripts (shell, perl, >>>> whatever) myself if need be, just need to know how to start going about >>>> obtaining such a specific list of messages. >>>> >>>> Thanks, >>>> >>>> -- >>>> Gerard Beekmans >>>> IT Manager >>>> Achilles Media >>>> Tel: 403-678-1216 ext. 102 >>>> Email: gbeekmans at achillesmedia.com >>>> >>>> >>>> ---- >>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>>> >>>> >>>> >> ---- >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >> >> From ktm at rice.edu Mon Aug 18 18:30:09 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Mon, 18 Aug 2008 17:30:09 -0500 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <48A9F5E9.2030907@achillesmedia.com> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> <48A9F5E9.2030907@achillesmedia.com> Message-ID: <20080818223009.GH18572@it.is.rice.edu> It must be a 2.3 option, we are running 2.3.10+ here. Ken On Mon, Aug 18, 2008 at 04:21:29PM -0600, Gerard Beekmans wrote: > I'll do some more checking then. My cyr_expire version doesn't even have > the -X option (I'm testing this on a system that has cyrus imap 2.2.13 as > its recent version). > > > > Gerard Beekmans > IT Manager > Achilles Media > Tel: 403-678-1216 ext. 102 > Email: gbeekmans at achillesmedia.com > > > > > Kenneth Marshall wrote: >> In the manual page, the definition of the '-X' option seems to >> do what you want: >> >> -X expunge-days >> Expunge previously deleted messages older than expunge-days >> (when using the "delayed" expunge mode). The default is >> 0 (zero) days, which will expunge all previously deleted >> messages. >> >> Ken >> >> >> On Mon, Aug 18, 2008 at 03:53:31PM -0600, Gerard Beekmans wrote: >> >>> Hi Ken, >>> >>> From the description it seems like cyr_expire will apply to every email >>> in a mailbox. I don't want to delete any regular emails other than the >>> ones already marked for deletion by an email client who is lacking a >>> decent purge feature. >>> >>> >>> Gerard Beekmans >>> IT Manager >>> Achilles Media >>> Tel: 403-678-1216 ext. 102 >>> Email: gbeekmans at achillesmedia.com >>> >>> >>> >>> >>> Kenneth Marshall wrote: >>> >>>> I think that the cyr_expire command may be what you are searching >>>> for. >>>> >>>> Ken >>>> >>>> On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: >>>> >>>>> Hi, >>>>> >>>>> I am looking for a way to run a daily script on the Cyrus IMAP server >>>>> that processes every user's mail folders and deletes every message >>>>> marked for deletion older than X days. >>>>> >>>>> I realize the proper way to do this is client-side and have the client >>>>> program purge/expunge the mailboxes periodically in some fashion. >>>>> >>>>> Unfortunately in the corporate world there are many clients who still >>>>> use old versions of Outlook that only marks a message for deletion and >>>>> will not automatically purge the folder. >>>>> >>>>> To force users to manually purge every single folder they have, one >>>>> folder at a time as some versions of Outlook can't do this recursively, >>>>> is not a feasible option. Users just stopped doing this because it >>>>> becomes too time consuming a task. >>>>> >>>>> So I'm looking for a server-side solution that analyzes every mail >>>>> folder on the system, finds marked messages older than X days and >>>>> purges/deletes them on the client's behalf. >>>>> >>>>> Some pointers are appreciated. I can write the scripts (shell, perl, >>>>> whatever) myself if need be, just need to know how to start going about >>>>> obtaining such a specific list of messages. >>>>> >>>>> Thanks, >>>>> >>>>> -- >>>>> Gerard Beekmans >>>>> IT Manager >>>>> Achilles Media >>>>> Tel: 403-678-1216 ext. 102 >>>>> Email: gbeekmans at achillesmedia.com >>>>> >>>>> >>>>> ---- >>>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >>>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >>>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>>>> >>>>> >>> ---- >>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>> >>> > From wes at umich.edu Mon Aug 18 20:26:04 2008 From: wes at umich.edu (Wesley Craig) Date: Mon, 18 Aug 2008 20:26:04 -0400 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080818220953.GG18572@it.is.rice.edu> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> Message-ID: <57A8FB67-DA19-4701-90B5-8E64D3B52B67@umich.edu> cyr_expire -D and -X deal with delayed delete & expunge, respectively. Neither will address message that the MUA hasn't already deleted (in the case of folders) or expunged (in the case of messages). The tool that is closest to the desired functionality is ipurge. In order for ipurge to do what you're asking, Gerard, it would have to examine whatever the "deleted" flag is for Outlook -- it varies by MUA, some set a flag, some move messages to a trash folder, etc. :wes On 18 Aug 2008, at 18:09, Kenneth Marshall wrote: > In the manual page, the definition of the '-X' option seems to > do what you want: > > -X expunge-days > Expunge previously deleted messages older than > expunge-days > (when using the "delayed" expunge mode). The default is > 0 (zero) days, which will expunge all previously > deleted messages. > >>> On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: >>>> I am looking for a way to run a daily script on the Cyrus IMAP >>>> server >>>> that processes every user's mail folders and deletes every message >>>> marked for deletion older than X days. >>>> >>>> I realize the proper way to do this is client-side and have the >>>> client >>>> program purge/expunge the mailboxes periodically in some fashion. >>>> >>>> Unfortunately in the corporate world there are many clients who >>>> still >>>> use old versions of Outlook that only marks a message for >>>> deletion and >>>> will not automatically purge the folder. >>>> >>>> To force users to manually purge every single folder they have, one >>>> folder at a time as some versions of Outlook can't do this >>>> recursively, >>>> is not a feasible option. Users just stopped doing this because it >>>> becomes too time consuming a task. >>>> >>>> So I'm looking for a server-side solution that analyzes every mail >>>> folder on the system, finds marked messages older than X days and >>>> purges/deletes them on the client's behalf. >>>> >>>> Some pointers are appreciated. I can write the scripts (shell, >>>> perl, >>>> whatever) myself if need be, just need to know how to start >>>> going about >>>> obtaining such a specific list of messages. From brong at fastmail.fm Mon Aug 18 20:05:31 2008 From: brong at fastmail.fm (Bron Gondwana) Date: Tue, 19 Aug 2008 10:05:31 +1000 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080818220953.GG18572@it.is.rice.edu> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> Message-ID: <20080819000531.GA28964@brong.net> On Mon, Aug 18, 2008 at 05:09:53PM -0500, Kenneth Marshall wrote: > In the manual page, the definition of the '-X' option seems to > do what you want: > > -X expunge-days > Expunge previously deleted messages older than expunge-days > (when using the "delayed" expunge mode). The default is > 0 (zero) days, which will expunge all previously deleted messages. Messages go through the following life cycle in "traditional IMAP", example: Created (\Recent) - LMTP DELIVER (UID = 9) No flags () - A001 SELECT INBOX (clears the \Recent) Viewed (\Seen) - A002 UID FETCH 9 RFC822 Deleted (\Deleted \Seen) - A003 UID STORE 9 +FLAGS (\Deleted) Purged (no message) - A004 EXPUNGE Now, what the -X option actually does is turns this into: Created (\Recent) - LMTP DELIVER (UID = 9) No flags () - A001 SELECT INBOX (clears the \Recent) Viewed (\Seen) - A002 UID FETCH 9 RFC822 Deleted (\Deleted \Seen) - A003 UID STORE 9 +FLAGS (\Deleted) Purged (no index record)- A004 EXPUNGE but the file is still on disk, just the index record has been moved from the file cyrus.index to a new file cyrus.expunge. A week later: Cleaned up (no file) - cyr_expire -X 7 The cyrus.expunge record and the actual spool file itself get deleted at this point. Until then you can un-delete the record using the "unexpunge" command in cyrus 2.3.X. --- I think what the original requestor was actually looking for is a tool that can run the "EXPUNGE" phase on a regular basis. As far as I'm aware there's nothing that ships with Cyrus that can do it. If I was writing something for the job I would make an admin IMAP connection to Cyrus and just cycle through the folders calling 'EXPUNGE' on them. Cheap and nasty, but it would do the trick. You can do this in any language with a TCP library, though something with an IMAP interface library would be nicer. I'd use Perl and Mail::IMAPTalk, but that's just because that's what I already use! Bron. From adam at morrison-ind.com Tue Aug 19 08:40:04 2008 From: adam at morrison-ind.com (Adam Tauno Williams) Date: Tue, 19 Aug 2008 08:40:04 -0400 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080819000531.GA28964@brong.net> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> <20080819000531.GA28964@brong.net> Message-ID: <1219149604.4778.8.camel@linux-nnci.site> On Tue, 2008-08-19 at 10:05 +1000, Bron Gondwana wrote: > On Mon, Aug 18, 2008 at 05:09:53PM -0500, Kenneth Marshall wrote: > > In the manual page, the definition of the '-X' option seems to > > do what you want: > > > > -X expunge-days > > Expunge previously deleted messages older than expunge-days > > (when using the "delayed" expunge mode). The default is > > 0 (zero) days, which will expunge all previously deleted messages. > Now, what the -X option actually does is turns this into: > but the file is still on disk, just the index record has been moved > from the file cyrus.index to a new file cyrus.expunge. A week later: > Cleaned up (no file) - cyr_expire -X 7 > The cyrus.expunge record and the actual spool file itself get deleted at > this point. Until then you can un-delete the record using the > "unexpunge" command in cyrus 2.3.X. I'm working on data-retention for my employer and I was wondering about this. The wording is a bit vague in the manual page (we are now using deleted to mean multiple things...). I have assumed that "-X 7" means purge-the-message-seven-days-AFTER-IT-WAS-"EXPUNGED". Is this correct? I believe the manual page could also be read to mean purge-the-message-AFTER-IT-WAS-"EXPUNGED"-AND-IS-OLDER-THAN-SEVEN-DAYS. "?OLDER-THAN-SEVEN-DAYS" meaning it was received more than seven days ago [equivalent to "ipurge -d 7 -X"]. > I think what the original requestor was actually looking for is a tool > that can run the "EXPUNGE" phase on a regular basis. As far as I'm > aware there's nothing that ships with Cyrus that can do it. If I was > writing something for the job I would make an admin IMAP connection to > Cyrus and just cycle through the folders calling 'EXPUNGE' on them. > Cheap and nasty, but it would do the trick. You can do this in any > language with a TCP library, though something with an IMAP interface > library would be nicer. I'd use Perl and Mail::IMAPTalk, but that's > just because that's what I already use! I'd do it in python. :) I've done some similar things for walking the entire mailstore and building statistics, etc... but it is REALLY slow! A server side API for making tools like cyr_expire would be really nice. From gbeekmans at achillesmedia.com Tue Aug 19 10:34:52 2008 From: gbeekmans at achillesmedia.com (Gerard Beekmans) Date: Tue, 19 Aug 2008 08:34:52 -0600 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <57A8FB67-DA19-4701-90B5-8E64D3B52B67@umich.edu> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> <57A8FB67-DA19-4701-90B5-8E64D3B52B67@umich.edu> Message-ID: <48AADA0C.6070303@achillesmedia.com> Wesley, I looked at ipurge but I find it also happily deletes messages that weren't marked for deletion. It appears to delete everything older than X days, regardless of that \Deleted flag mentioned in another reply. Gerard Beekmans IT Manager Achilles Media Tel: 403-678-1216 ext. 102 Email: gbeekmans at achillesmedia.com Wesley Craig wrote: > cyr_expire -D and -X deal with delayed delete & expunge, > respectively. Neither will address message that the MUA hasn't > already deleted (in the case of folders) or expunged (in the case of > messages). > > The tool that is closest to the desired functionality is ipurge. In > order for ipurge to do what you're asking, Gerard, it would have to > examine whatever the "deleted" flag is for Outlook -- it varies by > MUA, some set a flag, some move messages to a trash folder, etc. > > :wes > > On 18 Aug 2008, at 18:09, Kenneth Marshall wrote: >> In the manual page, the definition of the '-X' option seems to >> do what you want: >> >> -X expunge-days >> Expunge previously deleted messages older than >> expunge-days >> (when using the "delayed" expunge mode). The default is >> 0 (zero) days, which will expunge all previously >> deleted messages. >> >>>> On Mon, Aug 18, 2008 at 03:35:20PM -0600, Gerard Beekmans wrote: >>>>> I am looking for a way to run a daily script on the Cyrus IMAP server >>>>> that processes every user's mail folders and deletes every message >>>>> marked for deletion older than X days. >>>>> >>>>> I realize the proper way to do this is client-side and have the >>>>> client >>>>> program purge/expunge the mailboxes periodically in some fashion. >>>>> >>>>> Unfortunately in the corporate world there are many clients who still >>>>> use old versions of Outlook that only marks a message for deletion >>>>> and >>>>> will not automatically purge the folder. >>>>> >>>>> To force users to manually purge every single folder they have, one >>>>> folder at a time as some versions of Outlook can't do this >>>>> recursively, >>>>> is not a feasible option. Users just stopped doing this because it >>>>> becomes too time consuming a task. >>>>> >>>>> So I'm looking for a server-side solution that analyzes every mail >>>>> folder on the system, finds marked messages older than X days and >>>>> purges/deletes them on the client's behalf. >>>>> >>>>> Some pointers are appreciated. I can write the scripts (shell, perl, >>>>> whatever) myself if need be, just need to know how to start going >>>>> about >>>>> obtaining such a specific list of messages. From gbeekmans at achillesmedia.com Tue Aug 19 10:37:18 2008 From: gbeekmans at achillesmedia.com (Gerard Beekmans) Date: Tue, 19 Aug 2008 08:37:18 -0600 Subject: Deleting messages "marked for deletion" older than X days In-Reply-To: <20080819000531.GA28964@brong.net> References: <48A9EB18.40805@achillesmedia.com> <20080818214811.GE18572@it.is.rice.edu> <48A9EF5B.5020907@achillesmedia.com> <20080818220953.GG18572@it.is.rice.edu> <20080819000531.GA28964@brong.net> Message-ID: <48AADA9E.2020200@achillesmedia.com> Hi Bron, Yes, it sounds like that's what I'm looking for: running expunge periodically. Now there's one slight problem here: I can't just run expunge as it is. I have users who periodically need to undelete messages. I'd like expunge to only act on messages older than X days, giving people the chance to undelete messages within that time period. I'll check out some IMAP libraries. Perhaps one offers to obtain a list of all messages with the \Deleted flag, then check its received time stamp and do the math on that. If older than X, delete/expunge/whatever it, else skip it. Gerard Beekmans IT Manager Achilles Media Tel: 403-678-1216 ext. 102 Email: gbeekmans at achillesmedia.com Bron Gondwana wrote: > On Mon, Aug 18, 2008 at 05:09:53PM -0500, Kenneth Marshall wrote: > >> In the manual page, the definition of the '-X' option seems to >> do what you want: >> >> -X expunge-days >> Expunge previously deleted messages older than expunge-days >> (when using the "delayed" expunge mode). The default is >> 0 (zero) days, which will expunge all previously deleted messages. >> > > Messages go through the following life cycle in "traditional IMAP", > example: > > Created (\Recent) - LMTP DELIVER (UID = 9) > No flags () - A001 SELECT INBOX (clears the \Recent) > Viewed (\Seen) - A002 UID FETCH 9 RFC822 > Deleted (\Deleted \Seen) - A003 UID STORE 9 +FLAGS (\Deleted) > Purged (no message) - A004 EXPUNGE > > Now, what the -X option actually does is turns this into: > > Created (\Recent) - LMTP DELIVER (UID = 9) > No flags () - A001 SELECT INBOX (clears the \Recent) > Viewed (\Seen) - A002 UID FETCH 9 RFC822 > Deleted (\Deleted \Seen) - A003 UID STORE 9 +FLAGS (\Deleted) > Purged (no index record)- A004 EXPUNGE > > but the file is still on disk, just the index record has been moved > from the file cyrus.index to a new file cyrus.expunge. A week later: > > Cleaned up (no file) - cyr_expire -X 7 > > The cyrus.expunge record and the actual spool file itself get deleted at > this point. Until then you can un-delete the record using the > "unexpunge" command in cyrus 2.3.X. > > --- > > I think what the original requestor was actually looking for is a tool > that can run the "EXPUNGE" phase on a regular basis. As far as I'm > aware there's nothing that ships with Cyrus that can do it. If I was > writing something for the job I would make an admin IMAP connection to > Cyrus and just cycle through the folders calling 'EXPUNGE' on them. > Cheap and nasty, but it would do the trick. You can do this in any > language with a TCP library, though something with an IMAP interface > library would be nicer. I'd use Perl and Mail::IMAPTalk, but that's > just because that's what I already use! > > Bron. > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080819/be349d5a/attachment.html From aspineux at gmail.com Tue Aug 19 10:58:11 2008 From: aspineux at gmail.com (Alain Spineux) Date: Tue, 19 Aug 2008 16:58:11 +0200 Subject: limit user access to certain IP addresses? In-Reply-To: <48A95BA5.1060009@wpkg.org> References: <48A95BA5.1060009@wpkg.org> Message-ID: <71fe4e760808190758w6ae67860g62f708f6ea84043b@mail.gmail.com> On Mon, Aug 18, 2008 at 1:23 PM, Tomasz Chmielewski wrote: > It it possible to limit POP3/IMAP access for chosen users only to > certain IP addresses? > > For example, I'd like to allow some users only access from 127.0.0.1 > (or, Squirrelmail running on the same address as Cyrus); those users > shouldn't have public access to POP3/IMAP from the whole Internet. I do that using nginx as a pop3/imap proxy http://wiki.codemongers.com/NginxMailCoreModule > > At the same time, though, I would like to allow access for some other > users via POP3/IMAP as well. > > > Is it somehow possible with Cyrus? If it is, it would be great if it > could be used to limit access to SMTP as well. As SMTP is different than > what Cyrus does, this would perhaps suggest some additional PAM library? postfix allow you to setup your own policy service. You can insert your in smtpd_sender_restrictions or smtpd_rcipient_restrictions lists > > Any ideas? > > > -- > Tomasz Chmielewski > http://wpkg.org > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From avinash at sultanpur.org Wed Aug 20 03:33:44 2008 From: avinash at sultanpur.org (Avinash Sultanpur) Date: Wed, 20 Aug 2008 13:03:44 +0530 Subject: Problem with sync_client Message-ID: <20080820073342.GA22418@natasya.sultanpur.org> Hi, I am in the process of setting up replication. I have setup the replica server and I have tested it successfully with sync_test. -sh-3.2$ synctest -u cyrus -w password -t "" replica S: * STARTTLS S: * OK imap2.mediassistindia.com Cyrus sync server v2.3.7-Invoca-RPM-2.3.7-2.el5 C: STARTTLS S: OK Begin TLS negotiation now verify error:num=18:self signed certificate TLS connection established: TLSv1 with cipher AES256-SHA (256/256 bits) S: * SASL PLAIN S: * OK imap2.mediassistindia.com Cyrus sync server v2.3.7-Invoca-RPM-2.3.7-2.el5 C: AUTHENTICATE PLAIN **** S: OK Success (tls protection) Authenticated. Security strength factor: 256 However, when I try to use sync_client to replicate a mailbox I get the following error, -sh-3.2$ /usr/lib/cyrus-imapd/sync_client -vl -u yukthi Can not connect to server 'replica', retrying in 15 seconds and this in syslog, Aug 20 12:18:39 imap1 sync_client[10378]: connect(replica) failed: Invalid argument I ran tcpdump on the replica server and I don't see any packets coming to port 'csync'. You can also find the strace output of sync_client at http://sultanpur.org/sync_client_strace. Master server's imapd.conf: configdirectory: /var/lib/imap partition-default: /var/spool/imap admins: cyrus sievedir: /var/lib/imap/sieve sendmail: /usr/sbin/sendmail hashimapspool: true sasl_pwcheck_method: saslauthd sasl_mech_list: PLAIN lmtp_downcase_rcpt: 1 allowplaintext: 1 tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd.pem tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt autocreatequota: 2048000 unixhierarchysep: 1 sync_host: replica sync_authname: cyrus sync_password: password Cyrus version: 2.3.7 on Cent OS 5.2 -Avinash From peo at intersonic.se Wed Aug 20 10:12:29 2008 From: peo at intersonic.se (Per olof Ljungmark) Date: Wed, 20 Aug 2008 16:12:29 +0200 Subject: Problem with sync_client In-Reply-To: <20080820073342.GA22418@natasya.sultanpur.org> References: <20080820073342.GA22418@natasya.sultanpur.org> Message-ID: <48AC264D.3070901@intersonic.se> Avinash Sultanpur wrote: > Hi, > > I am in the process of setting up replication. I have setup the > replica server and I have tested it successfully with sync_test. > > sync_host: replica ^^^^^^^ I thought this paramter needs to be hostname or IP of replica? "sync_host: Name of the host (replica running sync_server(8)) to which replication actions will be sent by sync_client(8)." --per From dbucherml at hsolutions.ch Fri Aug 22 05:16:17 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 11:16:17 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) Message-ID: <48AE83E1.3050103@hsolutions.ch> Hello, We have 50 people using Outlook on our IMAP cyrus server. It's wonderful : fast, efficient, no problem, easy... But for 4-5 days I have a strange problem only on one PC : * Outlook has to reconnect to the server every 5 minutes because of "Fatal error: word too long". As far as I understand, the cause of the problem is : * "Outlook is sending either a token or quoted string that is longer than 8K bytes." But how could I correct this problem either in Outlook or cyrus ??? * Can I simply delete the "offending" email in Outlook, but how to find which one ? Thanks a lot in advance for your help ! Denis Bucher cyrus version : name : Cyrus IMAPD version : v2.2.12 2005/02/14 16:43:51 vendor : Project Cyrus support-url: http://asg.web.cmu.edu/cyrus os : Linux os-version : 2.6.16.46-0.12-smp environment: Built w/Cyrus SASL 2.1.21 Running w/Cyrus SASL 2.1.21 Built w/Sleepycat Software: Berkeley DB 4.3.29: (March 28, 2007) Running w/Sleepycat Software: Berkeley DB 4.3.29: (June 16, 2006) Built w/OpenSSL 0.9.8a 11 Oct 2005 Running w/OpenSSL 0.9.8a 11 Oct 2005 CMU Sieve 2.2 DRAC TCP Wrappers mmap = shared lock = fcntl nonblock = fcntl auth = unix idle = idled Denis From michael.menge at zdv.uni-tuebingen.de Fri Aug 22 05:45:38 2008 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Fri, 22 Aug 2008 11:45:38 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE83E1.3050103@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> Message-ID: <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> Quoting Denis BUCHER : > > Hello, > > We have 50 people using Outlook on our IMAP cyrus server. It's > wonderful : fast, efficient, no problem, easy... > > But for 4-5 days I have a strange problem only on one PC : > * Outlook has to reconnect to the server every 5 minutes because of > "Fatal error: word too long". > > As far as I understand, the cause of the problem is : > * "Outlook is sending either a token or quoted string that is longer > than 8K bytes." > > But how could I correct this problem either in Outlook or cyrus ??? > * Can I simply delete the "offending" email in Outlook, but how to > find which one ? > > Thanks a lot in advance for your help ! > > Denis Bucher > Hi you can investigate the problem further by activating cyrus telemetry logging for that user. Create a directory with the name of the userid in {configdirectory}/log . Cyrus will create files in there wich will contain all data send and recieved after authentication. Michael Menge -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de Waechterstrasse 76 72074 Tuebingen From dbucherml at hsolutions.ch Fri Aug 22 05:55:10 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 11:55:10 +0200 Subject: Question about deleted emails (emails being marked as deleted) Message-ID: <48AE8CFE.40404@hsolutions.ch> Hello, Many email clients simply marks emails as deleted when moving them or deleting them ? Which makes a huge amount of "ghost" emails filling our server. Is there a way with a simple script to delete all deleted emails let's say older than 30 days ? Thanks a lot in advance for your help ! Denis cyrus version : name : Cyrus IMAPD version : v2.2.12 2005/02/14 16:43:51 vendor : Project Cyrus support-url: http://asg.web.cmu.edu/cyrus os : Linux os-version : 2.6.16.46-0.12-smp environment: Built w/Cyrus SASL 2.1.21 Running w/Cyrus SASL 2.1.21 Built w/Sleepycat Software: Berkeley DB 4.3.29: (March 28, 2007) Running w/Sleepycat Software: Berkeley DB 4.3.29: (June 16, 2006) Built w/OpenSSL 0.9.8a 11 Oct 2005 Running w/OpenSSL 0.9.8a 11 Oct 2005 CMU Sieve 2.2 DRAC TCP Wrappers mmap = shared lock = fcntl nonblock = fcntl auth = unix idle = idled From dbucherml at hsolutions.ch Fri Aug 22 06:20:31 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 12:20:31 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> Message-ID: <48AE92EF.9070401@hsolutions.ch> Michael Menge a ?crit : > Quoting Denis BUCHER : >> >> We have 50 people using Outlook on our IMAP cyrus server. It's >> wonderful : fast, efficient, no problem, easy... >> >> But for 4-5 days I have a strange problem only on one PC : >> * Outlook has to reconnect to the server every 5 minutes because of >> "Fatal error: word too long". >> >> As far as I understand, the cause of the problem is : >> * "Outlook is sending either a token or quoted string that is longer >> than 8K bytes." >> >> But how could I correct this problem either in Outlook or cyrus ??? >> * Can I simply delete the "offending" email in Outlook, but how to >> find which one ? >> >> Denis Bucher > > Hi > > you can investigate the problem further by activating cyrus telemetry > logging for that user. Create a directory with the name of the userid > in {configdirectory}/log . Cyrus will create files in there wich will > contain all data send and recieved after authentication. > > Michael Menge What do you call the configdirectory for cyrus ? I have different places with cyrus (I'm using the standard package provided with SuSE Linux / SLES 10) : 1. I have a "cyrus" user with all binaries inside "bin" in the homedir 2. In "/var/spool/imap/user/" there are all user accounts with the mails... But I think I understand, I have to create the "log" directory into : /var/spool/imap/user/dbucher which means : /var/spool/imap/user/dbucher/log Is that enough and correct, no config to add or command in cyradm ? I restarted cyrus but nothing appears in the log directory... Thank you very much for your help Denis From dave64 at andrew.cmu.edu Fri Aug 22 06:30:59 2008 From: dave64 at andrew.cmu.edu (Dave McMurtrie) Date: Fri, 22 Aug 2008 06:30:59 -0400 Subject: Question about deleted emails (emails being marked as deleted) In-Reply-To: <48AE8CFE.40404@hsolutions.ch> References: <48AE8CFE.40404@hsolutions.ch> Message-ID: <48AE9563.4080104@andrew.cmu.edu> Denis BUCHER wrote: > Hello, > > Many email clients simply marks emails as deleted when moving them or > deleting them ? Which makes a huge amount of "ghost" emails filling our > server. > > Is there a way with a simple script to delete all deleted emails let's > say older than 30 days ? Check out the list archives from earlier this month: http://lists.andrew.cmu.edu/pipermail/info-cyrus/2008-August/029560.html Thanks, Dave From aspineux at gmail.com Fri Aug 22 07:11:53 2008 From: aspineux at gmail.com (Alain Spineux) Date: Fri, 22 Aug 2008 13:11:53 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE92EF.9070401@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> <48AE92EF.9070401@hsolutions.ch> Message-ID: <71fe4e760808220411uad95db8id265deaf7961a7fa@mail.gmail.com> On Fri, Aug 22, 2008 at 12:20 PM, Denis BUCHER wrote: > Michael Menge a ?crit : >> Quoting Denis BUCHER : >>> >>> We have 50 people using Outlook on our IMAP cyrus server. It's >>> wonderful : fast, efficient, no problem, easy... >>> >>> But for 4-5 days I have a strange problem only on one PC : >>> * Outlook has to reconnect to the server every 5 minutes because of >>> "Fatal error: word too long". >>> >>> As far as I understand, the cause of the problem is : >>> * "Outlook is sending either a token or quoted string that is longer >>> than 8K bytes." >>> >>> But how could I correct this problem either in Outlook or cyrus ??? >>> * Can I simply delete the "offending" email in Outlook, but how to >>> find which one ? >>> >>> Denis Bucher >> >> Hi >> >> you can investigate the problem further by activating cyrus telemetry >> logging for that user. Create a directory with the name of the userid >> in {configdirectory}/log . Cyrus will create files in there wich will >> contain all data send and recieved after authentication. >> >> Michael Menge > > What do you call the configdirectory for cyrus ? I have different places > with cyrus (I'm using the standard package provided with SuSE Linux / > SLES 10) : for myself : # mkdir /var/lib/imap/log/firstname.lastname at domain.name # chown cyrus.cyrus /var/lib/imap/log/firstname.lastname at domain.name > > 1. I have a "cyrus" user with all binaries inside "bin" in the homedir > 2. In "/var/spool/imap/user/" there are all user accounts with the mails... > > But I think I understand, I have to create the "log" directory into : > /var/spool/imap/user/dbucher > which means : > /var/spool/imap/user/dbucher/log > > Is that enough and correct, no config to add or command in cyradm ? nothing more > > I restarted cyrus but nothing appears in the log directory... > > Thank you very much for your help To solve your problem you could try to use an imap proxy between your outlook and cyrus like "nginx" Just for this user or other having problems at first > > Denis > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From dpc22 at cam.ac.uk Fri Aug 22 07:17:18 2008 From: dpc22 at cam.ac.uk (David Carter) Date: Fri, 22 Aug 2008 12:17:18 +0100 (BST) Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE83E1.3050103@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> Message-ID: On Fri, 22 Aug 2008, Denis BUCHER wrote: > As far as I understand, the cause of the problem is : * "Outlook is > sending either a token or quoted string that is longer than 8K bytes." Your problem is a mailbox which contains several thousand messages. Possibly several thousand messages which Outlook hasn't seen previously. Outlook tries to construct a single IMAP command of the form: UID FETCH uid,uid,uid,... where the list of UIDs is larger than 8 KBytes in size. > But how could I correct this problem either in Outlook or cyrus ??? Split the problem mailbox into smaller mailboxes using something other than Outlook. Alternatively you could increase the word limit in Cyrus. MAXWORD is 32k in recent Cyrus 2.3 versions. -- David Carter Email: David.Carter at ucs.cam.ac.uk University Computing Service, Phone: (01223) 334502 New Museums Site, Pembroke Street, Fax: (01223) 334679 Cambridge UK. CB2 3QH. From dpc22 at cam.ac.uk Fri Aug 22 07:18:13 2008 From: dpc22 at cam.ac.uk (David Carter) Date: Fri, 22 Aug 2008 12:18:13 +0100 (BST) Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE92EF.9070401@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> <48AE92EF.9070401@hsolutions.ch> Message-ID: On Fri, 22 Aug 2008, Denis BUCHER wrote: > But I think I understand, I have to create the "log" directory into : > /var/spool/imap/user/dbucher > which means : > /var/spool/imap/user/dbucher/log No, /var/imap/log/dbucher. You shouldn't need to restart Cyrus. -- David Carter Email: David.Carter at ucs.cam.ac.uk University Computing Service, Phone: (01223) 334502 New Museums Site, Pembroke Street, Fax: (01223) 334679 Cambridge UK. CB2 3QH. From michael.menge at zdv.uni-tuebingen.de Fri Aug 22 07:24:51 2008 From: michael.menge at zdv.uni-tuebingen.de (Michael Menge) Date: Fri, 22 Aug 2008 13:24:51 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE92EF.9070401@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> <48AE92EF.9070401@hsolutions.ch> Message-ID: <20080822132451.vj3jph3m88k048ow@webmail.uni-tuebingen.de> Quoting Denis BUCHER : > Michael Menge a ?crit : >> Quoting Denis BUCHER : >>> >>> We have 50 people using Outlook on our IMAP cyrus server. It's >>> wonderful : fast, efficient, no problem, easy... >>> >>> But for 4-5 days I have a strange problem only on one PC : >>> * Outlook has to reconnect to the server every 5 minutes because of >>> "Fatal error: word too long". >>> >>> As far as I understand, the cause of the problem is : >>> * "Outlook is sending either a token or quoted string that is longer >>> than 8K bytes." >>> >>> But how could I correct this problem either in Outlook or cyrus ??? >>> * Can I simply delete the "offending" email in Outlook, but how to >>> find which one ? >>> >>> Denis Bucher >> >> Hi >> >> you can investigate the problem further by activating cyrus >> telemetry logging for that user. Create a directory with the name >> of the userid in {configdirectory}/log . Cyrus will create files >> in there wich will contain all data send and recieved after >> authentication. >> >> Michael Menge > > What do you call the configdirectory for cyrus ? I have different > places with cyrus (I'm using the standard package provided with SuSE > Linux / SLES 10) : > > 1. I have a "cyrus" user with all binaries inside "bin" in the homedir > 2. In "/var/spool/imap/user/" there are all user accounts with the mails... > The configdirectory is set in /etc/imapd.conf it should default to /var/lib/imap > But I think I understand, I have to create the "log" directory into : > /var/spool/imap/user/dbucher > which means : > /var/spool/imap/user/dbucher/log > No, the log directory should already be there, so you have to create /var/lib/imap/log/dbucher ,take care that cyrus as permissions to write in that directory. > Is that enough and correct, no config to add or command in cyradm ? > Yes thas enough, no config no command in cyradm but you created it in the wrong place. Michael Menge -------------------------------------------------------------------------------- M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: michael.menge at zdv.uni-tuebingen.de Waechterstrasse 76 72074 Tuebingen From olaf at navi.pl Fri Aug 22 07:28:59 2008 From: olaf at navi.pl (Olaf Fraczyk) Date: Fri, 22 Aug 2008 13:28:59 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AE92EF.9070401@hsolutions.ch> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> <48AE92EF.9070401@hsolutions.ch> Message-ID: <1219404539.13993.39.camel@venus.local.navi.pl> On Fri, 2008-08-22 at 12:20 +0200, Denis BUCHER wrote: > > > > Hi > > > > you can investigate the problem further by activating cyrus telemetry > > logging for that user. Create a directory with the name of the userid > > in {configdirectory}/log . Cyrus will create files in there wich will > > contain all data send and recieved after authentication. > > > > Michael Menge > > What do you call the configdirectory for cyrus ? I have different places > with cyrus (I'm using the standard package provided with SuSE Linux / > SLES 10) : > > 1. I have a "cyrus" user with all binaries inside "bin" in the homedir > 2. In "/var/spool/imap/user/" there are all user accounts with the mails... > > But I think I understand, I have to create the "log" directory into : > /var/spool/imap/user/dbucher > which means : > /var/spool/imap/user/dbucher/log > > Is that enough and correct, no config to add or command in cyradm ? > > I restarted cyrus but nothing appears in the log directory... /var/spool/imap is not a config directory. in /etc/imapd.conf you should have a line with configdirectory definition eg: configdirectory: /var/lib/imap So you should create directory: /var/lib/imap/log/user_name Regards, Olaf -- Olaf Fr?czyk NAVI http://www.navi.pl http://www.ntp.navi.pl From cvizitiu at gbif.org Fri Aug 22 07:47:52 2008 From: cvizitiu at gbif.org (Ciprian Marius Vizitiu) Date: Fri, 22 Aug 2008 13:47:52 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: References: <48AE83E1.3050103@hsolutions.ch> Message-ID: <48AEA768.50201@gbif.org> David Carter wrote: > On Fri, 22 Aug 2008, Denis BUCHER wrote: > >> As far as I understand, the cause of the problem is : * "Outlook is >> sending either a token or quoted string that is longer than 8K bytes." >> > > Your problem is a mailbox which contains several thousand messages. > Possibly several thousand messages which Outlook hasn't seen previously. > > Outlook tries to construct a single IMAP command of the form: > > UID FETCH uid,uid,uid,... > > where the list of UIDs is larger than 8 KBytes in size. > Any other possibility? I mean other than several thousand messages? Can it be a limit in the OS? Or maybe the "set of fields"? Which contain a weird char(set)? I'm asking because I've had a CEO with ~28.000 (twenty eight thousands) messages in his Inbox... out of which ~9500 were unread; and that was on a 32 bit RHEL 4.0. Yet I haven't seen ( thanks God!) the problem(s) described in this thread. From dpc22 at cam.ac.uk Fri Aug 22 07:59:06 2008 From: dpc22 at cam.ac.uk (David Carter) Date: Fri, 22 Aug 2008 12:59:06 +0100 (BST) Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <48AEA768.50201@gbif.org> References: <48AE83E1.3050103@hsolutions.ch> <48AEA768.50201@gbif.org> Message-ID: On Fri, 22 Aug 2008, Ciprian Marius Vizitiu wrote: > Any other possibility? I mean other than several thousand messages? Several thousand messages is the obvious cause. We've seen this once (with Cyrus 2.3) after running unexpunge on a very large mailbox. The mailbox got a new UIDvalidity, so Outlook wanted to resychronise the whole thing. But /var/imap/log will give a definitive answer. -- David Carter Email: David.Carter at ucs.cam.ac.uk University Computing Service, Phone: (01223) 334502 New Museums Site, Pembroke Street, Fax: (01223) 334679 Cambridge UK. CB2 3QH. From dbucherml at hsolutions.ch Fri Aug 22 08:32:37 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 14:32:37 +0200 Subject: Question about deleted emails (emails being marked as deleted) In-Reply-To: <48AE9563.4080104@andrew.cmu.edu> References: <48AE8CFE.40404@hsolutions.ch> <48AE9563.4080104@andrew.cmu.edu> Message-ID: <48AEB1E5.5090403@hsolutions.ch> Dave McMurtrie a ?crit : >> Many email clients simply marks emails as deleted when moving them or >> deleting them ? Which makes a huge amount of "ghost" emails filling our >> server. >> >> Is there a way with a simple script to delete all deleted emails let's >> say older than 30 days ? > > Check out the list archives from earlier this month: > http://lists.andrew.cmu.edu/pipermail/info-cyrus/2008-August/029560.html > > Thanks, > > Dave Thanks a lot ! (And sorry I forgot to search the mailing list archives first) Denis From mikeegg1 at mac.com Fri Aug 22 09:00:25 2008 From: mikeegg1 at mac.com (Mike Eggleston) Date: Fri, 22 Aug 2008 08:00:25 -0500 Subject: Question about deleted emails (emails being marked as deleted) In-Reply-To: <48AEB1E5.5090403@hsolutions.ch> References: <48AE8CFE.40404@hsolutions.ch> <48AE9563.4080104@andrew.cmu.edu> <48AEB1E5.5090403@hsolutions.ch> Message-ID: <20080822130025.GC15690@mail.mac.com> On Fri, 22 Aug 2008, Denis BUCHER might have said: > Dave McMurtrie a ?crit : > >> Many email clients simply marks emails as deleted when moving them or > >> deleting them ? Which makes a huge amount of "ghost" emails filling our > >> server. > >> > >> Is there a way with a simple script to delete all deleted emails let's > >> say older than 30 days ? > > > > Check out the list archives from earlier this month: > > http://lists.andrew.cmu.edu/pipermail/info-cyrus/2008-August/029560.html > > > > Thanks, > > > > Dave > > Thanks a lot ! (And sorry I forgot to search the mailing list archives > first) > > Denis I have a perl script that expunges any messages marked for deletion. I also set an expiration of five days for a spam folder using cyradm. Mike From dbucherml at hsolutions.ch Fri Aug 22 09:04:41 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 15:04:41 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: <71fe4e760808220411uad95db8id265deaf7961a7fa@mail.gmail.com> References: <48AE83E1.3050103@hsolutions.ch> <20080822114538.3l180ndrhss8cg40@webmail.uni-tuebingen.de> <48AE92EF.9070401@hsolutions.ch> <71fe4e760808220411uad95db8id265deaf7961a7fa@mail.gmail.com> Message-ID: <48AEB969.2080202@hsolutions.ch> Hello, Thanks a lot to everyone for your answers, I'll do a complete reply, I think it's better : Michael Menge a ?crit : > The configdirectory is set in /etc/imapd.conf it should default to > /var/lib/imap Yes, you're right... BTW I never understood why there is a /etc/imapd.conf and a /etc/cyrus.conf... What should I do now that I have the logs ? Alain Spineux a ?crit : > for myself : > # mkdir /var/lib/imap/log/firstname.lastname at domain.name > # chown cyrus.cyrus /var/lib/imap/log/firstname.lastname at domain.name Ok great, for me it was /var/lib/imap/log/username, now the directory gets filled by cyrus (without even restarting it) > To solve your problem you could try to use an imap proxy between your > outlook and cyrus like "nginx" > Just for this user or other having problems at first You mean to see what's happening or as a solution ? Denis From dbucherml at hsolutions.ch Fri Aug 22 09:05:34 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 15:05:34 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: References: <48AE83E1.3050103@hsolutions.ch> Message-ID: <48AEB99E.2070203@hsolutions.ch> Hello, David Carter a ?crit : >> As far as I understand, the cause of the problem is : * "Outlook is >> sending either a token or quoted string that is longer than 8K bytes." > > Your problem is a mailbox which contains several thousand messages. > Possibly several thousand messages which Outlook hasn't seen previously. > > Outlook tries to construct a single IMAP command of the form: > > UID FETCH uid,uid,uid,... > > where the list of UIDs is larger than 8 KBytes in size. > >> But how could I correct this problem either in Outlook or cyrus ??? > > Split the problem mailbox into smaller mailboxes using something other > than Outlook. A mailbox or a folder ? I mean, if we can split messages into different folders will it solve the problem as well ? > Alternatively you could increase the word limit in Cyrus. > MAXWORD is 32k in recent Cyrus 2.3 versions. Question, I suppose I would need to compile Cyrus, if I wanted to change the word limit ? Thank you very much for your help Denis From dbucherml at hsolutions.ch Fri Aug 22 09:58:43 2008 From: dbucherml at hsolutions.ch (Denis BUCHER) Date: Fri, 22 Aug 2008 15:58:43 +0200 Subject: Very annoying IMAP problem (cyrus + Outlook) In-Reply-To: References: <48AE83E1.3050103@hsolutions.ch> Message-ID: <48AEC613.1000405@hsolutions.ch> Hello everyone, David Carter a ?crit : > On Fri, 22 Aug 2008, Denis BUCHER wrote: > >> As far as I understand, the cause of the problem is : * "Outlook is >> sending either a token or quoted string that is longer than 8K bytes." > > Your problem is a mailbox which contains several thousand messages. > Possibly several thousand messages which Outlook hasn't seen previously. > > Outlook tries to construct a single IMAP command of the form: > > UID FETCH uid,uid,uid,... > > where the list of UIDs is larger than 8 KBytes in size. Ok that's what I have : a) Logs are present # ls -l /var/lib/imap/log/dbucher total 2508 -rw------- 1 cyrus mail 355147 Aug 22 14:43 20235 -rw------- 1 cyrus mail 5327 Aug 22 14:43 25058 -rw------- 1 cyrus mail 10654 Aug 22 14:54 25415 -rw------- 1 cyrus mail 355241 Aug 22 15:24 25416 -rw------- 1 cyrus mail 355537 Aug 22 15:03 25417 -rw------- 1 cyrus mail 355147 Aug 22 14:48 25576 -rw------- 1 cyrus mail 5327 Aug 22 14:59 26381 -rw------- 1 cyrus mail 5327 Aug 22 15:04 26763 -rw------- 1 cyrus mail 355443 Aug 22 15:15 26765 -rw------- 1 cyrus mail 5327 Aug 22 15:09 27095 -rw------- 1 cyrus mail 5327 Aug 22 15:14 27752 -rw------- 1 cyrus mail 360146 Aug 22 15:19 28135 -rw------- 1 cyrus mail 5327 Aug 22 15:24 28463 -rw------- 1 cyrus mail 5327 Aug 22 15:29 29125 -rw------- 1 cyrus mail 355147 Aug 22 15:29 29127 b) That's the UID FETCH : # grep "UID FETCH" * 20235:<12194089821219411787>5mk6 OK Completed * BYE LOGOUT received ZZZZ OK Completed d) But not all : ==> 30887 <== >1219413279>91rc OK Completed <1219413279<6leo IDLE >1219413279>+ idling <12194133431219413343>6leo OK Completed <1219413343<351h UID STORE 7136 +FLAGS (\Deleted \Seen) >1219413343>* 7136 FETCH (FLAGS (\Deleted \Seen) UID 7136) 351h OK Completed <12194133431219413343>+ idling [end of file] e) And there are many "Fatal error: word too long" but not with same number... Aug 22 14:43:03 atlantic imaps[25050]: Fatal error: word too long Aug 22 14:48:08 atlantic imaps[25063]: Fatal error: word too long Aug 22 14:53:24 atlantic imaps[17518]: Fatal error: word too long Aug 22 14:58:28 atlantic imaps[26379]: Fatal error: word too long Aug 22 15:03:34 atlantic imaps[26776]: Fatal error: word too long Aug 22 15:08:40 atlantic imaps[27118]: Fatal error: word too long Aug 22 15:13:45 atlantic imaps[27749]: Fatal error: word too long Aug 22 15:18:51 atlantic imaps[27174]: Fatal error: word too long Aug 22 15:24:01 atlantic imaps[28464]: Fatal error: word too long Aug 22 15:29:06 atlantic imaps[29123]: Fatal error: word too long Normally the watched account having had "Fatal error", I should find a fatal error in the transactions logs ? Or is nothing written in case of a Fatal error ? (Which I hope not ;-) Thanks a lot for your help ! Denis From schweizer.martin at gmail.com Mon Aug 25 03:30:09 2008 From: schweizer.martin at gmail.com (Martin Schweizer) Date: Mon, 25 Aug 2008 09:30:09 +0200 Subject: root file system full: master.core? Message-ID: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> Hello I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all works well. After the update from FreeBSD 6.3 to 7.0 I got always when I start cyrus a file which is called master.core in /etc/rc.d which has around 65MB. The probleme here is that the root file system is now quite full. Any ideas? Kind regards, -- Martin Schweizer schweizer.martin at gmail.com Tel.: +41 32 512 48 54 (VoIP) Fax: +1 619 3300587 From aspineux at gmail.com Mon Aug 25 06:25:47 2008 From: aspineux at gmail.com (Alain Spineux) Date: Mon, 25 Aug 2008 12:25:47 +0200 Subject: root file system full: master.core? In-Reply-To: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> References: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> Message-ID: <71fe4e760808250325q1a178e9cg2ba0ea9587a59978@mail.gmail.com> On Mon, Aug 25, 2008 at 9:30 AM, Martin Schweizer wrote: > Hello > > I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all > works well. After the update from FreeBSD 6.3 to 7.0 I got always when > I start cyrus a file which is called master.core in /etc/rc.d which > has around 65MB. The problem here is that the root file system is now > quite full. Any ideas? This look like a "core dump" ! The dump of the memory of a process when it crashed. This should help you to find why it crashed ! Can you look in your log files at the creation time of this "core dump" to see for any error ? Are you sure master.core is coming from a problem with cyrus ? Because postfix "master" is also called master ! Could you remove this file and restart cyrus service ? Does this file come back ? If not can you try with postfix service ? FYI : the ulimit command can't be used to "disable" the core dump creation by setting a maximum size to 0 But this doesnt' solve the problem, just hide it. > > Kind regards, > -- > Martin Schweizer > schweizer.martin at gmail.com > Tel.: +41 32 512 48 54 (VoIP) > Fax: +1 619 3300587 > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From doconnor at gsoft.com.au Mon Aug 25 07:16:15 2008 From: doconnor at gsoft.com.au (Daniel O'Connor) Date: Mon, 25 Aug 2008 20:46:15 +0930 Subject: root file system full: master.core? In-Reply-To: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> References: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> Message-ID: On Mon, 25 Aug 2008, Martin Schweizer wrote: > I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare > all works well. After the update from FreeBSD 6.3 to 7.0 I got always > when I start cyrus a file which is called master.core in /etc/rc.d > which has around 65MB. The probleme here is that the root file system > is now quite full. Any ideas? What do you get if you run... sudo gdb /usr/local/cyrus/bin/master /master.core then type bt. One work around would be to modify the rc.d file to cd somewhere (put cyrus_imapd_chdir=/foo in it) I'm running 2.3.7 without seeing coredumps FWIW. -- Daniel O'Connor software and network engineer for Genesis Software - http://www.gsoft.com.au "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum GPG Fingerprint - 5596 B766 97C0 0E94 4347 295E E593 DC20 7B3F CE8C -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 187 bytes Desc: This is a digitally signed message part. Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080825/5b15d506/attachment.bin From tarjei at nu.no Mon Aug 25 08:04:57 2008 From: tarjei at nu.no (tarjei) Date: Mon, 25 Aug 2008 14:04:57 +0200 Subject: Cyrus-imapd not providing realm information Message-ID: <48B29FE9.2020604@nu.no> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an virtdomains setup. Relevant info: OS: Centos 5.2 Cyrus-Imapd: 2.3.7 Sasl: 2.1.22 imapd.conf: altnamespace: yes autocreatequota:-1 createonpost: no autocreate_sieve_script: /var/lib/imap/sieve/default.script autocreateinboxfolders: Spam|Drafts|Sent|Trash autosubscribeinboxfolders: Spam|Drafts|Sent|Trash autosubscribesharedfolders: Spam|Ikke-Spam defaultdomain: example.com virtdomains: userid servername: mail.example.com unixhierarchysep: 1 sasl_mech_list: plain sasl_pwcheck_method: saslauthd cmtp_overquota_perm_failure: no saslauthd.conf: ldap_servers: ldaps://ldap.example.com ldap_version: 3 ldap_timeout: 10 ldap_time_limit: 10 ldap_search_base: dc=example,dc=com ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com ldap_password: password ldap_scope: sub ldap_uidattr: mail ldap_filter_mode: yes ldap_filter: (mail=%u@%r) testsaslauth works: testsaslauthd -u tarjei -r example.com -p password 0: OK "Success." but imtest fails: imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost ... S: A01 NO authentication failure Authentication failed. generic failure I then find the following in the log files: saslauthd[27506]: do_auth : auth failure: [user=tarjei] [service=imap] [realm=] [mech=ldap] [reason=Unknown] And in the ldap log: SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" It seems to me that for some reason, the imap server is not passing on the full username - but just the part before the domainname. Does anyone know what I am doing wrong? I seem so close :) Kind regards, Tarjei -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsp/pYVRKCnSvzfIRAoN2AJ94nmeUJ1ir+SWICgZQwz1W9JQskACgn4X4 kt/8icmlER1QImZK+ZR/r7U= =zTtD -----END PGP SIGNATURE----- From lartc at manchotnetworks.net Mon Aug 25 08:13:05 2008 From: lartc at manchotnetworks.net (lartc) Date: Mon, 25 Aug 2008 14:13:05 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <48B29FE9.2020604@nu.no> References: <48B29FE9.2020604@nu.no> Message-ID: <1219666386.3771.9.camel@sumatra.ccuse.com> Hi, I've got the same setup -- you should have ldap_realm: yourdomain.com in /etc/saslauthd.conf and you should start saslauthd daemon with the "-r" argument hth, charles On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an > virtdomains setup. > > Relevant info: > OS: Centos 5.2 > Cyrus-Imapd: 2.3.7 > Sasl: 2.1.22 > > imapd.conf: > altnamespace: yes > autocreatequota:-1 > createonpost: no > autocreate_sieve_script: /var/lib/imap/sieve/default.script > autocreateinboxfolders: Spam|Drafts|Sent|Trash > autosubscribeinboxfolders: Spam|Drafts|Sent|Trash > autosubscribesharedfolders: Spam|Ikke-Spam > defaultdomain: example.com > virtdomains: userid > servername: mail.example.com > unixhierarchysep: 1 > sasl_mech_list: plain > sasl_pwcheck_method: saslauthd > cmtp_overquota_perm_failure: no > > saslauthd.conf: > ldap_servers: ldaps://ldap.example.com > ldap_version: 3 > ldap_timeout: 10 > ldap_time_limit: 10 > ldap_search_base: dc=example,dc=com > ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com > ldap_password: password > ldap_scope: sub > ldap_uidattr: mail > ldap_filter_mode: yes > ldap_filter: (mail=%u@%r) > > testsaslauth works: > testsaslauthd -u tarjei -r example.com -p password > 0: OK "Success." > > but imtest fails: > imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost > ... > S: A01 NO authentication failure > Authentication failed. generic failure > > I then find the following in the log files: > saslauthd[27506]: do_auth : auth failure: [user=tarjei] > [service=imap] [realm=] [mech=ldap] [reason=Unknown] > > And in the ldap log: > SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" > > > It seems to me that for some reason, the imap server is not passing on > the full username - but just the part before the domainname. > > Does anyone know what I am doing wrong? I seem so close :) > > Kind regards, > Tarjei > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFIsp/pYVRKCnSvzfIRAoN2AJ94nmeUJ1ir+SWICgZQwz1W9JQskACgn4X4 > kt/8icmlER1QImZK+ZR/r7U= > =zTtD > -----END PGP SIGNATURE----- > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html From tarjei at nu.no Mon Aug 25 08:37:03 2008 From: tarjei at nu.no (tarjei) Date: Mon, 25 Aug 2008 14:37:03 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <1219666386.3771.9.camel@sumatra.ccuse.com> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> Message-ID: <48B2A76F.8030303@nu.no> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 lartc wrote: > Hi, > > I've got the same setup -- you should have > > ldap_realm: yourdomain.com > > in /etc/saslauthd.conf > > and you should start saslauthd daemon with the "-r" argument > Hi Charles, thank you for your quick reply. I tried your suggestions, but they do not seem to solve my problem. The same problem persists. Kind regards, tarjei > hth, > > charles > > > > > On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: > Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an > virtdomains setup. > > Relevant info: > OS: Centos 5.2 > Cyrus-Imapd: 2.3.7 > Sasl: 2.1.22 > > imapd.conf: > altnamespace: yes > autocreatequota:-1 > createonpost: no > autocreate_sieve_script: /var/lib/imap/sieve/default.script > autocreateinboxfolders: Spam|Drafts|Sent|Trash > autosubscribeinboxfolders: Spam|Drafts|Sent|Trash > autosubscribesharedfolders: Spam|Ikke-Spam > defaultdomain: example.com > virtdomains: userid > servername: mail.example.com > unixhierarchysep: 1 > sasl_mech_list: plain > sasl_pwcheck_method: saslauthd > cmtp_overquota_perm_failure: no > > saslauthd.conf: > ldap_servers: ldaps://ldap.example.com > ldap_version: 3 > ldap_timeout: 10 > ldap_time_limit: 10 > ldap_search_base: dc=example,dc=com > ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com > ldap_password: password > ldap_scope: sub > ldap_uidattr: mail > ldap_filter_mode: yes > ldap_filter: (mail=%u@%r) > > testsaslauth works: > testsaslauthd -u tarjei -r example.com -p password > 0: OK "Success." > > but imtest fails: > imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost > ... > S: A01 NO authentication failure > Authentication failed. generic failure > > I then find the following in the log files: > saslauthd[27506]: do_auth : auth failure: [user=tarjei] > [service=imap] [realm=] [mech=ldap] [reason=Unknown] > > And in the ldap log: > SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" > > > It seems to me that for some reason, the imap server is not passing on > the full username - but just the part before the domainname. > > Does anyone know what I am doing wrong? I seem so close :) > > Kind regards, > Tarjei > - ---- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqdvYVRKCnSvzfIRAjSUAJ0VVE8/qQV1g8Jk5owVOhsvQ3+I7wCgqIa6 o6czot+fnXmO4tfUGFeeWhg= =M20U -----END PGP SIGNATURE----- From tarjei at nu.no Mon Aug 25 08:51:56 2008 From: tarjei at nu.no (tarjei) Date: Mon, 25 Aug 2008 14:51:56 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <48B2A76F.8030303@nu.no> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> <48B2A76F.8030303@nu.no> Message-ID: <48B2AAEC.8020309@nu.no> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Again, tarjei wrote: > lartc wrote: >> Hi, > >> I've got the same setup -- you should have > >> ldap_realm: yourdomain.com It seems that the parameter that needed to be set was ldap_default_realm, as I found when reading http://thread.gmane.org/gmane.mail.imap.cyrus/22049. Again, thanks for helping me. Kind regards, Tarjei > >> in /etc/saslauthd.conf > >> and you should start saslauthd daemon with the "-r" argument > > > Hi Charles, thank you for your quick reply. > > I tried your suggestions, but they do not seem to solve my problem. The > same problem persists. > > Kind regards, > tarjei > >> hth, > >> charles > > > > >> On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: >> Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an >> virtdomains setup. > >> Relevant info: >> OS: Centos 5.2 >> Cyrus-Imapd: 2.3.7 >> Sasl: 2.1.22 > >> imapd.conf: >> altnamespace: yes >> autocreatequota:-1 >> createonpost: no >> autocreate_sieve_script: /var/lib/imap/sieve/default.script >> autocreateinboxfolders: Spam|Drafts|Sent|Trash >> autosubscribeinboxfolders: Spam|Drafts|Sent|Trash >> autosubscribesharedfolders: Spam|Ikke-Spam >> defaultdomain: example.com >> virtdomains: userid >> servername: mail.example.com >> unixhierarchysep: 1 >> sasl_mech_list: plain >> sasl_pwcheck_method: saslauthd >> cmtp_overquota_perm_failure: no > >> saslauthd.conf: >> ldap_servers: ldaps://ldap.example.com >> ldap_version: 3 >> ldap_timeout: 10 >> ldap_time_limit: 10 >> ldap_search_base: dc=example,dc=com >> ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com >> ldap_password: password >> ldap_scope: sub >> ldap_uidattr: mail >> ldap_filter_mode: yes >> ldap_filter: (mail=%u@%r) > >> testsaslauth works: >> testsaslauthd -u tarjei -r example.com -p password >> 0: OK "Success." > >> but imtest fails: >> imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost >> ... >> S: A01 NO authentication failure >> Authentication failed. generic failure > >> I then find the following in the log files: >> saslauthd[27506]: do_auth : auth failure: [user=tarjei] >> [service=imap] [realm=] [mech=ldap] [reason=Unknown] > >> And in the ldap log: >> SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" > > >> It seems to me that for some reason, the imap server is not passing on >> the full username - but just the part before the domainname. > >> Does anyone know what I am doing wrong? I seem so close :) > >> Kind regards, >> Tarjei > > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ 8dnhnjUTrfUoeL/nU6OZxp8= =cPzT -----END PGP SIGNATURE----- From aspineux at gmail.com Mon Aug 25 11:06:37 2008 From: aspineux at gmail.com (Alain Spineux) Date: Mon, 25 Aug 2008 17:06:37 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <48B2AAEC.8020309@nu.no> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> <48B2A76F.8030303@nu.no> <48B2AAEC.8020309@nu.no> Message-ID: <71fe4e760808250806v65baa35bo507592e798bd0445@mail.gmail.com> On Mon, Aug 25, 2008 at 2:51 PM, tarjei wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Again, > tarjei wrote: >> lartc wrote: >>> Hi, >> >>> I've got the same setup -- you should have >> >>> ldap_realm: yourdomain.com > > It seems that the parameter that needed to be set was > ldap_default_realm, as I found when reading > http://thread.gmane.org/gmane.mail.imap.cyrus/22049. > You set virtdomains: userid What is happening if you configure a second domain name ? I thing your error was to configure defaultdomain: example.com because then when you login as someone at example.com, cyrus remove the @example.com This is working that way because when you updrade from virtdomains: off to virtdomains: userid you can keep your old user (without @domain.name) without any changes. Just create new mailboxes and users specifying a domain name. Regards > Again, thanks for helping me. > > Kind regards, > Tarjei > > >> >>> in /etc/saslauthd.conf >> >>> and you should start saslauthd daemon with the "-r" argument >> >> >> Hi Charles, thank you for your quick reply. >> >> I tried your suggestions, but they do not seem to solve my problem. The >> same problem persists. >> >> Kind regards, >> tarjei >> >>> hth, >> >>> charles >> >> >> >> >>> On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: >>> Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an >>> virtdomains setup. >> >>> Relevant info: >>> OS: Centos 5.2 >>> Cyrus-Imapd: 2.3.7 >>> Sasl: 2.1.22 >> >>> imapd.conf: >>> altnamespace: yes >>> autocreatequota:-1 >>> createonpost: no >>> autocreate_sieve_script: /var/lib/imap/sieve/default.script >>> autocreateinboxfolders: Spam|Drafts|Sent|Trash >>> autosubscribeinboxfolders: Spam|Drafts|Sent|Trash >>> autosubscribesharedfolders: Spam|Ikke-Spam >>> defaultdomain: example.com >>> virtdomains: userid >>> servername: mail.example.com >>> unixhierarchysep: 1 >>> sasl_mech_list: plain >>> sasl_pwcheck_method: saslauthd >>> cmtp_overquota_perm_failure: no >> >>> saslauthd.conf: >>> ldap_servers: ldaps://ldap.example.com >>> ldap_version: 3 >>> ldap_timeout: 10 >>> ldap_time_limit: 10 >>> ldap_search_base: dc=example,dc=com >>> ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com >>> ldap_password: password >>> ldap_scope: sub >>> ldap_uidattr: mail >>> ldap_filter_mode: yes >>> ldap_filter: (mail=%u@%r) >> >>> testsaslauth works: >>> testsaslauthd -u tarjei -r example.com -p password >>> 0: OK "Success." >> >>> but imtest fails: >>> imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost >>> ... >>> S: A01 NO authentication failure >>> Authentication failed. generic failure >> >>> I then find the following in the log files: >>> saslauthd[27506]: do_auth : auth failure: [user=tarjei] >>> [service=imap] [realm=] [mech=ldap] [reason=Unknown] >> >>> And in the ldap log: >>> SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" >> >> >>> It seems to me that for some reason, the imap server is not passing on >>> the full username - but just the part before the domainname. >> >>> Does anyone know what I am doing wrong? I seem so close :) >> >>> Kind regards, >>> Tarjei >> >> ---- >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >> > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ > 8dnhnjUTrfUoeL/nU6OZxp8= > =cPzT > -----END PGP SIGNATURE----- > ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > -- Alain Spineux aspineux gmail com May the sources be with you From lartc at manchotnetworks.net Mon Aug 25 11:17:32 2008 From: lartc at manchotnetworks.net (lartc) Date: Mon, 25 Aug 2008 17:17:32 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <48B2AAEC.8020309@nu.no> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> <48B2A76F.8030303@nu.no> <48B2AAEC.8020309@nu.no> Message-ID: <1219677452.3771.13.camel@sumatra.ccuse.com> Woops. Yep. More coffee needed. Cheers Charles On Mon, 2008-08-25 at 14:51 +0200, tarjei wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Again, > tarjei wrote: > > lartc wrote: > >> Hi, > > > >> I've got the same setup -- you should have > > > >> ldap_realm: yourdomain.com > > It seems that the parameter that needed to be set was > ldap_default_realm, as I found when reading > http://thread.gmane.org/gmane.mail.imap.cyrus/22049. > > Again, thanks for helping me. > > Kind regards, > Tarjei > > > > > >> in /etc/saslauthd.conf > > > >> and you should start saslauthd daemon with the "-r" argument > > > > > > Hi Charles, thank you for your quick reply. > > > > I tried your suggestions, but they do not seem to solve my problem. The > > same problem persists. > > > > Kind regards, > > tarjei > > > >> hth, > > > >> charles > > > > > > > > > >> On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: > >> Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an > >> virtdomains setup. > > > >> Relevant info: > >> OS: Centos 5.2 > >> Cyrus-Imapd: 2.3.7 > >> Sasl: 2.1.22 > > > >> imapd.conf: > >> altnamespace: yes > >> autocreatequota:-1 > >> createonpost: no > >> autocreate_sieve_script: /var/lib/imap/sieve/default.script > >> autocreateinboxfolders: Spam|Drafts|Sent|Trash > >> autosubscribeinboxfolders: Spam|Drafts|Sent|Trash > >> autosubscribesharedfolders: Spam|Ikke-Spam > >> defaultdomain: example.com > >> virtdomains: userid > >> servername: mail.example.com > >> unixhierarchysep: 1 > >> sasl_mech_list: plain > >> sasl_pwcheck_method: saslauthd > >> cmtp_overquota_perm_failure: no > > > >> saslauthd.conf: > >> ldap_servers: ldaps://ldap.example.com > >> ldap_version: 3 > >> ldap_timeout: 10 > >> ldap_time_limit: 10 > >> ldap_search_base: dc=example,dc=com > >> ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com > >> ldap_password: password > >> ldap_scope: sub > >> ldap_uidattr: mail > >> ldap_filter_mode: yes > >> ldap_filter: (mail=%u@%r) > > > >> testsaslauth works: > >> testsaslauthd -u tarjei -r example.com -p password > >> 0: OK "Success." > > > >> but imtest fails: > >> imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost > >> ... > >> S: A01 NO authentication failure > >> Authentication failed. generic failure > > > >> I then find the following in the log files: > >> saslauthd[27506]: do_auth : auth failure: [user=tarjei] > >> [service=imap] [realm=] [mech=ldap] [reason=Unknown] > > > >> And in the ldap log: > >> SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" > > > > > >> It seems to me that for some reason, the imap server is not passing on > >> the full username - but just the part before the domainname. > > > >> Does anyone know what I am doing wrong? I seem so close :) > > > >> Kind regards, > >> Tarjei > > > > ---- > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFIsqrrYVRKCnSvzfIRAjBHAKCBQYe6u8ZZOd7ssM68vSQ6en8oAwCgrUl+ > 8dnhnjUTrfUoeL/nU6OZxp8= > =cPzT > -----END PGP SIGNATURE----- -- "simplified chinese" is not nearly as easy as they would have you believe ... a superlative oxymoron" --anonymous From list at joreybump.com Mon Aug 25 19:50:02 2008 From: list at joreybump.com (Jorey Bump) Date: Mon, 25 Aug 2008 19:50:02 -0400 Subject: Pruning Duplicates Message-ID: <48B3452A.60900@joreybump.com> I've discovered that a user's folder suddenly contains a couple of thousand duplicate messages. Each pair of messages shares the same inode (ext3) but has a different filename (for example, 15715. and 21534.). I haven't determined the cause yet, but I believe it may be due to an aborted attempt to reorganize this large collection of emails (almost 20,000 messages). The account is shared among a handful of users who access it concurrently, using the same login and password, which may have contributed to the issue. Is the shared inode a result of Cyrus IMAPd's duplicate suppression? I've been asked to remove the duplicates. Can anyone recommend a safe and simple method for doing so? From wes at umich.edu Mon Aug 25 22:45:36 2008 From: wes at umich.edu (Wesley Craig) Date: Mon, 25 Aug 2008 22:45:36 -0400 Subject: Pruning Duplicates In-Reply-To: <48B3452A.60900@joreybump.com> References: <48B3452A.60900@joreybump.com> Message-ID: <2B3493D6-A027-4121-AC29-73A38B9BA0BD@umich.edu> I've seen this before with Thunderbird. As I recall, Thunderbird requests a lengthy operation but times out (or fills a buffer?) before getting a result back. It then tries the operation again, until the mailbox is woefully full. To clean up, we typically calculate checksums on the files and find duplicates that way. :wes On 25 Aug 2008, at 19:50, Jorey Bump wrote: > I've discovered that a user's folder suddenly contains a couple of > thousand duplicate messages. Each pair of messages shares the same > inode > (ext3) but has a different filename (for example, 15715. and > 21534.). I > haven't determined the cause yet, but I believe it may be due to an > aborted attempt to reorganize this large collection of emails (almost > 20,000 messages). The account is shared among a handful of users who > access it concurrently, using the same login and password, which may > have contributed to the issue. > > Is the shared inode a result of Cyrus IMAPd's duplicate suppression? > I've been asked to remove the duplicates. Can anyone recommend a safe > and simple method for doing so? From gmane-2006-04-16 at jt-socal.com Mon Aug 25 23:01:30 2008 From: gmane-2006-04-16 at jt-socal.com (John Thomas) Date: Mon, 25 Aug 2008 20:01:30 -0700 Subject: Pruning Duplicates In-Reply-To: <48B3452A.60900@joreybump.com> References: <48B3452A.60900@joreybump.com> Message-ID: <48B3720A.6020008@jt-socal.com> Jorey Bump wrote: > I've been asked to remove the duplicates. Can anyone recommend a safe > and simple method for doing so? I have had success with this Thunderbird extension https://addons.mozilla.org/en-US/thunderbird/addon/956 YMMV, have backups. -- Sincerely, John Thomas From list at joreybump.com Mon Aug 25 23:34:02 2008 From: list at joreybump.com (Jorey Bump) Date: Mon, 25 Aug 2008 23:34:02 -0400 Subject: Pruning Duplicates In-Reply-To: <2B3493D6-A027-4121-AC29-73A38B9BA0BD@umich.edu> References: <48B3452A.60900@joreybump.com> <2B3493D6-A027-4121-AC29-73A38B9BA0BD@umich.edu> Message-ID: <48B379AA.7030700@joreybump.com> Wesley Craig wrote, at 08/25/2008 10:45 PM: > I've seen this before with Thunderbird. As I recall, Thunderbird > requests a lengthy operation but times out (or fills a buffer?) before > getting a result back. It then tries the operation again, until the > mailbox is woefully full. Interesting. Aside from webmail, Thunderbird is indeed the only other client used to access this account. > To clean up, we typically calculate checksums on the files and find > duplicates that way. In this case, I can easily find the inodes that reference more than one file: ls -li /var/spool/imap/user/bob/folder | cut -b 1-8 | sort | uniq -d I was hoping to somehow leverage this information to delete the duplicates only, but haven't quite figured it out myself. From list at joreybump.com Tue Aug 26 00:07:06 2008 From: list at joreybump.com (Jorey Bump) Date: Tue, 26 Aug 2008 00:07:06 -0400 Subject: Pruning Duplicates In-Reply-To: <48B3720A.6020008@jt-socal.com> References: <48B3452A.60900@joreybump.com> <48B3720A.6020008@jt-socal.com> Message-ID: <48B3816A.5030202@joreybump.com> John Thomas wrote, at 08/25/2008 11:01 PM: > Jorey Bump wrote: >> I've been asked to remove the duplicates. Can anyone recommend a safe >> and simple method for doing so? > > I have had success with this Thunderbird extension > https://addons.mozilla.org/en-US/thunderbird/addon/956 > YMMV, have backups. Thanks, that did the trick, although I used a fork that's being actively developed: http://removedupes.mozdev.org/ It's actually a pretty handy extension, as I discovered while testing on some of my own accounts. From tarjei at nu.no Tue Aug 26 09:11:41 2008 From: tarjei at nu.no (tarjei) Date: Tue, 26 Aug 2008 15:11:41 +0200 Subject: Is unixhierarchysep:1 required when using virtdomain? Message-ID: <48B4010D.2030804@nu.no> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I read somewhere that setting unixhierarchysep to true is required when using virtdomain, but this is not mentioned on the man page. Is there something missing on the manpage, or have I just missunderstood something? Also, what problems will I face if I set it to false? One thing is client issues, but what about acls, etc? Kind regards, Tarjei -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFItAENYVRKCnSvzfIRAmqjAJ46YKEbUj/4fIXEKlBOdquUjXVubgCdEwR2 2SlZv1n1LACzLc8GWied0Us= =Ku45 -----END PGP SIGNATURE----- From tarjei at nu.no Tue Aug 26 09:13:44 2008 From: tarjei at nu.no (tarjei) Date: Tue, 26 Aug 2008 15:13:44 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <71fe4e760808250806v65baa35bo507592e798bd0445@mail.gmail.com> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> <48B2A76F.8030303@nu.no> <48B2AAEC.8020309@nu.no> <71fe4e760808250806v65baa35bo507592e798bd0445@mail.gmail.com> Message-ID: <48B40188.1030301@nu.no> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, Alain Spineux wrote: > On Mon, Aug 25, 2008 at 2:51 PM, tarjei wrote: > Hi Again, > tarjei wrote: >>>> lartc wrote: >>>>> Hi, >>>>> I've got the same setup -- you should have >>>>> ldap_realm: yourdomain.com > It seems that the parameter that needed to be set was > ldap_default_realm, as I found when reading > http://thread.gmane.org/gmane.mail.imap.cyrus/22049. > > >> You set >> virtdomains: userid > >> What is happening if you configure a second domain name ? > >> I thing your error was to configure > >> defaultdomain: example.com Ok, so I should not set defaultdomain when creating a setup from scratch then? kind regards, Tarjei > >> because then when you login as someone at example.com, cyrus remove the >> @example.com > >> This is working that way because when you updrade from > >> virtdomains: off >> to >> virtdomains: userid > >> you can keep your old user (without @domain.name) without any changes. >> Just create new mailboxes and users specifying a domain name. > >> Regards > > > Again, thanks for helping me. > > Kind regards, > Tarjei > > >>>>> in /etc/saslauthd.conf >>>>> and you should start saslauthd daemon with the "-r" argument >>>> >>>> Hi Charles, thank you for your quick reply. >>>> >>>> I tried your suggestions, but they do not seem to solve my problem. The >>>> same problem persists. >>>> >>>> Kind regards, >>>> tarjei >>>> >>>>> hth, >>>>> charles >>>> >>>> >>>> >>>>> On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: >>>>> Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an >>>>> virtdomains setup. >>>>> Relevant info: >>>>> OS: Centos 5.2 >>>>> Cyrus-Imapd: 2.3.7 >>>>> Sasl: 2.1.22 >>>>> imapd.conf: >>>>> altnamespace: yes >>>>> autocreatequota:-1 >>>>> createonpost: no >>>>> autocreate_sieve_script: /var/lib/imap/sieve/default.script >>>>> autocreateinboxfolders: Spam|Drafts|Sent|Trash >>>>> autosubscribeinboxfolders: Spam|Drafts|Sent|Trash >>>>> autosubscribesharedfolders: Spam|Ikke-Spam >>>>> defaultdomain: example.com >>>>> virtdomains: userid >>>>> servername: mail.example.com >>>>> unixhierarchysep: 1 >>>>> sasl_mech_list: plain >>>>> sasl_pwcheck_method: saslauthd >>>>> cmtp_overquota_perm_failure: no >>>>> saslauthd.conf: >>>>> ldap_servers: ldaps://ldap.example.com >>>>> ldap_version: 3 >>>>> ldap_timeout: 10 >>>>> ldap_time_limit: 10 >>>>> ldap_search_base: dc=example,dc=com >>>>> ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com >>>>> ldap_password: password >>>>> ldap_scope: sub >>>>> ldap_uidattr: mail >>>>> ldap_filter_mode: yes >>>>> ldap_filter: (mail=%u@%r) >>>>> testsaslauth works: >>>>> testsaslauthd -u tarjei -r example.com -p password >>>>> 0: OK "Success." >>>>> but imtest fails: >>>>> imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost >>>>> ... >>>>> S: A01 NO authentication failure >>>>> Authentication failed. generic failure >>>>> I then find the following in the log files: >>>>> saslauthd[27506]: do_auth : auth failure: [user=tarjei] >>>>> [service=imap] [realm=] [mech=ldap] [reason=Unknown] >>>>> And in the ldap log: >>>>> SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" >>>> >>>>> It seems to me that for some reason, the imap server is not passing on >>>>> the full username - but just the part before the domainname. >>>>> Does anyone know what I am doing wrong? I seem so close :) >>>>> Kind regards, >>>>> Tarjei >>>> ---- >>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>>> - ---- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >> -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFItAGIYVRKCnSvzfIRAtnsAJ9/LiX+5j7yp/SYgkNyAiUPzOO+vwCgpAlx cUqCz8jSR67aW2J70DhdQ4o= =Zztf -----END PGP SIGNATURE----- From aspineux at gmail.com Wed Aug 27 07:36:06 2008 From: aspineux at gmail.com (Alain Spineux) Date: Wed, 27 Aug 2008 13:36:06 +0200 Subject: Cyrus-imapd not providing realm information In-Reply-To: <48B40188.1030301@nu.no> References: <48B29FE9.2020604@nu.no> <1219666386.3771.9.camel@sumatra.ccuse.com> <48B2A76F.8030303@nu.no> <48B2AAEC.8020309@nu.no> <71fe4e760808250806v65baa35bo507592e798bd0445@mail.gmail.com> <48B40188.1030301@nu.no> Message-ID: <71fe4e760808270436m14a1e1cu3088bd150935bd03@mail.gmail.com> On Tue, Aug 26, 2008 at 3:13 PM, tarjei wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi, > > Alain Spineux wrote: >> On Mon, Aug 25, 2008 at 2:51 PM, tarjei wrote: >> Hi Again, >> tarjei wrote: >>>>> lartc wrote: >>>>>> Hi, >>>>>> I've got the same setup -- you should have >>>>>> ldap_realm: yourdomain.com >> It seems that the parameter that needed to be set was >> ldap_default_realm, as I found when reading >> http://thread.gmane.org/gmane.mail.imap.cyrus/22049. >> >> >>> You set >>> virtdomains: userid >> >>> What is happening if you configure a second domain name ? >> >>> I thing your error was to configure >> >>> defaultdomain: example.com > Ok, so I should not set defaultdomain when creating a setup from scratch > then? Nicely said ! This is my understanding of defaultdomain option. > > kind regards, > Tarjei >> >>> because then when you login as someone at example.com, cyrus remove the >>> @example.com >> >>> This is working that way because when you updrade from >> >>> virtdomains: off >>> to >>> virtdomains: userid >> >>> you can keep your old user (without @domain.name) without any changes. >>> Just create new mailboxes and users specifying a domain name. >> >>> Regards >> >> >> Again, thanks for helping me. >> >> Kind regards, >> Tarjei >> >> >>>>>> in /etc/saslauthd.conf >>>>>> and you should start saslauthd daemon with the "-r" argument >>>>> >>>>> Hi Charles, thank you for your quick reply. >>>>> >>>>> I tried your suggestions, but they do not seem to solve my problem. The >>>>> same problem persists. >>>>> >>>>> Kind regards, >>>>> tarjei >>>>> >>>>>> hth, >>>>>> charles >>>>> >>>>> >>>>> >>>>>> On Mon, 2008-08-25 at 14:04 +0200, tarjei wrote: >>>>>> Hi, I'm trying to get Cyrus IMAPD + saslauthd working with an >>>>>> virtdomains setup. >>>>>> Relevant info: >>>>>> OS: Centos 5.2 >>>>>> Cyrus-Imapd: 2.3.7 >>>>>> Sasl: 2.1.22 >>>>>> imapd.conf: >>>>>> altnamespace: yes >>>>>> autocreatequota:-1 >>>>>> createonpost: no >>>>>> autocreate_sieve_script: /var/lib/imap/sieve/default.script >>>>>> autocreateinboxfolders: Spam|Drafts|Sent|Trash >>>>>> autosubscribeinboxfolders: Spam|Drafts|Sent|Trash >>>>>> autosubscribesharedfolders: Spam|Ikke-Spam >>>>>> defaultdomain: example.com >>>>>> virtdomains: userid >>>>>> servername: mail.example.com >>>>>> unixhierarchysep: 1 >>>>>> sasl_mech_list: plain >>>>>> sasl_pwcheck_method: saslauthd >>>>>> cmtp_overquota_perm_failure: no >>>>>> saslauthd.conf: >>>>>> ldap_servers: ldaps://ldap.example.com >>>>>> ldap_version: 3 >>>>>> ldap_timeout: 10 >>>>>> ldap_time_limit: 10 >>>>>> ldap_search_base: dc=example,dc=com >>>>>> ldap_bind_dn: uid=saslauthd,ou=Services,dc=example,dc=com >>>>>> ldap_password: password >>>>>> ldap_scope: sub >>>>>> ldap_uidattr: mail >>>>>> ldap_filter_mode: yes >>>>>> ldap_filter: (mail=%u@%r) >>>>>> testsaslauth works: >>>>>> testsaslauthd -u tarjei -r example.com -p password >>>>>> 0: OK "Success." >>>>>> but imtest fails: >>>>>> imtest -u tarjei at example.com -a tarjei at example.com -t "" localhost >>>>>> ... >>>>>> S: A01 NO authentication failure >>>>>> Authentication failed. generic failure >>>>>> I then find the following in the log files: >>>>>> saslauthd[27506]: do_auth : auth failure: [user=tarjei] >>>>>> [service=imap] [realm=] [mech=ldap] [reason=Unknown] >>>>>> And in the ldap log: >>>>>> SRCH base="dc=example,dc=com" scope=2 deref=0 filter="(mail=tarjei@)" >>>>> >>>>>> It seems to me that for some reason, the imap server is not passing on >>>>>> the full username - but just the part before the domainname. >>>>>> Does anyone know what I am doing wrong? I seem so close :) >>>>>> Kind regards, >>>>>> Tarjei >>>>> ---- >>>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >>>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >>>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>>>> > - ---- > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html >>> > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org > > iD8DBQFItAGIYVRKCnSvzfIRAtnsAJ9/LiX+5j7yp/SYgkNyAiUPzOO+vwCgpAlx > cUqCz8jSR67aW2J70DhdQ4o= > =Zztf > -----END PGP SIGNATURE----- > -- Alain Spineux aspineux gmail com May the sources be with you From brong at fastmail.fm Wed Aug 27 07:46:24 2008 From: brong at fastmail.fm (Bron Gondwana) Date: Wed, 27 Aug 2008 21:46:24 +1000 Subject: Is unixhierarchysep:1 required when using virtdomain? In-Reply-To: <48B4010D.2030804@nu.no> References: <48B4010D.2030804@nu.no> Message-ID: <20080827114624.GA22038@brong.net> On Tue, Aug 26, 2008 at 03:11:41PM +0200, tarjei wrote: > I read somewhere that setting unixhierarchysep to true is required when > using virtdomain, but this is not mentioned on the man page. Wow, you could have fooled me. > Is there something missing on the manpage, or have I just missunderstood > something? We have a few hundred thousand users who are domain split, and we ddon't use unixhierarchysep. > Also, what problems will I face if I set it to false? One thing is > client issues, but what about acls, etc? Changing it on the fly sounds messy. Bron. From Rudy.Gevaert at UGent.be Wed Aug 27 08:36:58 2008 From: Rudy.Gevaert at UGent.be (Rudy Gevaert) Date: Wed, 27 Aug 2008 14:36:58 +0200 Subject: Is unixhierarchysep:1 required when using virtdomain? In-Reply-To: <20080827114624.GA22038@brong.net> References: <48B4010D.2030804@nu.no> <20080827114624.GA22038@brong.net> Message-ID: <48B54A6A.1050905@UGent.be> Bron Gondwana wrote: > On Tue, Aug 26, 2008 at 03:11:41PM +0200, tarjei wrote: >> I read somewhere that setting unixhierarchysep to true is required when >> using virtdomain, but this is not mentioned on the man page. > > Wow, you could have fooled me. > >> Is there something missing on the manpage, or have I just missunderstood >> something? > > We have a few hundred thousand users who are domain split, and > we ddon't use unixhierarchysep. But then you don't have '.' in their user names, right? Rudy -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert Rudy.Gevaert at UGent.be tel:+32 9 264 4734 Directie ICT, afd. Infrastructuur ICT Department, Infrastructure office Groep Systemen Systems group Universiteit Gent Ghent University Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- From brong at fastmail.fm Wed Aug 27 09:19:48 2008 From: brong at fastmail.fm (Bron Gondwana) Date: Wed, 27 Aug 2008 23:19:48 +1000 Subject: Is unixhierarchysep:1 required when using virtdomain? In-Reply-To: <48B54A6A.1050905@UGent.be> References: <48B4010D.2030804@nu.no> <20080827114624.GA22038@brong.net> <48B54A6A.1050905@UGent.be> Message-ID: <1219843188.23101.1270773715@webmail.messagingengine.com> On Wed, 27 Aug 2008 14:36:58 +0200, "Rudy Gevaert" said: > Bron Gondwana wrote: > > On Tue, Aug 26, 2008 at 03:11:41PM +0200, tarjei wrote: > >> I read somewhere that setting unixhierarchysep to true is required when > >> using virtdomain, but this is not mentioned on the man page. > > > > Wow, you could have fooled me. > > > >> Is there something missing on the manpage, or have I just missunderstood > >> something? > > > > We have a few hundred thousand users who are domain split, and > > we ddon't use unixhierarchysep. > > But then you don't have '.' in their user names, right? Nope. Never wanted a dot in a username. Usernames belong in [a-z][a-z0-9_]+ space. And strictly, trailing _ is pretty bogus too. :) Bron. -- Bron Gondwana brong at fastmail.fm From toomas.aas at raad.tartu.ee Wed Aug 27 14:21:37 2008 From: toomas.aas at raad.tartu.ee (Toomas Aas) Date: Wed, 27 Aug 2008 21:21:37 +0300 Subject: root file system full: master.core? In-Reply-To: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> References: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> Message-ID: <48B59B31.2090708@raad.tartu.ee> Martin Schweizer wrote: > I use FreeBSD 7.0 an a single server with cyrus v2.3.12p2. So fare all > works well. After the update from FreeBSD 6.3 to 7.0 I got always when > I start cyrus a file which is called master.core in /etc/rc.d which > has around 65MB. As others already pointed out, this is caused by a process called 'master' crashing and dumping core. Quite possibly a cyrus master process. If I understand you correctly, you upgraded from FreeBSD 6.3 to 7.0 on the same machine. Have you added or rebuilt any ports since the upgrade? If so, you may now have conflicting shared libraries. -- Toomas From schweizer.martin at gmail.com Thu Aug 28 05:39:01 2008 From: schweizer.martin at gmail.com (Martin Schweizer) Date: Thu, 28 Aug 2008 11:39:01 +0200 Subject: root file system full: master.core? In-Reply-To: <48B59B31.2090708@raad.tartu.ee> References: <380ccfd60808250030o74d8e0d2i12a3eb8f52fa95bb@mail.gmail.com> <48B59B31.2090708@raad.tartu.ee> Message-ID: <380ccfd60808280239n1b368b68j9e60bdf39f0ad7fa@mail.gmail.com> Hello Toomas 2008/8/27 Toomas Aas : > If I understand you correctly, you upgraded from FreeBSD 6.3 to 7.0 on the > same machine. Have you added or rebuilt any ports since the upgrade? If so, > you may now have conflicting shared libraries. That's a good hint. Of course after the upgrade I started portupgrade -faP (as described). It seem's that this crash occurs while portupgrade runs. So this could be the problem. Regards, -- Martin Schweizer schweizer.martin at gmail.com Tel.: +41 32 512 48 54 (VoIP) Fax: +1 619 3300587 From thiagoh at digirati.com.br Thu Aug 28 14:34:22 2008 From: thiagoh at digirati.com.br (Thiago Henrique) Date: Thu, 28 Aug 2008 15:34:22 -0300 Subject: Comparison of float number in Sieve Message-ID: <1219948462.19477.7.camel@henrique> Hi, About Sieve: Is there comparison of float/negative numbers in Sieve? I know the "i; ascii-numeric", but it compares only positive integers. ?Thank you all in advance. Best Regards -- []'s Thiago Henrique Network Administration Digirati Networks K8 Networks From iwan at reahl.org Fri Aug 29 03:27:44 2008 From: iwan at reahl.org (Iwan Vosloo) Date: Fri, 29 Aug 2008 09:27:44 +0200 Subject: Source of DBERRORs? Message-ID: <1219994864.7241.18.camel@easymoney> Hi there, I have an installation of cyrus 2.2, running an ubuntu server. It used db4.6. Everything works fine, except that I get DBERRORs (log included below) in the log. The errors do not seem to affect mail delivery. I've done a db_checkpoint and db_restore on the db, which seems to have no effect. The part that concerns me is the DBERROR, and the aborted transaction. Any pointers as to how I can hunt this thing down? Regards - Iwan Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: accepted connection Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: lmtp connection preauth'd as postman Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: WARNING: sieve script /var/spool/sieve/i/johndoe/defaultbc doesn't exist: No such file or directory Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: duplicate_check: <20080829070227.0A3293BC55 at hostname.c.com> user.johndoe 0 Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: duplicate_check: <20080829070227.0A3293BC55 at hostname.c.com> user.johndoe 0 Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: mystore: starting txn 2147483653 Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: mystore: aborting txn 2147483653 Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: DBERROR: mystore: error storing <20080829070227.0A3293BC55 at hostname.c.com>: DB_PAGE_NOTFOUND: Requested page not found Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: duplicate_mark: <20080829070227.0A3293BC55 at hostname.c.com> user.johndoe 1219993349 42329 Aug 29 09:02:29 hostname cyrus/lmtpunix[30100]: Delivered: <20080829070227.0A3293BC55 at hostname.c.com> to mailbox: user.johndoe From mikeegg1 at mac.com Fri Aug 29 09:55:40 2008 From: mikeegg1 at mac.com (Mike Eggleston) Date: Fri, 29 Aug 2008 08:55:40 -0500 Subject: MUA not noticing new mail Message-ID: <20080829135540.GB16215@mail.mac.com> Morning, I have a user that has complained of her MAU not notifying her about receiving new mail many times. In the beginning she was on a Windows XP using first Outlook 2000, then Outlook 2007. Now she's on a Mac OS X (Leopard, 10.5.4) using Mac Mail (Mail.app). I look at the cyrus server, mail store, and see messages with the right file system time stamp and the right Received times in the message itself. My current need is to fix her Mac OS X Mail issue so she gets notified when mail arrives. Where can I start looking for a setting to change? I did find this article about Mac OS X Mail ignoring new mail and may be not working right with IDLE. Should I turn off IDLE? Mike Fedora Core 5, latest patches $ rpm -qa | grep cyrus cyrus-imapd-devel-2.3.1-2.8.fc5 cyrus-sasl-lib-2.1.21-10 cyrus-sasl-2.1.21-10 cyrus-imapd-utils-2.3.1-2.8.fc5 cyrus-sasl-ldap-2.1.21-10 cyrus-imapd-2.3.1-2.8.fc5 cyrus-sasl-devel-2.1.21-10 ---------------- /etc/cyrus.conf # standard standalone server implementation START { # do not delete this entry! recover cmd="ctl_cyrusdb -r" # this is only necessary if using idled for IMAP IDLE idled cmd="idled" } # UNIX sockets start with a slash and are put into /var/lib/imap/sockets SERVICES { # add or remove based on preferences imap cmd="imapd" listen="imap" prefork=10 imaps cmd="imapd -s" listen="imaps" prefork=5 pop3 cmd="pop3d" listen="pop3" prefork=2 pop3s cmd="pop3d -s" listen="pop3s" prefork=2 sieve cmd="timsieved" listen="sieve" prefork=10 # these are only necessary if receiving/exporting usenet via NNTP # nntp cmd="nntpd" listen="nntp" prefork=3 # nntps cmd="nntpd -s" listen="nntps" prefork=1 # at least one LMTP is required for delivery # lmtp cmd="lmtpd" listen="localhost:lmtp" prefork=1 lmtpunix cmd="lmtpd" listen="/var/lib/imap/socket/lmtp" prefork=10 # this is only necessary if using notifications # notify cmd="notifyd" listen="/var/lib/imap/socket/notify" proto="udp" prefork=1 } EVENTS { # this is required checkpoint cmd="ctl_cyrusdb -c" period=30 # this is only necessary if using duplicate delivery suppression, # Sieve or NNTP delprune cmd="cyr_expire -E 3 -X 1" at=0200 # this is only necessary if caching TLS sessions tlsprune cmd="tls_prune" at=0400 # mikee 080109 - make sure messages are trimmed msgprune1 cmd="ipurge -f -d 2 -X user.%.backup" at=2200 msgprune2 cmd="ipurge -f -d 5 -X user.%.spam" at=2230 msgprune3 cmd="ipurge -f -d 4 -X user.%.Trash" at=2300 } ---------------- /etc/cyrus.conf ---------------- /etc/imapd.conf admins: cyrus allowanonymouslogin: no allowplaintext: yes autocreatequota: -1 autocreateinboxfolders: Sent | Drafts | | spam | backup configdirectory: /var/lib/imap drachost: localhost dracinterval: 0 hashimapspool: true partition-default: /var/spool/imap poptimeout: 10 postmaster: postmaster quotawarn: 90 reject8bit: no sasl_mech_list: PLAIN sasl_pwcheck_method: saslauthd sendmail: /usr/lib/sendmail servername: servername sieveusehomedir: 0 sievedir: /var/lib/imap/sieve sieve_maxscripts: 5 sieve_maxscriptsize: 96 timeout: 1440 tls_ca_file: /etc/pki/tls/certs/ca-bundle.crt tls_cert_file: /etc/pki/cyrus-imapd/cyrus-imapd-071024.pem tls_key_file: /etc/pki/cyrus-imapd/cyrus-imapd-071024.pem #unixhierarchysep: yes ---------------- /etc/imapd.conf From ktm at rice.edu Fri Aug 29 10:13:18 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Fri, 29 Aug 2008 09:13:18 -0500 Subject: MUA not noticing new mail In-Reply-To: <20080829135540.GB16215@mail.mac.com> References: <20080829135540.GB16215@mail.mac.com> Message-ID: <20080829141318.GJ27711@it.is.rice.edu> On Fri, Aug 29, 2008 at 08:55:40AM -0500, Mike Eggleston wrote: > Morning, > > I have a user that has complained of her MAU not notifying her about > receiving new mail many times. In the beginning she was on a Windows > XP using first Outlook 2000, then Outlook 2007. Now she's on a Mac OS X > (Leopard, 10.5.4) using Mac Mail (Mail.app). > > I look at the cyrus server, mail store, and see messages with the right > file system time stamp and the right Received times in the message itself. > > My current need is to fix her Mac OS X Mail issue so she gets notified > when mail arrives. > > Where can I start looking for a setting to change? > > I did find this article about Mac > OS X Mail ignoring new mail and may be not working right with IDLE. Should > I turn off IDLE? > > Mike > Mike, We tried many IDLE options here, but so many clients had poor IDLE support that we ended up turning it off. The number of help desk calls such as the one above dropped essentially to zero after the change. Cheers, Ken From mikeegg1 at mac.com Fri Aug 29 10:23:56 2008 From: mikeegg1 at mac.com (Mike Eggleston) Date: Fri, 29 Aug 2008 09:23:56 -0500 Subject: MUA not noticing new mail In-Reply-To: <20080829141318.GJ27711@it.is.rice.edu> References: <20080829135540.GB16215@mail.mac.com> <20080829141318.GJ27711@it.is.rice.edu> Message-ID: <20080829142356.GC16215@mail.mac.com> On Fri, 29 Aug 2008, Kenneth Marshall might have said: > On Fri, Aug 29, 2008 at 08:55:40AM -0500, Mike Eggleston wrote: > > Morning, > > > > I have a user that has complained of her MAU not notifying her about > > receiving new mail many times. In the beginning she was on a Windows > > XP using first Outlook 2000, then Outlook 2007. Now she's on a Mac OS X > > (Leopard, 10.5.4) using Mac Mail (Mail.app). > > > > I look at the cyrus server, mail store, and see messages with the right > > file system time stamp and the right Received times in the message itself. > > > > My current need is to fix her Mac OS X Mail issue so she gets notified > > when mail arrives. > > > > Where can I start looking for a setting to change? > > > > I did find this article about Mac > > OS X Mail ignoring new mail and may be not working right with IDLE. Should > > I turn off IDLE? > > > > Mike > > > Mike, > > We tried many IDLE options here, but so many clients had poor IDLE > support that we ended up turning it off. The number of help desk > calls such as the one above dropped essentially to zero after the > change. > > Cheers, > Ken > I just turn off idle by commenting out the process in /etc/cyrus.conf, right? Mike From ktm at rice.edu Fri Aug 29 10:44:13 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Fri, 29 Aug 2008 09:44:13 -0500 Subject: MUA not noticing new mail In-Reply-To: <20080829142356.GC16215@mail.mac.com> References: <20080829135540.GB16215@mail.mac.com> <20080829141318.GJ27711@it.is.rice.edu> <20080829142356.GC16215@mail.mac.com> Message-ID: <20080829144413.GL27711@it.is.rice.edu> On Fri, Aug 29, 2008 at 09:23:56AM -0500, Mike Eggleston wrote: > On Fri, 29 Aug 2008, Kenneth Marshall might have said: > > > On Fri, Aug 29, 2008 at 08:55:40AM -0500, Mike Eggleston wrote: > > > Morning, > > > > > > I have a user that has complained of her MAU not notifying her about > > > receiving new mail many times. In the beginning she was on a Windows > > > XP using first Outlook 2000, then Outlook 2007. Now she's on a Mac OS X > > > (Leopard, 10.5.4) using Mac Mail (Mail.app). > > > > > > I look at the cyrus server, mail store, and see messages with the right > > > file system time stamp and the right Received times in the message itself. > > > > > > My current need is to fix her Mac OS X Mail issue so she gets notified > > > when mail arrives. > > > > > > Where can I start looking for a setting to change? > > > > > > I did find this article about Mac > > > OS X Mail ignoring new mail and may be not working right with IDLE. Should > > > I turn off IDLE? > > > > > > Mike > > > > > Mike, > > > > We tried many IDLE options here, but so many clients had poor IDLE > > support that we ended up turning it off. The number of help desk > > calls such as the one above dropped essentially to zero after the > > change. > > > > Cheers, > > Ken > > > > I just turn off idle by commenting out the process in /etc/cyrus.conf, right? > > Mike > You also need to set "imapidlepoll: 0" in imapd.conf. Ken From wes at umich.edu Fri Aug 29 13:34:24 2008 From: wes at umich.edu (Wesley Craig) Date: Fri, 29 Aug 2008 13:34:24 -0400 Subject: MUA not noticing new mail In-Reply-To: <20080829141318.GJ27711@it.is.rice.edu> References: <20080829135540.GB16215@mail.mac.com> <20080829141318.GJ27711@it.is.rice.edu> Message-ID: <5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu> On 29 Aug 2008, at 10:13, Kenneth Marshall wrote: > We tried many IDLE options here, but so many clients had poor IDLE > support that we ended up turning it off. The number of help desk > calls such as the one above dropped essentially to zero after the > change. I wonder if you have some practical experience to share, e.g., which clients & versions have poor IDLE support? :wes From ktm at rice.edu Fri Aug 29 13:48:48 2008 From: ktm at rice.edu (Kenneth Marshall) Date: Fri, 29 Aug 2008 12:48:48 -0500 Subject: MUA not noticing new mail In-Reply-To: <5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu> References: <20080829135540.GB16215@mail.mac.com> <20080829141318.GJ27711@it.is.rice.edu> <5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu> Message-ID: <20080829174848.GP27711@it.is.rice.edu> On Fri, Aug 29, 2008 at 01:34:24PM -0400, Wesley Craig wrote: > On 29 Aug 2008, at 10:13, Kenneth Marshall wrote: >> We tried many IDLE options here, but so many clients had poor IDLE >> support that we ended up turning it off. The number of help desk >> calls such as the one above dropped essentially to zero after the >> change. > > I wonder if you have some practical experience to share, e.g., which > clients & versions have poor IDLE support? > > :wes > Outlook/Outlook Express drove the change for us. They would open multiple IMAP connections (sent folder, deleted folder, INBOX, ...) but the only folder for which they would issue the IDLE command for properly was the INBOX. From the behavior of other clients, many had the same issue. Apparently Outlook counted on the IDLE for the INBOX counting for all additional IMAP connections to the same server. Ken