From iane at sussex.ac.uk  Mon Sep  1 06:34:51 2008
From: iane at sussex.ac.uk (Ian Eiloart)
Date: Mon, 01 Sep 2008 11:34:51 +0100
Subject: MUA not noticing new mail
In-Reply-To: <20080829174848.GP27711@it.is.rice.edu>
References: <20080829135540.GB16215@mail.mac.com>
	<20080829141318.GJ27711@it.is.rice.edu>
	<5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu>
	<20080829174848.GP27711@it.is.rice.edu>
Message-ID: <2ED8F1ADEA7B9F99E6AA3ECC@glynde.staff.uscs.susx.ac.uk>



--On 29 August 2008 12:48:48 -0500 Kenneth Marshall <ktm at rice.edu> wrote:

> On Fri, Aug 29, 2008 at 01:34:24PM -0400, Wesley Craig wrote:
>> On 29 Aug 2008, at 10:13, Kenneth Marshall wrote:
>>> We tried many IDLE options here, but so many clients had poor IDLE
>>> support that we ended up turning it off. The number of help desk
>>> calls such as the one above dropped essentially to zero after the
>>> change.
>>
>> I wonder if you have some practical experience to share, e.g., which
>> clients & versions have poor IDLE support?
>>
>> :wes
>>
> Outlook/Outlook Express drove the change for us. They would open
> multiple IMAP connections (sent folder, deleted folder, INBOX, ...)
> but the only folder for which they would issue the IDLE command for
> properly was the INBOX. From the behavior of other clients, many
> had the same issue. Apparently Outlook counted on the IDLE for the
> INBOX counting for all additional IMAP connections to the same
> server.
>

I guess the other issue would be user understanding. I guess the ideal 
behaviour is that a client will open a connection to all mailboxes that it 
would otherwise be polling. Probably, some will rely on the user opening 
those mailboxes - which just isn't going to happen without substantial 
education.

Having all those connections open presumably has a negative impact on 
scalability, too. For example, we use a cluster of OSX servers, each of 
which is limited in the kernel to 2500 open processes (and there is no way 
to change this!). I'd hate to think of all my users having several 
processes open just on the off chance that email will be delivered to them.

-- 
Ian Eiloart
IT Services, University of Sussex
x3148

From dbucherml at hsolutions.ch  Mon Sep  1 14:50:57 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Mon, 01 Sep 2008 20:50:57 +0200
Subject: Very annoying IMAP problem (cyrus + Outlook)
In-Reply-To: <48AEC613.1000405@hsolutions.ch>
References: <48AE83E1.3050103@hsolutions.ch>	<alpine.LSU.1.10.0808221200020.30627@hermes-1.csi.cam.ac.uk>
	<48AEC613.1000405@hsolutions.ch>
Message-ID: <48BC3991.80008@hsolutions.ch>

Hello everyone,

What should I do next to solve my problem ?

Denis

Denis BUCHER a ?crit :
> Hello everyone,
> 
> David Carter a ?crit :
>> On Fri, 22 Aug 2008, Denis BUCHER wrote:
>>
>>> As far as I understand, the cause of the problem is : * "Outlook is 
>>> sending either a token or quoted string that is longer than 8K bytes."
>> Your problem is a mailbox which contains several thousand messages. 
>> Possibly several thousand messages which Outlook hasn't seen previously.
>>
>> Outlook tries to construct a single IMAP command of the form:
>>
>>  UID FETCH uid,uid,uid,... <some set of fields>
>>
>> where the list of UIDs is larger than 8 KBytes in size.
> 
> Ok that's what I have :
> 
> a) Logs are present
> # ls -l /var/lib/imap/log/dbucher
> total 2508
> -rw------- 1 cyrus mail 355147 Aug 22 14:43 20235
> -rw------- 1 cyrus mail   5327 Aug 22 14:43 25058
> -rw------- 1 cyrus mail  10654 Aug 22 14:54 25415
> -rw------- 1 cyrus mail 355241 Aug 22 15:24 25416
> -rw------- 1 cyrus mail 355537 Aug 22 15:03 25417
> -rw------- 1 cyrus mail 355147 Aug 22 14:48 25576
> -rw------- 1 cyrus mail   5327 Aug 22 14:59 26381
> -rw------- 1 cyrus mail   5327 Aug 22 15:04 26763
> -rw------- 1 cyrus mail 355443 Aug 22 15:15 26765
> -rw------- 1 cyrus mail   5327 Aug 22 15:09 27095
> -rw------- 1 cyrus mail   5327 Aug 22 15:14 27752
> -rw------- 1 cyrus mail 360146 Aug 22 15:19 28135
> -rw------- 1 cyrus mail   5327 Aug 22 15:24 28463
> -rw------- 1 cyrus mail   5327 Aug 22 15:29 29125
> -rw------- 1 cyrus mail 355147 Aug 22 15:29 29127
> 
> b) That's the UID FETCH :
> # grep "UID FETCH" *
> 20235:<1219408982<jbf7 UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 20235:<1219408982<eke2 UID FETCH 1:7135 (UID FLAGS)
> 25416:<1219411440<kb1u UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 25416:<1219411440<qv47 UID FETCH 1:7135 (UID FLAGS)
> 25417:<1219409521<1ozq UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 25417:<1219409521<h7ki UID FETCH 1:7135 (UID FLAGS)
> 25576:<1219409287<ukf6 UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 25576:<1219409287<9vks UID FETCH 1:7135 (UID FLAGS)
> 26765:<1219410214<y8b2 UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 26765:<1219410214<b685 UID FETCH 1:7135 (UID FLAGS)
> 28135:<1219411131<7bfi UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 28135:<1219411131<dkkx UID FETCH 1:7135 (UID FLAGS)
> 29127:<1219411745<4g4y UID FETCH 7136:* (UID FLAGS RFC822.SIZE 
> BODY.PEEK[HEADER] INTERNALDATE)
> 29127:<1219411745<cos6 UID FETCH 1:7135 (UID FLAGS)
> 
> c) Most sessions in the logs seem to finish correctly :
> ...
> <1219411787<DONE
> ZZZZ LOGOUT
>  >1219411787>5mk6 OK Completed
> * BYE LOGOUT received
> ZZZZ OK Completed
> 
> d) But not all :
> ==> 30887 <==
>  >1219413279>91rc OK Completed
> <1219413279<6leo IDLE
>  >1219413279>+ idling
> <1219413343<DONE
>  >1219413343>6leo OK Completed
> <1219413343<351h UID STORE 7136 +FLAGS (\Deleted \Seen)
>  >1219413343>* 7136 FETCH (FLAGS (\Deleted \Seen) UID 7136)
> 351h OK Completed
> <1219413343<dpau IDLE
>  >1219413343>+ idling
> [end of file]
> 
> e) And there are many "Fatal error: word too long" but not with same 
> number...
> Aug 22 14:43:03 atlantic imaps[25050]: Fatal error: word too long
> Aug 22 14:48:08 atlantic imaps[25063]: Fatal error: word too long
> Aug 22 14:53:24 atlantic imaps[17518]: Fatal error: word too long
> Aug 22 14:58:28 atlantic imaps[26379]: Fatal error: word too long
> Aug 22 15:03:34 atlantic imaps[26776]: Fatal error: word too long
> Aug 22 15:08:40 atlantic imaps[27118]: Fatal error: word too long
> Aug 22 15:13:45 atlantic imaps[27749]: Fatal error: word too long
> Aug 22 15:18:51 atlantic imaps[27174]: Fatal error: word too long
> Aug 22 15:24:01 atlantic imaps[28464]: Fatal error: word too long
> Aug 22 15:29:06 atlantic imaps[29123]: Fatal error: word too long
> 
> Normally the watched account having had "Fatal error", I should find a 
> fatal error in the transactions logs ? Or is nothing written in case of 
> a Fatal error ? (Which I hope not ;-)
> 
> Thanks a lot for your help !
> 
> Denis
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
> 


Denis Bucher

-- 

Denis Bucher   Horus Digital Solutions s?rl  Each problem has a solution
___________________________________________________________________________
    T?l. +41-22-8000625     Fax: +41-22-8000622      www.hsolutions.ch

From wes at umich.edu  Mon Sep  1 15:37:19 2008
From: wes at umich.edu (Wesley Craig)
Date: Mon, 1 Sep 2008 15:37:19 -0400
Subject: Very annoying IMAP problem (cyrus + Outlook)
In-Reply-To: <48BC3991.80008@hsolutions.ch>
References: <48AE83E1.3050103@hsolutions.ch>	<alpine.LSU.1.10.0808221200020.30627@hermes-1.csi.cam.ac.uk>
	<48AEC613.1000405@hsolutions.ch> <48BC3991.80008@hsolutions.ch>
Message-ID: <B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>

On 01 Sep 2008, at 14:50, Denis BUCHER wrote:
> What should I do next to solve my problem ?

There are actually a couple of places cyrus might give the fatal  
error "word too long".  The prot routines should be recording the  
interactions before passing the data up to the imap layer where the  
parsing error occurs.  Are there any long lines in your telemetry?   
The bad line should directly proceed "* BYE Fatal error: word too  
long" in the telemetry (if I'm reading imapd's fatal() routine  
correctly).

AFAIK, there's nothing to be done other than adjusting the MAXWORD  
and/or MAXQUOTED limits.  That means upgrading or recompiling the old  
version that you're on.

:wes

> Denis BUCHER a ?crit :
>> David Carter a ?crit :
>>> On Fri, 22 Aug 2008, Denis BUCHER wrote:
>>>> As far as I understand, the cause of the problem is : * "Outlook is
>>>> sending either a token or quoted string that is longer than 8K  
>>>> bytes."
>>> Your problem is a mailbox which contains several thousand messages.
>>> Possibly several thousand messages which Outlook hasn't seen  
>>> previously.
>>>
>>> Outlook tries to construct a single IMAP command of the form:
>>>
>>>  UID FETCH uid,uid,uid,... <some set of fields>
>>>
>>> where the list of UIDs is larger than 8 KBytes in size.
>>
>> Ok that's what I have :
>>
>> a) Logs are present
>> # ls -l /var/lib/imap/log/dbucher
>> total 2508
>> -rw------- 1 cyrus mail 355147 Aug 22 14:43 20235
>> -rw------- 1 cyrus mail   5327 Aug 22 14:43 25058
>> -rw------- 1 cyrus mail  10654 Aug 22 14:54 25415
>> -rw------- 1 cyrus mail 355241 Aug 22 15:24 25416
>> -rw------- 1 cyrus mail 355537 Aug 22 15:03 25417
>> -rw------- 1 cyrus mail 355147 Aug 22 14:48 25576
>> -rw------- 1 cyrus mail   5327 Aug 22 14:59 26381
>> -rw------- 1 cyrus mail   5327 Aug 22 15:04 26763
>> -rw------- 1 cyrus mail 355443 Aug 22 15:15 26765
>> -rw------- 1 cyrus mail   5327 Aug 22 15:09 27095
>> -rw------- 1 cyrus mail   5327 Aug 22 15:14 27752
>> -rw------- 1 cyrus mail 360146 Aug 22 15:19 28135
>> -rw------- 1 cyrus mail   5327 Aug 22 15:24 28463
>> -rw------- 1 cyrus mail   5327 Aug 22 15:29 29125
>> -rw------- 1 cyrus mail 355147 Aug 22 15:29 29127
>>
>> b) That's the UID FETCH :
>> # grep "UID FETCH" *
>> 20235:<1219408982<jbf7 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 20235:<1219408982<eke2 UID FETCH 1:7135 (UID FLAGS)
>> 25416:<1219411440<kb1u UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 25416:<1219411440<qv47 UID FETCH 1:7135 (UID FLAGS)
>> 25417:<1219409521<1ozq UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 25417:<1219409521<h7ki UID FETCH 1:7135 (UID FLAGS)
>> 25576:<1219409287<ukf6 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 25576:<1219409287<9vks UID FETCH 1:7135 (UID FLAGS)
>> 26765:<1219410214<y8b2 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 26765:<1219410214<b685 UID FETCH 1:7135 (UID FLAGS)
>> 28135:<1219411131<7bfi UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 28135:<1219411131<dkkx UID FETCH 1:7135 (UID FLAGS)
>> 29127:<1219411745<4g4y UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>> BODY.PEEK[HEADER] INTERNALDATE)
>> 29127:<1219411745<cos6 UID FETCH 1:7135 (UID FLAGS)
>>
>> c) Most sessions in the logs seem to finish correctly :
>> ...
>> <1219411787<DONE
>> ZZZZ LOGOUT
>>> 1219411787>5mk6 OK Completed
>> * BYE LOGOUT received
>> ZZZZ OK Completed
>>
>> d) But not all :
>> ==> 30887 <==
>>> 1219413279>91rc OK Completed
>> <1219413279<6leo IDLE
>>> 1219413279>+ idling
>> <1219413343<DONE
>>> 1219413343>6leo OK Completed
>> <1219413343<351h UID STORE 7136 +FLAGS (\Deleted \Seen)
>>> 1219413343>* 7136 FETCH (FLAGS (\Deleted \Seen) UID 7136)
>> 351h OK Completed
>> <1219413343<dpau IDLE
>>> 1219413343>+ idling
>> [end of file]
>>
>> e) And there are many "Fatal error: word too long" but not with same
>> number...
>> Aug 22 14:43:03 atlantic imaps[25050]: Fatal error: word too long
>> Aug 22 14:48:08 atlantic imaps[25063]: Fatal error: word too long
>> Aug 22 14:53:24 atlantic imaps[17518]: Fatal error: word too long
>> Aug 22 14:58:28 atlantic imaps[26379]: Fatal error: word too long
>> Aug 22 15:03:34 atlantic imaps[26776]: Fatal error: word too long
>> Aug 22 15:08:40 atlantic imaps[27118]: Fatal error: word too long
>> Aug 22 15:13:45 atlantic imaps[27749]: Fatal error: word too long
>> Aug 22 15:18:51 atlantic imaps[27174]: Fatal error: word too long
>> Aug 22 15:24:01 atlantic imaps[28464]: Fatal error: word too long
>> Aug 22 15:29:06 atlantic imaps[29123]: Fatal error: word too long
>>
>> Normally the watched account having had "Fatal error", I should  
>> find a
>> fatal error in the transactions logs ? Or is nothing written in  
>> case of
>> a Fatal error ? (Which I hope not ;-)

From brong at fastmail.fm  Mon Sep  1 18:48:10 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Tue, 2 Sep 2008 08:48:10 +1000
Subject: Very annoying IMAP problem (cyrus + Outlook)
In-Reply-To: <B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>
References: <48AE83E1.3050103@hsolutions.ch>
	<alpine.LSU.1.10.0808221200020.30627@hermes-1.csi.cam.ac.uk>
	<48AEC613.1000405@hsolutions.ch> <48BC3991.80008@hsolutions.ch>
	<B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>
Message-ID: <20080901224810.GA7264@brong.net>

On Mon, Sep 01, 2008 at 03:37:19PM -0400, Wesley Craig wrote:
> On 01 Sep 2008, at 14:50, Denis BUCHER wrote:
> > What should I do next to solve my problem ?
> 
> There are actually a couple of places cyrus might give the fatal  
> error "word too long".  The prot routines should be recording the  
> interactions before passing the data up to the imap layer where the  
> parsing error occurs.  Are there any long lines in your telemetry?   
> The bad line should directly proceed "* BYE Fatal error: word too  
> long" in the telemetry (if I'm reading imapd's fatal() routine  
> correctly).
> 
> AFAIK, there's nothing to be done other than adjusting the MAXWORD  
> and/or MAXQUOTED limits.  That means upgrading or recompiling the old  
> version that you're on.

This is what we apply at FastMail:

-    MAXQUOTED = 32768,
-    MAXWORD = 32768,
+    MAXQUOTED = 524288,
+    MAXWORD = 524288,

Our smallest IMAP server has 6Gb of memory, so we really don't need
baby-sized buffers :)

Bron.

From brong at fastmail.fm  Tue Sep  2 03:32:42 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Tue, 2 Sep 2008 17:32:42 +1000
Subject: Replication errors: missing subscription
Message-ID: <20080902073242.GA31857@brong.net>

Our Cyrus 2.3.12 + patches replication system has been running very
reliably for months - to the point where the only issues our
checkreplication script tends to find are either:

a) cases where someone has reconstructed and not run quota -f
   afterwards, causing quota mismatches.  (this is mostly the
   fault of bits of our code that need updating!)

b) subscriptions missing on the replica.

I have a suspicion that most of these could be avoided by the simple
expedient of switching from putting individual subscription records
into the sync log to copying the entire user.sub file.

(I've also changed setseen_all to just overwrite the user.seen file 
rather than attempt some sort of merger.  It's a replica, the master
is right!  This will break if you're using a different database type
on the replica than the master of course - but that's why you
shouldn't be sending binary formats over the wire in the first place.
It's already going to break)

Bron.


From kleo+cyrus at netbox.cz  Tue Sep  2 06:48:05 2008
From: kleo+cyrus at netbox.cz (Vladimir Klejch)
Date: Tue, 2 Sep 2008 12:48:05 +0200 (CEST)
Subject: Replication errors: missing subscription
In-Reply-To: <20080902073242.GA31857@brong.net>
References: <20080902073242.GA31857@brong.net>
Message-ID: <alpine.DEB.1.10.0809021238190.858@crathva.argobk-va.pm>


Hi

It's posible to see your  checkreplication script ??? I'm searching for 
valuable solution of checking the replication and there is no documented 
solution , how to verify "in sync" state  and workaround for misstates ...

 	Thanks
 					Kleo


On Tue, 2 Sep 2008, Bron Gondwana wrote:

> Our Cyrus 2.3.12 + patches replication system has been running very
> reliably for months - to the point where the only issues our
> checkreplication script tends to find are either:
>
> a) cases where someone has reconstructed and not run quota -f
>   afterwards, causing quota mismatches.  (this is mostly the
>   fault of bits of our code that need updating!)
>
> b) subscriptions missing on the replica.
>
> I have a suspicion that most of these could be avoided by the simple
> expedient of switching from putting individual subscription records
> into the sync log to copying the entire user.sub file.
>
> (I've also changed setseen_all to just overwrite the user.seen file
> rather than attempt some sort of merger.  It's a replica, the master
> is right!  This will break if you're using a different database type
> on the replica than the master of course - but that's why you
> shouldn't be sending binary formats over the wire in the first place.
> It's already going to break)
>
> Bron.
>


-- 

   	~~	~~	~~	~~	~~	~~	~~
Vladimir `KLEO' Klejch     	Kleo'at'netbox.cz
 		...	...	...	...



From ml at bortal.de  Tue Sep  2 07:16:32 2008
From: ml at bortal.de (ml at bortal.de)
Date: Tue,  2 Sep 2008 13:16:32 +0200 (CEST)
Subject: =?ISO-8859-1?Q?How to make secure SM?=  =?ISO-8859-1?Q?TP Relaying?=
Message-ID: <20080902111632.34019D5411D@nemo.xenovation.com>

Hello List,

we currently have 3 E-Mail Boxes running sendmail and cyrus. We serve
about 50 customers and 800  e-mail adresses. The Customers usually have
an Exchange-Server or directly connect to us using smtp auth.

Out problem: If a customer sends out an E-mail bomb by accident or
purpose, then the ip-address of our mailserver will be blacklisted!

Whats the best way to avoid this? Is there a way to set some sort of
limit or something?

Example: If a customer with 50 E-Mail Adresses gets a LOT of spam
including unknown user bounces, then i will get a lot of traffic wich
will look like some e-mail attach, too.

Any ideas?

Thanks,
Mario




From Rudy.Gevaert at UGent.be  Tue Sep  2 09:06:07 2008
From: Rudy.Gevaert at UGent.be (Rudy Gevaert)
Date: Tue, 02 Sep 2008 15:06:07 +0200
Subject: Skiplist errors on Cyrus 2.3.12
In-Reply-To: <200808011232.42751.stockton@netbg.com>
References: <20080711093751.GA19670@rzdspc6.informatik.uni-hamburg.de>	<20080711125500.GA21954@brong.net>	<20080714071057.GA13835@rzdspc6.informatik.uni-hamburg.de>
	<200808011232.42751.stockton@netbg.com>
Message-ID: <48BD3A3F.9090001@UGent.be>

Stoyan Tzalev wrote:
> sorry to confirm this,

+1

:(
-- 
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Rudy Gevaert          Rudy.Gevaert at UGent.be          tel:+32 9 264 4734
Directie ICT, afd. Infrastructuur ICT Department, Infrastructure office
Groep Systemen                    Systems group
Universiteit Gent                 Ghent University
Krijgslaan 281, gebouw S9, 9000 Gent, Belgie               www.UGent.be
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

From adam at morrison-ind.com  Tue Sep  2 09:47:00 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Tue, 02 Sep 2008 09:47:00 -0400
Subject: Telemetry Data Files
Message-ID: <1220363220.7082.6.camel@linux-nnci.site>

I'm looking at Cyrus' ability to log telemetry data, but not finding
allot of documentation, so...

<1220361788<B00051 UID FETCH 485619 BODY.PEEK[]
>1220361788>* 66 FETCH (UID 485619 BODY[] {5256}
Return-Path: <info-cyrus-bounces at lists.andrew.cmu.edu>
Received: from kyack.mormail.com (KYACK.mormail.com [192.168.1.8])
	 by imap.mormail.com (Cyrus v2.2.12) with LMTPA;

I assume that "<" prefix indicates this is the command from the client
and ">" is the response from the server (followed by the subsequent
data)?

The "1?220361788" is a timestamp?  (since that roughly converts to now)

"?B00051" is some kind of sequence number?


From Rudy.Gevaert at UGent.be  Tue Sep  2 11:14:00 2008
From: Rudy.Gevaert at UGent.be (Rudy Gevaert)
Date: Tue, 02 Sep 2008 17:14:00 +0200
Subject: Telemetry Data Files
In-Reply-To: <1220363220.7082.6.camel@linux-nnci.site>
References: <1220363220.7082.6.camel@linux-nnci.site>
Message-ID: <48BD5838.20204@UGent.be>

Adam Tauno Williams wrote:
> I'm looking at Cyrus' ability to log telemetry data, but not finding
> allot of documentation, so...
> 
> <1220361788<B00051 UID FETCH 485619 BODY.PEEK[]
>> 1220361788>* 66 FETCH (UID 485619 BODY[] {5256}
> Return-Path: <info-cyrus-bounces at lists.andrew.cmu.edu>
> Received: from kyack.mormail.com (KYACK.mormail.com [192.168.1.8])
> 	 by imap.mormail.com (Cyrus v2.2.12) with LMTPA;
> 
> I assume that "<" prefix indicates this is the command from the client
> and ">" is the response from the server (followed by the subsequent
> data)?
> 

yes

> The "1?220361788" is a timestamp?  (since that roughly converts to now)

i assume so too :)

> "?B00051" is some kind of sequence number?

yes, see section
2.2.1 and 2.2.2 of rfc3501



-- 
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Rudy Gevaert          Rudy.Gevaert at UGent.be          tel:+32 9 264 4734
Directie ICT, afd. Infrastructuur ICT Department, Infrastructure office
Groep Systemen                    Systems group
Universiteit Gent                 Ghent University
Krijgslaan 281, gebouw S9, 9000 Gent, Belgie               www.UGent.be
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

From brong at fastmail.fm  Tue Sep  2 23:53:24 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Wed, 3 Sep 2008 13:53:24 +1000
Subject: Skiplist errors on Cyrus 2.3.12
In-Reply-To: <20080711093751.GA19670@rzdspc6.informatik.uni-hamburg.de>
References: <20080711093751.GA19670@rzdspc6.informatik.uni-hamburg.de>
Message-ID: <20080903035324.GB9925@brong.net>

On Fri, Jul 11, 2008 at 11:37:52AM +0200, Reinhard Zierke wrote:
> Jul 11 10:32:41 mailhost.informatik.uni-hamburg.de cyradm[13944]: [ID 637875 local6.error] Fatal error: Internal error: assertion failed: cyrusdb_skiplist.c: 622: db->lock_status == UNLOCKED
> Jul 11 10:32:41 mailhost.informatik.uni-hamburg.de cyradm[13944]: [ID 558109 local6.error] skiplist: closed while still locked

We think we've figured this one out now :)  Finally.  John Capo came up
with a basic patch that fixed it, and I've done a slightly more
ambitious refactor.  Rudy has tested my patch, and we're running it at
FastMail as well.

I've rebuild our webpage with the new patch included.  NOTE: this patch
obsoletes the old readlocktracking patch, and conflicts with it.  This
way is much cleaner.

Bron.

http://cyrus.brong.fastmail.fm/patches/cyrus-skiplist-locking-rework-2.3.12.diff

From dangaudette at knet.ca  Wed Sep  3 14:59:15 2008
From: dangaudette at knet.ca (Dan Gaudette)
Date: Wed, 03 Sep 2008 13:59:15 -0500
Subject: Murder with Virtual Domains - deliveries from postfix fail
Message-ID: <48BEDE83.3050505@knet.ca>

Hello,

I have Cyrus Murder 2.3.12p2 up and running (1 frontend, 1 backend, 1 
mupdate), however when I enable virtdomains I receive the following 
error on the frontend:   imapd/lmtp[]: verify_user 
(frontend.example.com!user.steve) failed: Mailbox does not exist

Everything else seems to work fine (IMAP, POP, creating/deleting 
mailboxes with domain administrators), but the frontend server fails 
with the above message when receiving the email addressed to 
steve at example.com from Postfix (separate machine). 

Postfix returns: <steve at frontend.example.com>: host 
xxx.xx.xx.xxx[xxx.xx.xx.xxx] said: 550-Mailbox unknown.  Either there is 
no mailbox associated with this 550-name or you do not have 
authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO 
command)

I've tried recreating the mailbox after virtdomains was enabled, but 
with the same result. 

Am I missing something in my Cyrus configuration, or is this an issue 
with Postfix?

Thanks in advance,
Dan

Backend config:

# /etc/imapd.conf

    configdirectory: /var/cyrus/imap
    partition-default: /var/cyrus/mail
    syslog_prefix: imapd
    admins: cyrus murd admin at foo.bar
    
    proxyservers: murd
   
   # settings for the mupdate (master) server   
   mupdate_config: standard
   mupdate_username: back
   mupdate_authname: back
   mupdate_password: back
   mupdate_server: xxx.xxx.xxx.xxx
   mupdate_port: 3905
   
   # allow user moves and renames
   allowusermoves: 1
   
   # virtual domain
   # allowed values: off, userid, on
   virtdomains: userid
   defaultdomain: example.com
   servername: backend

   guid_mode: sha1
   
    # Sieve
    sievedir: /var/cyrus/sieve
    sendmail: /usr/sbin/sendmail

    # Databases
    hashimapspool: true
    annotation_db: skiplist
    duplicate_db: skiplist
    mboxlist_db: skiplist
    quota_db: quotalegacy
    seenstate_db: skiplist
    subscription_db: skiplist

    # Authentication
    allowanonymouslogin: no
    allowplaintext: yes

    # Use saslauthd to authenticate users
    sasl_mech_list: plain
    sasl_pwcheck_method: saslauthd

    # Bounce messages that are over quota
    lmtp_over_quota_perm_failure: yes

    # tls/ssl support
    tls_cert_file: /var/cyrus/imap/tls/server.pem
    tls_key_file: /var/cyrus/imap/tls/server.pem
    tls_ca_file: /var/cyrus/imap/tls/server.pem


Frontend config is similar, but with proxy_authname and  backend_password


From dab66 at mail.lepp.cornell.edu  Wed Sep  3 15:06:23 2008
From: dab66 at mail.lepp.cornell.edu (Devin Bougie)
Date: Wed, 3 Sep 2008 15:06:23 -0400
Subject: default kerberos instance
Message-ID: <0F24798A-EEC1-4125-AD17-A6EAF775229F@mail.lepp.cornell.edu>

Hi, All.  How can one specify the default kerberos instance that is  
used to authenticate users?  We have basic kerberos5 authentication  
working, but we would like Cyrus to authenticate users using an  
alternate instance.  For example, if a user logs in as dab66, we want  
Cyrus to authenticate them using the dab66/instance kerberos instance  
instead of just dab66.

Any suggestions would be greatly appreciated.

Sincerely,
Devin

------
Devin Bougie
Laboratory for Elementary-Particle Physics
Cornell University

From dwhite at olp.net  Wed Sep  3 15:42:44 2008
From: dwhite at olp.net (Dan White)
Date: Wed, 03 Sep 2008 14:42:44 -0500
Subject: Murder with Virtual Domains - deliveries from postfix fail
In-Reply-To: <48BEDE83.3050505@knet.ca>
References: <48BEDE83.3050505@knet.ca>
Message-ID: <48BEE8B4.3090403@olp.net>

Dan Gaudette wrote:
> Hello,
>
> I have Cyrus Murder 2.3.12p2 up and running (1 frontend, 1 backend, 1 
> mupdate), however when I enable virtdomains I receive the following 
> error on the frontend:   imapd/lmtp[]: verify_user 
> (frontend.example.com!user.steve) failed: Mailbox does not exist
>
> Everything else seems to work fine (IMAP, POP, creating/deleting 
> mailboxes with domain administrators), but the frontend server fails 
> with the above message when receiving the email addressed to 
> steve at example.com from Postfix (separate machine). 
>
> Postfix returns: <steve at frontend.example.com>: host 
> xxx.xx.xx.xxx[xxx.xx.xx.xxx] said: 550-Mailbox unknown.  Either there is 
> no mailbox associated with this 550-name or you do not have 
> authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO 
> command)
>
> I've tried recreating the mailbox after virtdomains was enabled, but 
> with the same result. 
>
> Am I missing something in my Cyrus configuration, or is this an issue 
> with Postfix?
>
>
>   

Dan,

I ran into a similar error during my install, but I don't recall if this 
is what got me around it:

On the Front end:
virtdomains: on

On the Backend:
virtdomains: userid

On the Mupdate server:
virtdomains: on

I have Postfix and lmtp (proxy) running on the frontend as well. I can 
provide more config if you'd like.

From dangaudette at knet.ca  Wed Sep  3 16:56:55 2008
From: dangaudette at knet.ca (Dan Gaudette)
Date: Wed, 03 Sep 2008 15:56:55 -0500
Subject: Murder with Virtual Domains - deliveries from postfix fail
In-Reply-To: <48BEE8B4.3090403@olp.net>
References: <48BEDE83.3050505@knet.ca> <48BEE8B4.3090403@olp.net>
Message-ID: <48BEFA17.90700@knet.ca>

Thanks Dan, but I'm still getting the same error.

It'd be awesome if you could provide some more config.


Dan White wrote:
> Dan Gaudette wrote:
>> Hello,
>>
>> I have Cyrus Murder 2.3.12p2 up and running (1 frontend, 1 backend, 1 
>> mupdate), however when I enable virtdomains I receive the following 
>> error on the frontend:   imapd/lmtp[]: verify_user 
>> (frontend.example.com!user.steve) failed: Mailbox does not exist
>>
>> Everything else seems to work fine (IMAP, POP, creating/deleting 
>> mailboxes with domain administrators), but the frontend server fails 
>> with the above message when receiving the email addressed to 
>> steve at example.com from Postfix (separate machine).
>> Postfix returns: <steve at frontend.example.com>: host 
>> xxx.xx.xx.xxx[xxx.xx.xx.xxx] said: 550-Mailbox unknown.  Either there 
>> is no mailbox associated with this 550-name or you do not have 
>> authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO 
>> command)
>>
>> I've tried recreating the mailbox after virtdomains was enabled, but 
>> with the same result.
>> Am I missing something in my Cyrus configuration, or is this an issue 
>> with Postfix?
>>
>>
>>   
>
> Dan,
>
> I ran into a similar error during my install, but I don't recall if 
> this is what got me around it:
>
> On the Front end:
> virtdomains: on
>
> On the Backend:
> virtdomains: userid
>
> On the Mupdate server:
> virtdomains: on
>
> I have Postfix and lmtp (proxy) running on the frontend as well. I can 
> provide more config if you'd like.


From dwhite at olp.net  Wed Sep  3 23:57:57 2008
From: dwhite at olp.net (Dan White)
Date: Wed, 03 Sep 2008 22:57:57 -0500
Subject: Murder with Virtual Domains - deliveries from postfix fail
In-Reply-To: <48BEFA17.90700@knet.ca>
References: <48BEDE83.3050505@knet.ca> <48BEE8B4.3090403@olp.net>
	<48BEFA17.90700@knet.ca>
Message-ID: <48BF5CC5.6060203@olp.net>

Dan Gaudette wrote:
> Thanks Dan, but I'm still getting the same error.
>
> It'd be awesome if you could provide some more config.

http://support.olp.net/cyrus/

- Dan

From hdembkowski at alcatel-lucent.com  Mon Sep  8 10:07:41 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Mon, 8 Sep 2008 16:07:41 +0200
Subject: Core dump from cyrusdb_skiplist.c
Message-ID: <B576524D0905194499F90736CAA2758A01D8E3BC@DEEXC1U03.de.lucent.com>

Hi,  


We are using cyrus-imapd-2.3.7 to store our messages.
And we got core from imap - file cyrusdb_skiplist.c


#0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930", prefixlen=16, goodp=0x8087dc0 <find_p>,
    cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at cyrusdb_skiplist.c:1019
1019                    ptr = db->map_base + FORWARD(ptr, 0);
(gdb) t 1
[Switching to thread 1 (process 14237)]#0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930", prefixlen=16,
    goodp=0x8087dc0 <find_p>, cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at cyrusdb_skiplist.c:1019
1019                    ptr = db->map_base + FORWARD(ptr, 0);
(gdb) where
#0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930", prefixlen=16, goodp=0x8087dc0 <find_p>,
    cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at cyrusdb_skiplist.c:1019
#1  0x08087ecf in annotatemore_findall (mailbox=0x814b618 "@?\024\b\a", entry=0x80b4834 "*", proc=0x4effb8, rock=0x4effb8,
    tid=0xbfffc91c) at annotate.c:391
#2  0x0808801b in annotatemore_rename (oldmboxname=0xbfffd730 "user.6165602930",
    newmboxname=0x4effb8 <Address 0x4effb8 out of bounds>, olduserid=0x4effb8 <Address 0x4effb8 out of bounds>,
    newuserid=0x4effb8 <Address 0x4effb8 out of bounds>) at annotate.c:2093
#3  0x08055e39 in cmd_rename (tag=0x8151a28 "1", oldname=0x8151b08 "user.6165602930", newname=0x81c6010 "user.6163078011",
    partition=0x0) at imapd.c:5408
#4  0x0805e3ac in cmdloop () at imapd.c:1532
#5  0x08060a57 in service_main (argc=1, argv=0x8149008, envp=0xbffffd64) at imapd.c:789
#6  0x0804c3a8 in main (argc=3, argv=0xbffffd54, envp=0xbffffd64) at service.c:532


It refers to function myforeach() and code


    980             /* save KEY, KEYLEN */
    981             if (KEYLEN(ptr) > savebuflen) {
    982                 savebuflen = KEYLEN(ptr) + 1024;
    983                 savebuf = xrealloc(savebuf, savebuflen);
    984             }
    985             memcpy(savebuf, KEY(ptr), KEYLEN(ptr));
    986             savebufsize = KEYLEN(ptr);
    987
    988             /* make callback */
    989             cb_r = cb(rock, KEY(ptr), KEYLEN(ptr), DATA(ptr), DATALEN(ptr));
    990             if (cb_r) break;
    991
    992             if (!tid) {
    993                 /* grab a r lock */
    994                 if ((r = read_lock(db)) < 0) {
    995                     return r;
    996                 }
    997             } else {
    998                 /* make sure we're up to date */
    999                 update_lock(db, tp);
   1000             }
   1001
   1002             /* reposition */
   1003             if (!(ino == db->map_ino && sz == db->map_size)) {
   1004                 /* something changed in the file; reseek */
   1005                 ptr = find_node(db, savebuf, savebufsize, 0);
   1006
   1007                 /* 'ptr' might not equal 'savebuf'.  if it's different,
   1008                    we want to stay where we are.  if it's the same, we
   1009                    should move on to the next one */
   1010                 if (savebufsize == KEYLEN(ptr) &&
   1011                     !memcmp(savebuf, KEY(ptr), savebufsize)) {
   1012                     ptr = db->map_base + FORWARD(ptr, 0);
   1013                 } else {
   1014                     /* 'savebuf' got deleted, so we're now pointing at the
   1015                        right thing */
   1016                 }
   1017             } else {
   1018                 /* move to the next one */
   1019                 ptr = db->map_base + FORWARD(ptr, 0);
   1020             }
   1021         } else {
   1022             /* we didn't make the callback; keep going */
   1023             ptr = db->map_base + FORWARD(ptr, 0);
   1024         }
   1025     }



Do you know something about it?



Kind Regards,
Henryk

From Rudy.Gevaert at UGent.be  Mon Sep  8 10:52:37 2008
From: Rudy.Gevaert at UGent.be (Rudy Gevaert)
Date: Mon, 08 Sep 2008 16:52:37 +0200
Subject: snmp monitoring two cyrus instances on one machine
Message-ID: <48C53C35.9050706@UGent.be>

Hello,

Some time ago I tried to get snmp monitoring of my cyrus installation. 
I got stuck back then and gave up.

Today I tried again and surprisingly I managed to get a lot farther.  I 
can read out the snmp values of 'a' cyrus instances.

On each machine I run two cyrus instances.  One master and one replica.
However it is not clear how I can distinguish between the master and the 
replica.

One on server when I do an snmp walk I get the data from the master, but 
on an other one I get the data of the replica.

Ideally I want to get both, with two walks.

Does anyone have an idea how to handle this?

Thanks in advance,


-- 
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Rudy Gevaert          Rudy.Gevaert at UGent.be          tel:+32 9 264 4734
Directie ICT, afd. Infrastructuur ICT Department, Infrastructure office
Groep Systemen                    Systems group
Universiteit Gent                 Ghent University
Krijgslaan 281, gebouw S9, 9000 Gent, Belgie               www.UGent.be
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

From stpierre at NebrWesleyan.edu  Mon Sep  8 15:12:53 2008
From: stpierre at NebrWesleyan.edu (Chris St. Pierre)
Date: Mon, 8 Sep 2008 14:12:53 -0500 (CDT)
Subject: Docs for Cyrus/GFS?
Message-ID: <alpine.LFD.1.10.0809081410580.23269@grunthos.NebrWesleyan.edu>

I'm looking for any good documentation on using Cyrus IMAP with shared
storage (in our case, GFS).  Thus far, all I've been able to turn up
is a few snippets on mailing lists and in the wiki, but nothing really
comprehensive.  Any pointers?  Thanks!

Chris St. Pierre
Unix Systems Administrator
Nebraska Wesleyan University

From jens.hoffrichter at gmail.com  Mon Sep  8 15:52:20 2008
From: jens.hoffrichter at gmail.com (Jens Hoffrichter)
Date: Mon, 8 Sep 2008 21:52:20 +0200
Subject: Fwd: Docs for Cyrus/GFS?
In-Reply-To: <9b48a1210809081251n3edbcac0j19538110628cfce3@mail.gmail.com>
References: <alpine.LFD.1.10.0809081410580.23269@grunthos.NebrWesleyan.edu>
	<9b48a1210809081251n3edbcac0j19538110628cfce3@mail.gmail.com>
Message-ID: <9b48a1210809081252p28f11324p27fe54f2c04c5cac@mail.gmail.com>

There I told him to write to the list, and I just clicked the wrong
reply button myself ;)

Sorry for that.


---------- Forwarded message ----------
From: Jens Hoffrichter <jens.hoffrichter at gmail.com>
Date: 2008/9/8
Subject: Re: Docs for Cyrus/GFS?
To: "Chris St. Pierre" <stpierre at nebrwesleyan.edu>


Hi Chris,

2008/9/8 Chris St. Pierre <stpierre at nebrwesleyan.edu>:

> I'm looking for any good documentation on using Cyrus IMAP with shared
> storage (in our case, GFS).  Thus far, all I've been able to turn up
> is a few snippets on mailing lists and in the wiki, but nothing really
> comprehensive.  Any pointers?  Thanks!
There is no real documentation up to now, I think, but I'm in the
process of implementing a quite big mail system on top of a GFS, so if
you have any specific questions, just ask here on the list or me
directly, though on the list would probably be better, to share the
answers.

Just some hints for things I stumbled upon up to now:

I suppose you meta directory will be shared, so you need to separate
out some directories between the single nodes, where each node can put
its own files. Directories coming to my mind are "proc" and "backup".
There are probably some more, but I have no access to the machine
right now to check it. For the separation there I used the named
symlinks from GFS, which worked quite fine.

The other thing is: Make ABSOLUTELY sure that you turn off anything
related to bdb during compile (you probably need to compile your own
cyrus anyway, we are using the incova sources here), as berkeley db
just doesn't work on top of GFS. Or, at least not in a cyrus context.
And it isn't sufficient to just use skiplist in the config file, you
definitely need to switch off compiling bdb support.

The reason for this is that even if you don't have any bdbs
configured, cyrus will still initialize some sort of bdb environment
in your meta directory, and if on another sort the same thing is
happening during the same time, it will try to sleep on a mutex,
waiting for the release of the mutex. Yet, the callback to wake up
never comes when using GFS, so your process will hang indefinitely.
That one took us at least 3 weeks to figure out ;)

Besides from those little things, cyrus works on top of the GFS just
fine, you probably need to tweak some tuning parameters, but I don't
remember them right now, if you need them, I can look them up for you.

The performance is nothing to brag about, though, cyrus and GFS just
don't play that well together. But I got the performance I needed
(around 15 logins per second with three nodes using a loadbalancer),
which is sufficient for our needs. The added reliability is nice,
though, as you can turn off one node, and the whole thing still works.

I don't know if you have any experience using RedHat Cluster, but be
absolutely sure to understand about fencing and quorum of the cluster
before you start any configuration. Cluster software is by no means
really easy to use, IMO, and everything you do needs some extra
thinking if you are just used working with single nodes normally :)

Just try your luck, and if you have any questions, just ask.

Jens

From brong at fastmail.fm  Mon Sep  8 21:11:36 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Tue, 09 Sep 2008 11:11:36 +1000
Subject: Core dump from cyrusdb_skiplist.c
In-Reply-To: <B576524D0905194499F90736CAA2758A01D8E3BC@DEEXC1U03.de.lucent.com>
References: <B576524D0905194499F90736CAA2758A01D8E3BC@DEEXC1U03.de.lucent.com>
Message-ID: <1220922696.16736.1272906357@webmail.messagingengine.com>

Yeah, you've got a corrupted skiplist file.  There are a variety
of reasons why this could be the case, but most of all, the
skiplist library in 2.3.7 is pretty buggy.  Well, no more buggy
than it had been for ages, but I got a LOT of fixes added since
then.

Probably the best skiplist library in current use is 2.3.11.  2.3.12
is theoretically better, but it actually exposes a bug that just
silently worked in 2.3.11.

Hopefully, if Wes and Ken are happy that the locking refactor is
tested enough, there will be a 2.3.13 soonish with a "perfect"
skiplist library.

Meanwhile - that doesn't fix your problem!  How attached are you
to the data in the skiplist file?  It's your annotations DB.  Do you have
a recent backup before it got corrupted?  It's sometimes hard to tell.

I can probably repair it for you, but I haven't got a good working
automated tool for it.  I'd be going in and fiddling the bits by hand!

Bron.


On Mon, 8 Sep 2008 16:07:41 +0200, "DEMBKOWSKI, Henryk (Henryk)" <hdembkowski at alcatel-lucent.com> said:
> Hi,  
> 
> 
> We are using cyrus-imapd-2.3.7 to store our messages.
> And we got core from imap - file cyrusdb_skiplist.c
> 
> 
> #0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930",
> prefixlen=16, goodp=0x8087dc0 <find_p>,
>     cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at
>     cyrusdb_skiplist.c:1019
> 1019                    ptr = db->map_base + FORWARD(ptr, 0);
> (gdb) t 1
> [Switching to thread 1 (process 14237)]#0  myforeach (db=0x814b618,
> prefix=0xbfffb8c0 "user.6165602930", prefixlen=16,
>     goodp=0x8087dc0 <find_p>, cb=0x80871d0 <find_cb>, rock=0xbfffb8b0,
>     tid=0xbfffc91c) at cyrusdb_skiplist.c:1019
> 1019                    ptr = db->map_base + FORWARD(ptr, 0);
> (gdb) where
> #0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930",
> prefixlen=16, goodp=0x8087dc0 <find_p>,
>     cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at
>     cyrusdb_skiplist.c:1019
> #1  0x08087ecf in annotatemore_findall (mailbox=0x814b618 "@&#351;\024\b\a",
> entry=0x80b4834 "*", proc=0x4effb8, rock=0x4effb8,
>     tid=0xbfffc91c) at annotate.c:391
> #2  0x0808801b in annotatemore_rename (oldmboxname=0xbfffd730
> "user.6165602930",
>     newmboxname=0x4effb8 <Address 0x4effb8 out of bounds>,
>     olduserid=0x4effb8 <Address 0x4effb8 out of bounds>,
>     newuserid=0x4effb8 <Address 0x4effb8 out of bounds>) at
>     annotate.c:2093
> #3  0x08055e39 in cmd_rename (tag=0x8151a28 "1", oldname=0x8151b08
> "user.6165602930", newname=0x81c6010 "user.6163078011",
>     partition=0x0) at imapd.c:5408
> #4  0x0805e3ac in cmdloop () at imapd.c:1532
> #5  0x08060a57 in service_main (argc=1, argv=0x8149008, envp=0xbffffd64)
> at imapd.c:789
> #6  0x0804c3a8 in main (argc=3, argv=0xbffffd54, envp=0xbffffd64) at
> service.c:532
> 
> 
> It refers to function myforeach() and code
> 
> 
>     980             /* save KEY, KEYLEN */
>     981             if (KEYLEN(ptr) > savebuflen) {
>     982                 savebuflen = KEYLEN(ptr) + 1024;
>     983                 savebuf = xrealloc(savebuf, savebuflen);
>     984             }
>     985             memcpy(savebuf, KEY(ptr), KEYLEN(ptr));
>     986             savebufsize = KEYLEN(ptr);
>     987
>     988             /* make callback */
>     989             cb_r = cb(rock, KEY(ptr), KEYLEN(ptr), DATA(ptr),
>     DATALEN(ptr));
>     990             if (cb_r) break;
>     991
>     992             if (!tid) {
>     993                 /* grab a r lock */
>     994                 if ((r = read_lock(db)) < 0) {
>     995                     return r;
>     996                 }
>     997             } else {
>     998                 /* make sure we're up to date */
>     999                 update_lock(db, tp);
>    1000             }
>    1001
>    1002             /* reposition */
>    1003             if (!(ino == db->map_ino && sz == db->map_size)) {
>    1004                 /* something changed in the file; reseek */
>    1005                 ptr = find_node(db, savebuf, savebufsize, 0);
>    1006
>    1007                 /* 'ptr' might not equal 'savebuf'.  if it's
>    different,
>    1008                    we want to stay where we are.  if it's the
>    same, we
>    1009                    should move on to the next one */
>    1010                 if (savebufsize == KEYLEN(ptr) &&
>    1011                     !memcmp(savebuf, KEY(ptr), savebufsize)) {
>    1012                     ptr = db->map_base + FORWARD(ptr, 0);
>    1013                 } else {
>    1014                     /* 'savebuf' got deleted, so we're now
>    pointing at the
>    1015                        right thing */
>    1016                 }
>    1017             } else {
>    1018                 /* move to the next one */
>    1019                 ptr = db->map_base + FORWARD(ptr, 0);
>    1020             }
>    1021         } else {
>    1022             /* we didn't make the callback; keep going */
>    1023             ptr = db->map_base + FORWARD(ptr, 0);
>    1024         }
>    1025     }
> 
> 
> 
> Do you know something about it?
> 
> 
> 
> Kind Regards,
> Henryk
-- 
  Bron Gondwana
  brong at fastmail.fm


From hdembkowski at alcatel-lucent.com  Tue Sep  9 04:20:13 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Tue, 9 Sep 2008 10:20:13 +0200
Subject: Core dump from cyrusdb_skiplist.c
In-Reply-To: <1220922696.16736.1272906357@webmail.messagingengine.com>
References: <B576524D0905194499F90736CAA2758A01D8E3BC@DEEXC1U03.de.lucent.com>
	<1220922696.16736.1272906357@webmail.messagingengine.com>
Message-ID: <B576524D0905194499F90736CAA2758A01D8E516@DEEXC1U03.de.lucent.com>

Bron,

Thanks for help. 

Yes, we have backup and we successfully recovered our annotations
database. 

However it could be good if we could have fix for cyrusdb_skiplist.c and
core will 
not be seen anymore.

Kind Regards,
Henryk


-----Original Message-----
From: Bron Gondwana [mailto:brong at fastmail.fm] 
Sent: Tuesday, September 09, 2008 3:12 AM
To: DEMBKOWSKI, Henryk (Henryk); Info Cyrus; Cyrus Devel
Cc: DEMBEK, Adam (Adam)
Subject: Re: Core dump from cyrusdb_skiplist.c

Yeah, you've got a corrupted skiplist file.  There are a variety of
reasons why this could be the case, but most of all, the skiplist
library in 2.3.7 is pretty buggy.  Well, no more buggy than it had been
for ages, but I got a LOT of fixes added since then.

Probably the best skiplist library in current use is 2.3.11.  2.3.12 is
theoretically better, but it actually exposes a bug that just silently
worked in 2.3.11.

Hopefully, if Wes and Ken are happy that the locking refactor is tested
enough, there will be a 2.3.13 soonish with a "perfect"
skiplist library.

Meanwhile - that doesn't fix your problem!  How attached are you to the
data in the skiplist file?  It's your annotations DB.  Do you have a
recent backup before it got corrupted?  It's sometimes hard to tell.

I can probably repair it for you, but I haven't got a good working
automated tool for it.  I'd be going in and fiddling the bits by hand!

Bron.


On Mon, 8 Sep 2008 16:07:41 +0200, "DEMBKOWSKI, Henryk (Henryk)"
<hdembkowski at alcatel-lucent.com> said:
> Hi,
> 
> 
> We are using cyrus-imapd-2.3.7 to store our messages.
> And we got core from imap - file cyrusdb_skiplist.c
> 
> 
> #0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930", 
> prefixlen=16, goodp=0x8087dc0 <find_p>,
>     cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at
>     cyrusdb_skiplist.c:1019
> 1019                    ptr = db->map_base + FORWARD(ptr, 0);
> (gdb) t 1
> [Switching to thread 1 (process 14237)]#0  myforeach (db=0x814b618, 
> prefix=0xbfffb8c0 "user.6165602930", prefixlen=16,
>     goodp=0x8087dc0 <find_p>, cb=0x80871d0 <find_cb>, rock=0xbfffb8b0,
>     tid=0xbfffc91c) at cyrusdb_skiplist.c:1019
> 1019                    ptr = db->map_base + FORWARD(ptr, 0);
> (gdb) where
> #0  myforeach (db=0x814b618, prefix=0xbfffb8c0 "user.6165602930", 
> prefixlen=16, goodp=0x8087dc0 <find_p>,
>     cb=0x80871d0 <find_cb>, rock=0xbfffb8b0, tid=0xbfffc91c) at
>     cyrusdb_skiplist.c:1019
> #1  0x08087ecf in annotatemore_findall (mailbox=0x814b618 
> "@&#351;\024\b\a",
> entry=0x80b4834 "*", proc=0x4effb8, rock=0x4effb8,
>     tid=0xbfffc91c) at annotate.c:391
> #2  0x0808801b in annotatemore_rename (oldmboxname=0xbfffd730 
> "user.6165602930",
>     newmboxname=0x4effb8 <Address 0x4effb8 out of bounds>,
>     olduserid=0x4effb8 <Address 0x4effb8 out of bounds>,
>     newuserid=0x4effb8 <Address 0x4effb8 out of bounds>) at
>     annotate.c:2093
> #3  0x08055e39 in cmd_rename (tag=0x8151a28 "1", oldname=0x8151b08 
> "user.6165602930", newname=0x81c6010 "user.6163078011",
>     partition=0x0) at imapd.c:5408
> #4  0x0805e3ac in cmdloop () at imapd.c:1532
> #5  0x08060a57 in service_main (argc=1, argv=0x8149008, 
> envp=0xbffffd64) at imapd.c:789
> #6  0x0804c3a8 in main (argc=3, argv=0xbffffd54, envp=0xbffffd64) at
> service.c:532
> 
> 
> It refers to function myforeach() and code
> 
> 
>     980             /* save KEY, KEYLEN */
>     981             if (KEYLEN(ptr) > savebuflen) {
>     982                 savebuflen = KEYLEN(ptr) + 1024;
>     983                 savebuf = xrealloc(savebuf, savebuflen);
>     984             }
>     985             memcpy(savebuf, KEY(ptr), KEYLEN(ptr));
>     986             savebufsize = KEYLEN(ptr);
>     987
>     988             /* make callback */
>     989             cb_r = cb(rock, KEY(ptr), KEYLEN(ptr), DATA(ptr),
>     DATALEN(ptr));
>     990             if (cb_r) break;
>     991
>     992             if (!tid) {
>     993                 /* grab a r lock */
>     994                 if ((r = read_lock(db)) < 0) {
>     995                     return r;
>     996                 }
>     997             } else {
>     998                 /* make sure we're up to date */
>     999                 update_lock(db, tp);
>    1000             }
>    1001
>    1002             /* reposition */
>    1003             if (!(ino == db->map_ino && sz == db->map_size)) {
>    1004                 /* something changed in the file; reseek */
>    1005                 ptr = find_node(db, savebuf, savebufsize, 0);
>    1006
>    1007                 /* 'ptr' might not equal 'savebuf'.  if it's
>    different,
>    1008                    we want to stay where we are.  if it's the
>    same, we
>    1009                    should move on to the next one */
>    1010                 if (savebufsize == KEYLEN(ptr) &&
>    1011                     !memcmp(savebuf, KEY(ptr), savebufsize)) {
>    1012                     ptr = db->map_base + FORWARD(ptr, 0);
>    1013                 } else {
>    1014                     /* 'savebuf' got deleted, so we're now
>    pointing at the
>    1015                        right thing */
>    1016                 }
>    1017             } else {
>    1018                 /* move to the next one */
>    1019                 ptr = db->map_base + FORWARD(ptr, 0);
>    1020             }
>    1021         } else {
>    1022             /* we didn't make the callback; keep going */
>    1023             ptr = db->map_base + FORWARD(ptr, 0);
>    1024         }
>    1025     }
> 
> 
> 
> Do you know something about it?
> 
> 
> 
> Kind Regards,
> Henryk
--
  Bron Gondwana
  brong at fastmail.fm


From Hagedorn at uni-koeln.de  Tue Sep  9 06:32:13 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Tue, 09 Sep 2008 12:32:13 +0200
Subject: snmp monitoring two cyrus instances on one machine
In-Reply-To: <48C53C35.9050706@UGent.be>
References: <48C53C35.9050706@UGent.be>
Message-ID: <C840FCBF46507C0A99B00DA8@tyrion.rrz.uni-koeln.de>

--On 8. September 2008 16:52:37 +0200 Rudy Gevaert <Rudy.Gevaert at UGent.be> 
wrote:

> Some time ago I tried to get snmp monitoring of my cyrus installation.
> I got stuck back then and gave up.
>
> Today I tried again and surprisingly I managed to get a lot farther.  I
> can read out the snmp values of 'a' cyrus instances.
>
> On each machine I run two cyrus instances.

Using different IP addresses or just different ports?

> One master and one replica.
> However it is not clear how I can distinguish between the master and the
> replica.

If they are using different IP addresses I would expect that to work. I'ne 
never done that myself, though.
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080909/4d8f7c2e/attachment.bin 

From russek at win-rar.com  Tue Sep  9 08:58:08 2008
From: russek at win-rar.com (Johannes =?ISO-8859-1?Q?Ru=DFek?=)
Date: Tue, 09 Sep 2008 14:58:08 +0200
Subject: ssl client certificates
Message-ID: <1220965088.17470.23.camel@admc.win-rar.local>

Hello everybody,
so cyrus does support ssl client certificates (otherwise there wouldn't
be errors such as "TLS server engine: No CA file
specified. Client side certs may not work"), but can i use client certs
as a replacement to username/password logins? e.g. use the cert to map
the x509 subject to the username of the user?
regards,
johannes


-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 2616 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080909/6b690512/attachment-0001.bin 

From stpierre at NebrWesleyan.edu  Tue Sep  9 11:49:12 2008
From: stpierre at NebrWesleyan.edu (Chris St. Pierre)
Date: Tue, 9 Sep 2008 10:49:12 -0500 (CDT)
Subject: Fwd: Docs for Cyrus/GFS?
In-Reply-To: <9b48a1210809081252p28f11324p27fe54f2c04c5cac@mail.gmail.com>
References: <alpine.LFD.1.10.0809081410580.23269@grunthos.NebrWesleyan.edu>
	<9b48a1210809081251n3edbcac0j19538110628cfce3@mail.gmail.com>
	<9b48a1210809081252p28f11324p27fe54f2c04c5cac@mail.gmail.com>
Message-ID: <alpine.LFD.1.10.0809091046420.23269@grunthos.NebrWesleyan.edu>

Jens--

Thanks for your help!  I've been able to get Cyrus IMAP running now
with a shared backend, and my tests thus far indicate that it's
working dandy.

It looks like most of the "important" databases are already skiplists;
the only ones that defaulted to BDB were the duplicate, tlscache, and
ptscache databases.  What, if anything, do I need to do special when
converting my data over?  I'll not be changing Cyrus versions; will it
"just work" to move all of my current data, or will I need to convert
databases/reconstruct/etc.?

Thanks again!

Chris St. Pierre
Unix Systems Administrator
Nebraska Wesleyan University

On Mon, 8 Sep 2008, Jens Hoffrichter wrote:

> There I told him to write to the list, and I just clicked the wrong
> reply button myself ;)
>
> Sorry for that.
>
>
> ---------- Forwarded message ----------
> From: Jens Hoffrichter <jens.hoffrichter at gmail.com>
> Date: 2008/9/8
> Subject: Re: Docs for Cyrus/GFS?
> To: "Chris St. Pierre" <stpierre at nebrwesleyan.edu>
>
>
> Hi Chris,
>
> 2008/9/8 Chris St. Pierre <stpierre at nebrwesleyan.edu>:
>
>> I'm looking for any good documentation on using Cyrus IMAP with shared
>> storage (in our case, GFS).  Thus far, all I've been able to turn up
>> is a few snippets on mailing lists and in the wiki, but nothing really
>> comprehensive.  Any pointers?  Thanks!
> There is no real documentation up to now, I think, but I'm in the
> process of implementing a quite big mail system on top of a GFS, so if
> you have any specific questions, just ask here on the list or me
> directly, though on the list would probably be better, to share the
> answers.
>
> Just some hints for things I stumbled upon up to now:
>
> I suppose you meta directory will be shared, so you need to separate
> out some directories between the single nodes, where each node can put
> its own files. Directories coming to my mind are "proc" and "backup".
> There are probably some more, but I have no access to the machine
> right now to check it. For the separation there I used the named
> symlinks from GFS, which worked quite fine.
>
> The other thing is: Make ABSOLUTELY sure that you turn off anything
> related to bdb during compile (you probably need to compile your own
> cyrus anyway, we are using the incova sources here), as berkeley db
> just doesn't work on top of GFS. Or, at least not in a cyrus context.
> And it isn't sufficient to just use skiplist in the config file, you
> definitely need to switch off compiling bdb support.
>
> The reason for this is that even if you don't have any bdbs
> configured, cyrus will still initialize some sort of bdb environment
> in your meta directory, and if on another sort the same thing is
> happening during the same time, it will try to sleep on a mutex,
> waiting for the release of the mutex. Yet, the callback to wake up
> never comes when using GFS, so your process will hang indefinitely.
> That one took us at least 3 weeks to figure out ;)
>
> Besides from those little things, cyrus works on top of the GFS just
> fine, you probably need to tweak some tuning parameters, but I don't
> remember them right now, if you need them, I can look them up for you.
>
> The performance is nothing to brag about, though, cyrus and GFS just
> don't play that well together. But I got the performance I needed
> (around 15 logins per second with three nodes using a loadbalancer),
> which is sufficient for our needs. The added reliability is nice,
> though, as you can turn off one node, and the whole thing still works.
>
> I don't know if you have any experience using RedHat Cluster, but be
> absolutely sure to understand about fencing and quorum of the cluster
> before you start any configuration. Cluster software is by no means
> really easy to use, IMO, and everything you do needs some extra
> thinking if you are just used working with single nodes normally :)
>
> Just try your luck, and if you have any questions, just ask.
>
> Jens
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>

From Rudy.Gevaert at UGent.be  Tue Sep  9 13:57:51 2008
From: Rudy.Gevaert at UGent.be (Rudy Gevaert)
Date: Tue, 09 Sep 2008 19:57:51 +0200
Subject: snmp monitoring two cyrus instances on one machine
In-Reply-To: <C840FCBF46507C0A99B00DA8@tyrion.rrz.uni-koeln.de>
References: <48C53C35.9050706@UGent.be>
	<C840FCBF46507C0A99B00DA8@tyrion.rrz.uni-koeln.de>
Message-ID: <48C6B91F.20102@UGent.be>

Sebastian Hagedorn wrote:
> --On 8. September 2008 16:52:37 +0200 Rudy Gevaert 
> <Rudy.Gevaert at UGent.be> wrote:
> 
>> Some time ago I tried to get snmp monitoring of my cyrus installation.
>> I got stuck back then and gave up.
>>
>> Today I tried again and surprisingly I managed to get a lot farther.  I
>> can read out the snmp values of 'a' cyrus instances.
>>
>> On each machine I run two cyrus instances.
> 
> Using different IP addresses or just different ports?

different ip's.  But they both connect to /var/run/agentx


>> One master and one replica.
>> However it is not clear how I can distinguish between the master and the
>> replica.
> 
> If they are using different IP addresses I would expect that to work. 
> I'ne never done that myself, though.
> 

Maybe I have overlooked something in the snmp output, but I can't see 
anything that specifies the backend.

Thanks in advance,


-- 
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --
Rudy Gevaert          Rudy.Gevaert at UGent.be          tel:+32 9 264 4734
Directie ICT, afd. Infrastructuur  Direction ICT, Infrastructure dept.
Groep Systemen                     Systems group
Universiteit Gent                  Ghent University
Krijgslaan 281, gebouw S9, 9000 Gent, Belgie               www.UGent.be
-- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- --

From wes at umich.edu  Tue Sep  9 14:03:13 2008
From: wes at umich.edu (Wesley Craig)
Date: Tue, 9 Sep 2008 14:03:13 -0400
Subject: ssl client certificates
In-Reply-To: <1220965088.17470.23.camel@admc.win-rar.local>
References: <1220965088.17470.23.camel@admc.win-rar.local>
Message-ID: <6992DCF0-9EC7-44E3-86FD-AFBE8A51DBE5@umich.edu>

I haven't tried it, but it's certainly meant to.  The name of the  
user should be in the CN attribute of the subject certificate.

:wes

On 09 Sep 2008, at 08:58, Johannes Ru?ek wrote:
> so cyrus does support ssl client certificates (otherwise there  
> wouldn't
> be errors such as "TLS server engine: No CA file
> specified. Client side certs may not work"), but can i use client  
> certs
> as a replacement to username/password logins? e.g. use the cert to map
> the x509 subject to the username of the user?

From flathill at netspring.co.jp  Wed Sep 10 02:38:45 2008
From: flathill at netspring.co.jp (Seiichirou Hiraoka)
Date: Wed, 10 Sep 2008 15:38:45 +0900 (JST)
Subject: Japanese official ML for cyrus
Message-ID: <20080910.153845.112612681.flathill@netspring.co.jp>

Hi,

Is there Japanese official ML concerning Cyrus-IMAP?
Is it scheduled to make it from lists.andrew.cmu.edu
in the future in case of not being?

If it doesn't schedule, I think I will make it by myself.

Best regards. 

- flathill

From lists at norrbring.se  Wed Sep 10 03:29:13 2008
From: lists at norrbring.se (Anders Norrbring)
Date: Wed, 10 Sep 2008 09:29:13 +0200
Subject: Hints for Sieve script
Message-ID: <48C77749.1010401@norrbring.se>

Hi..
I need a hint on how to put together a Sieve script.

Basically, I want a vacation rule to be in effect first of all, that's 
no problem to make.
Then, I want the incoming mail to be permanently deleted after the 
vacation note is sent.

It's the last step I need a hint for..

Thanks!
Anders.

From obata at lins.jp  Wed Sep 10 04:48:45 2008
From: obata at lins.jp (OBATA Akio)
Date: Wed, 10 Sep 2008 17:48:45 +0900
Subject: Japanese official ML for cyrus
In-Reply-To: <20080910.153845.112612681.flathill@netspring.co.jp>
References: <20080910.153845.112612681.flathill@netspring.co.jp>
Message-ID: <op.ug9b3jk1csw9i4@ponkan.lins.jp>

Hi,

On Wed, 10 Sep 2008 15:38:45 +0900, Seiichirou Hiraoka <flathill at netspring.co.jp> wrote:

> Is there Japanese official ML concerning Cyrus-IMAP?
> Is it scheduled to make it from lists.andrew.cmu.edu
> in the future in case of not being?
>
> If it doesn't schedule, I think I will make it by myself.

Where the desire come from?

-- 
OBATA Akio / obata at lins.jp


From russek at win-rar.com  Wed Sep 10 07:48:22 2008
From: russek at win-rar.com (Johannes =?ISO-8859-1?Q?Ru=DFek?=)
Date: Wed, 10 Sep 2008 13:48:22 +0200
Subject: ssl client certificates
In-Reply-To: <6992DCF0-9EC7-44E3-86FD-AFBE8A51DBE5@umich.edu>
References: <1220965088.17470.23.camel@admc.win-rar.local>
	<6992DCF0-9EC7-44E3-86FD-AFBE8A51DBE5@umich.edu>
Message-ID: <1221047302.20325.2.camel@admc.win-rar.local>

Hello Wesley,
thanks for the information. I managed to find the code in tls.c and
imapd.c and it seems as if it you were right :) which is good news!
but it's bad news that we use the UID attribute for the "username", and
CN for the actual name (like Johannes Russek in my case). :/
it also doesn't seem to be configurable (yet), so i might check if i can
hack tls.c for that. (would anyone else think this is a good idea? e.g.
to specify the attribute that contains the username/userid used for
cyrus mailstore?
thanks!
johannes


Am Dienstag, den 09.09.2008, 14:03 -0400 schrieb Wesley Craig:
> I haven't tried it, but it's certainly meant to.  The name of the  
> user should be in the CN attribute of the subject certificate.
> 
> :wes
> 
> On 09 Sep 2008, at 08:58, Johannes Ru?ek wrote:
> > so cyrus does support ssl client certificates (otherwise there  
> > wouldn't
> > be errors such as "TLS server engine: No CA file
> > specified. Client side certs may not work"), but can i use client  
> > certs
> > as a replacement to username/password logins? e.g. use the cert to map
> > the x509 subject to the username of the user?
-- 
****************************************************************************
Please vote for WinRAR at the ESWC Epsilon Award 2008.
To vote, go to
https://digiumenterprise.com/answer/?sid=234683&chk=UG3B5W7X
****************************************************************************
****************************************************************************

Best Regards,

Johannes Ru?ek
Linux/UNIX Administration

win.rar GmbH
Schumannstr. 17
10117 Berlin
Germany

www.win-rar.com    (website)
russek at win-rar.com (e-mail)

+49 30 28886758  (tel Zentrale)
+49 30 28884514 (fax)

****************************************************************************
win.rar GmbH Berlin                           |    HR B-Nr. 109885 B
Management: ?nc?l Kaya, Burak Canboy          |    Amtsgericht Charlottenburg
****************************************************************************
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 2616 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080910/d41e081f/attachment.bin 

From dave64 at andrew.cmu.edu  Wed Sep 10 07:59:00 2008
From: dave64 at andrew.cmu.edu (Dave McMurtrie)
Date: Wed, 10 Sep 2008 07:59:00 -0400
Subject: Japanese official ML for cyrus
In-Reply-To: <20080910.153845.112612681.flathill@netspring.co.jp>
References: <20080910.153845.112612681.flathill@netspring.co.jp>
Message-ID: <48C7B684.6060401@andrew.cmu.edu>

Seiichirou Hiraoka wrote:
> Hi,
> 
> Is there Japanese official ML concerning Cyrus-IMAP?
> Is it scheduled to make it from lists.andrew.cmu.edu
> in the future in case of not being?

Good morning,

Carnegie Mellon University does not maintain a Japanese mailing list for 
Cyrus IMAP and there are currently no plans to do so.

Thank you,

Dave

From wes at umich.edu  Wed Sep 10 09:35:59 2008
From: wes at umich.edu (Wesley Craig)
Date: Wed, 10 Sep 2008 09:35:59 -0400
Subject: ssl client certificates
In-Reply-To: <1221047302.20325.2.camel@admc.win-rar.local>
References: <1220965088.17470.23.camel@admc.win-rar.local>
	<6992DCF0-9EC7-44E3-86FD-AFBE8A51DBE5@umich.edu>
	<1221047302.20325.2.camel@admc.win-rar.local>
Message-ID: <D7212C1C-64FE-4E8A-9156-AB561887C09F@umich.edu>

Yes, the code lacks at least the ability to specify aspects of the  
schema.  I also noticed that it's using obsolete APIs, tho I'm not  
sure that's actually a problem.  I'd be happy to work with you to get  
an acceptable patch committed for this code path.

:wes

On 10 Sep 2008, at 07:48, Johannes Ru?ek wrote:
> thanks for the information. I managed to find the code in tls.c and
> imapd.c and it seems as if it you were right :) which is good news!
> but it's bad news that we use the UID attribute for the "username",  
> and
> CN for the actual name (like Johannes Russek in my case). :/
> it also doesn't seem to be configurable (yet), so i might check if  
> i can
> hack tls.c for that. (would anyone else think this is a good idea?  
> e.g.
> to specify the attribute that contains the username/userid used for
> cyrus mailstore?

From toomas.aas at raad.tartu.ee  Thu Sep 11 01:11:05 2008
From: toomas.aas at raad.tartu.ee (Toomas Aas)
Date: Thu, 11 Sep 2008 08:11:05 +0300
Subject: Hints for Sieve script
In-Reply-To: <48C77749.1010401@norrbring.se>
References: <48C77749.1010401@norrbring.se>
Message-ID: <48C8A869.8060803@raad.tartu.ee>

Anders Norrbring wrote:

> Basically, I want a vacation rule to be in effect first of all, that's 
> no problem to make.
> Then, I want the incoming mail to be permanently deleted after the 
> vacation note is sent.
> 
> It's the last step I need a hint for..

I happen to have a script in place for one user which does exactly that. I 
don't know if this is the "perfect" way, but it works:


# Vacation
if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe", 
"list-owner", "list-post", "list-archive", "list-id"], not header 
:comparator "i;ascii-casemap" :is "Precedence" "list,bulk" ) {
     vacation :days 1 :addresses [ "user.name at example.net" ] :subject 
"YOUR VACATION MESSAGE SUBJECT" "YOUR VACATION MESSAGE TEXT";
}

# Discard
if size :over 1 {
     discard;
}

HTH
--
Toomas Aas
... Work is for people who don't know how to fish.

From lists at norrbring.se  Thu Sep 11 01:40:09 2008
From: lists at norrbring.se (Anders Norrbring)
Date: Thu, 11 Sep 2008 07:40:09 +0200
Subject: Hints for Sieve script
In-Reply-To: <48C8A869.8060803@raad.tartu.ee>
References: <48C77749.1010401@norrbring.se> <48C8A869.8060803@raad.tartu.ee>
Message-ID: <48C8AF39.3050506@norrbring.se>

Toomas Aas skrev:
> Anders Norrbring wrote:
>
>> Basically, I want a vacation rule to be in effect first of all, 
>> that's no problem to make.
>> Then, I want the incoming mail to be permanently deleted after the 
>> vacation note is sent.
>>
>> It's the last step I need a hint for..
>
> I happen to have a script in place for one user which does exactly 
> that. I don't know if this is the "perfect" way, but it works:
>
>
> # Vacation
> if allof ( not exists ["list-help", "list-unsubscribe", 
> "list-subscribe", "list-owner", "list-post", "list-archive", 
> "list-id"], not header :comparator "i;ascii-casemap" :is "Precedence" 
> "list,bulk" ) {
>     vacation :days 1 :addresses [ "user.name at example.net" ] :subject 
> "YOUR VACATION MESSAGE SUBJECT" "YOUR VACATION MESSAGE TEXT";
> }
>
> # Discard
> if size :over 1 {
>     discard;
> }
>
> HTH
> -- 
> Toomas Aas
> ... Work is for people who don't know how to fish.

Thanks Toomas,
I was on that track as well, but I wasn't sure whether Sieve was 
strictly sequential or not.. Would not be so good if it executes the 
discard first.. ;-)
But if it works for you, I'll try it for my user as well!

Thanks a lot.
Anders.


From hdembkowski at alcatel-lucent.com  Thu Sep 11 06:30:04 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Thu, 11 Sep 2008 12:30:04 +0200
Subject: Problem with skiplist
Message-ID: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>

Hi,

We are using skiplist for our annotations.db.  And we have big problems
with it. 

We are using tool validate-skiplist
(http://kolab.org/cgi-bin/viewcvs-kolab.cgi/utils/admin/)
to check if annotations.db is fine. Some time ago we got the following
error:

validate-skiplist: Bad node: expected ADD or DELETE at 0x001CFDB4!
(found0x78742F70)

Unfortunately we don't know exact scenario which could cause this
problem. We just 
run validate-skiplist in cron (every one hour) and from time to time we
see such error.

So we found patches to fix some issues (our problems are the same as
described at
http://www.intevation.de/roundup/kolab/issue840) - source can be found
here

http://permalink.gmane.org/gmane.mail.imap.cyrus/28033

However it doesn't help. We still have error 

validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
(found 0x38373033)


We noticed that this error/problem is self repaired. I mean after few
hours everything is fine. 
For example, we had errors  

validate-skiplist -v annotations.db
Skiplist file Version 1.2
Max level: 20
Current level: 17
26549 active items
Log start at 0x002A855C
Last recovery on Tue Aug 26 22:18:33 2008

Checking log part...
validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
(found 0x38373033)


But after few hours 


validate-skiplist -v annotations.db
Skiplist file Version 1.2
Max level: 20
Current level: 17
34415 active items
Log start at 0x003C9ED8
Last recovery on Wed Sep 10 01:10:40 2008

Checking log part...
Found 3830 ADD, 5336 DELETE and 5431 COMMIT nodes in log.

It has been repaired without any actions from our side. Interesting
thing is 
that "Last recovery" has been changed. Do you know what is it? Who
changed it?
Why it is done? When it is done? "Last recovery" suggest that something 
recovered annotations.db. 



Kind Regards,
Henryk Dembkowski

From brong at fastmail.fm  Thu Sep 11 09:02:29 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Thu, 11 Sep 2008 23:02:29 +1000
Subject: Problem with skiplist
In-Reply-To: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
Message-ID: <20080911130229.GA28674@brong.net>

On Thu, Sep 11, 2008 at 12:30:04PM +0200, DEMBKOWSKI, Henryk (Henryk) wrote:
> Hi,
> 
> We are using skiplist for our annotations.db.  And we have big problems
> with it. 
> 
> We are using tool validate-skiplist
> (http://kolab.org/cgi-bin/viewcvs-kolab.cgi/utils/admin/)
> to check if annotations.db is fine. Some time ago we got the following
> error:
> 
> validate-skiplist: Bad node: expected ADD or DELETE at 0x001CFDB4!
> (found0x78742F70)
> 
> Unfortunately we don't know exact scenario which could cause this
> problem. We just 
> run validate-skiplist in cron (every one hour) and from time to time we
> see such error.
> 
> So we found patches to fix some issues (our problems are the same as
> described at
> http://www.intevation.de/roundup/kolab/issue840) - source can be found
> here
> 
> http://permalink.gmane.org/gmane.mail.imap.cyrus/28033
> 
> However it doesn't help. We still have error 
> 
> validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
> (found 0x38373033)
> 
> 
> We noticed that this error/problem is self repaired. I mean after few
> hours everything is fine. 
> For example, we had errors  
> 
> validate-skiplist -v annotations.db
> Skiplist file Version 1.2
> Max level: 20
> Current level: 17
> 26549 active items
> Log start at 0x002A855C
> Last recovery on Tue Aug 26 22:18:33 2008
> 
> Checking log part...
> validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
> (found 0x38373033)
> 
> 
> But after few hours 
> 
> 
> validate-skiplist -v annotations.db
> Skiplist file Version 1.2
> Max level: 20
> Current level: 17
> 34415 active items
> Log start at 0x003C9ED8
> Last recovery on Wed Sep 10 01:10:40 2008
> 
> Checking log part...
> Found 3830 ADD, 5336 DELETE and 5431 COMMIT nodes in log.
> 
> It has been repaired without any actions from our side. Interesting
> thing is 
> that "Last recovery" has been changed. Do you know what is it? Who
> changed it?
> Why it is done? When it is done? "Last recovery" suggest that something 
> recovered annotations.db. 

You really, really want a new version of cyrusdb_skiplist.c!  I
recommend the attached one.  It's 2.3.12 plus the patches that will
go into 2.3.13.

Bron ( there won't be any compatibility issues, just drop it in your
       cyrus-imapd-2.3.12/lib/ directory and rebuild )
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cyrusdb_skiplist.c
Type: text/x-csrc
Size: 60380 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080911/4aa17df8/attachment-0001.bin 

From hdembkowski at alcatel-lucent.com  Thu Sep 11 09:48:25 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Thu, 11 Sep 2008 15:48:25 +0200
Subject: Problem with skiplist
In-Reply-To: <20080911130229.GA28674@brong.net>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net>
Message-ID: <B576524D0905194499F90736CAA2758A01D8ECE2@DEEXC1U03.de.lucent.com>

Bron,

Thank you for help.

Do you think that we should also change linux kernel to  2.6.19.2 or
higher?
As Thomas Jarosch suggested. Or new version of skip list will be enough?

Kind Regards,
Henryk



-----Original Message-----
From: Bron Gondwana [mailto:brong at fastmail.fm] 
Sent: Thursday, September 11, 2008 3:02 PM
To: DEMBKOWSKI, Henryk (Henryk)
Cc: info-cyrus at lists.andrew.cmu.edu; cyrus-devel at lists.andrew.cmu.edu;
ZAKRZEWSKI, Marcin (Marcin); ILNICKI, Waldek (Waldek)
Subject: Re: Problem with skiplist

On Thu, Sep 11, 2008 at 12:30:04PM +0200, DEMBKOWSKI, Henryk (Henryk)
wrote:
> Hi,
> 
> We are using skiplist for our annotations.db.  And we have big 
> problems with it.
> 
> We are using tool validate-skiplist
> (http://kolab.org/cgi-bin/viewcvs-kolab.cgi/utils/admin/)
> to check if annotations.db is fine. Some time ago we got the following
> error:
> 
> validate-skiplist: Bad node: expected ADD or DELETE at 0x001CFDB4!
> (found0x78742F70)
> 
> Unfortunately we don't know exact scenario which could cause this 
> problem. We just run validate-skiplist in cron (every one hour) and 
> from time to time we see such error.
> 
> So we found patches to fix some issues (our problems are the same as 
> described at
> http://www.intevation.de/roundup/kolab/issue840) - source can be found

> here
> 
> http://permalink.gmane.org/gmane.mail.imap.cyrus/28033
> 
> However it doesn't help. We still have error
> 
> validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
> (found 0x38373033)
> 
> 
> We noticed that this error/problem is self repaired. I mean after few 
> hours everything is fine.
> For example, we had errors
> 
> validate-skiplist -v annotations.db
> Skiplist file Version 1.2
> Max level: 20
> Current level: 17
> 26549 active items
> Log start at 0x002A855C
> Last recovery on Tue Aug 26 22:18:33 2008
> 
> Checking log part...
> validate-skiplist: Bad node: expected ADD or DELETE at 0x002A855C!
> (found 0x38373033)
> 
> 
> But after few hours
> 
> 
> validate-skiplist -v annotations.db
> Skiplist file Version 1.2
> Max level: 20
> Current level: 17
> 34415 active items
> Log start at 0x003C9ED8
> Last recovery on Wed Sep 10 01:10:40 2008
> 
> Checking log part...
> Found 3830 ADD, 5336 DELETE and 5431 COMMIT nodes in log.
> 
> It has been repaired without any actions from our side. Interesting 
> thing is that "Last recovery" has been changed. Do you know what is 
> it? Who changed it?
> Why it is done? When it is done? "Last recovery" suggest that 
> something recovered annotations.db.

You really, really want a new version of cyrusdb_skiplist.c!  I
recommend the attached one.  It's 2.3.12 plus the patches that will go
into 2.3.13.

Bron ( there won't be any compatibility issues, just drop it in your
       cyrus-imapd-2.3.12/lib/ directory and rebuild )

From dbucherml at hsolutions.ch  Thu Sep 11 14:16:35 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Thu, 11 Sep 2008 20:16:35 +0200
Subject: lmtpunix: DBERROR db4: Logging region out of memory; you may need
	to increase its size
Message-ID: <48C96083.2090504@hsolutions.ch>

Hello,

I know this problem has been answered on different lists, but I don't 
understand what to do to correct it ?

lmtpunix[16846]: DBERROR db4: Logging region out of memory; you may need 
to increase its size

If anyone could tell me exactly which commands or config to use it would 
be great !

Thanks a lot !

Denis

From dbucherml at hsolutions.ch  Thu Sep 11 14:19:02 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Thu, 11 Sep 2008 20:19:02 +0200
Subject: lmtpunix: DBERROR db4: Logging region out of memory; you may
	need to increase its size
In-Reply-To: <48C96083.2090504@hsolutions.ch>
References: <48C96083.2090504@hsolutions.ch>
Message-ID: <48C96116.6070703@hsolutions.ch>

Denis BUCHER a ?crit :
> I know this problem has been answered on different lists, but I don't 
> understand what to do to correct it ?
> 
> lmtpunix[16846]: DBERROR db4: Logging region out of memory; you may need 
> to increase its size
> 
> If anyone could tell me exactly which commands or config to use it would 
> be great !

These are the complete logs :

Sep 11 20:05:35 host lmtpunix[16846]: DBERROR db4: Logging region out of 
memory; you may need to increase its size

Sep 11 20:05:35 host lmtpunix[16846]: DBERROR: opening 
/var/lib/imap/deliver.db: Cannot allocate memory

Sep 11 20:05:35 host lmtpunix[16846]: DBERROR: opening 
/var/lib/imap/deliver.db: cyrusdb error

Sep 11 20:05:35 host lmtpunix[16846]: FATAL: lmtpd: unable to init 
duplicate delivery database

Denis

From dbucherml at hsolutions.ch  Thu Sep 11 14:30:22 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Thu, 11 Sep 2008 20:30:22 +0200
Subject: [slapd] db_equality_candidates index_param failed
Message-ID: <48C963BE.1080208@hsolutions.ch>

Hello !

My cyrus-slapd config work now perfectly but I have some strange 
messages in the logs that I would like to understand/correct :

* bdb_equality_candidates: (accountStatus) index_param failed (18)
* bdb_equality_candidates: (virtualdomain) index_param failed (18)
* bdb_equality_candidates: (description) index_param failed (18)

This is exactly ONE session where one of our users 
(description=dbucher at ourcompany.ch) is sending a mail to the outside 
world (dbucher at destdomain.ch).

If someone would be nice enough to explain me exactly what it means, of 
course I know it's more a LDAP question, therefore sorry if it should 
not be posted here...

Thanks a lot

Denis


Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1273 BIND anonymous 
mech=implicit ssf=0
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1273 BIND 
dn="cn=mailadmin,ou=mailservices,dc=ourcompany,dc=ch" method=128
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1273 BIND 
dn="cn=mailadmin,ou=mailservices,dc=ourcompany,dc=ch" mech=SIMPLE ssf=0
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1273 RESULT tag=97 
err=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1274 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(|(&(objectClass=CourierMailAccount)(mail=dbucher at ourcompany.ch)(accountStatus=active))(&(cn=mailadmin)(description=dbucher at ourcompany.ch)))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1274 SRCH attr=dn
Sep 11 20:19:29 mailhost slapd[2099]: <= bdb_equality_candidates: 
(accountStatus) index_param failed (18)
Sep 11 20:19:29 mailhost slapd[2099]: <= bdb_equality_candidates: 
(description) index_param failed (18)
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1274 SEARCH RESULT 
tag=101 err=0 nentries=1 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1275 BIND anonymous 
mech=implicit ssf=0
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1275 BIND 
dn="cn=dbucher,ou=users,ou=ourcompany.ch,ou=mailservices,dc=ourcompany,dc=ch" 
method=128
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1275 BIND 
dn="cn=dbucher,ou=users,ou=ourcompany.ch,ou=mailservices,dc=ourcompany,dc=ch" 
mech=SIMPLE ssf=0
Sep 11 20:19:29 mailhost slapd[2099]: conn=21436 op=1275 RESULT tag=97 
err=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=4 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierMailAlias)(mail=dbucher at destdomain.ch)(accountStatus=active))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=4 SRCH attr=maildrop
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=4 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=5 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierMailAlias)(mail=@destdomain.ch)(accountStatus=active))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=5 SRCH attr=maildrop
Sep 11 20:19:29 mailhost slapd[2099]: conn=24035 op=5 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=4 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierMailAlias)(mail=dbucher at destdomain.ch)(accountStatus=active))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=4 SRCH attr=maildrop
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=4 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=5 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierMailAlias)(mail=@destdomain.ch)(accountStatus=active))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=5 SRCH attr=maildrop
Sep 11 20:19:29 mailhost slapd[2099]: conn=24036 op=5 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 fd=20 ACCEPT from 
IP=127.0.0.1:41775 (IP=0.0.0.0:389)
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=0 BIND 
dn="cn=mailadmin,ou=mailservices,dc=ourcompany,dc=ch" method=128
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=0 BIND 
dn="cn=mailadmin,ou=mailservices,dc=ourcompany,dc=ch" mech=SIMPLE ssf=0
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=0 RESULT tag=97 
err=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=1 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierMailAlias)(mail=destdomain.ch)(accountStatus=active))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=1 SRCH attr=maildrop
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=1 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=2 SRCH 
base="ou=mailservices,dc=ourcompany,dc=ch" scope=2 deref=0 
filter="(&(objectClass=CourierDomainAlias)(virtualdomain=destdomain.ch))"
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=2 SRCH 
attr=virtualdomain
Sep 11 20:19:29 mailhost slapd[2099]: <= bdb_equality_candidates: 
(virtualdomain) index_param failed (18)
Sep 11 20:19:29 mailhost slapd[2099]: conn=24038 op=2 SEARCH RESULT 
tag=101 err=0 nentries=0 text=
Sep 11 20:19:35 mailhost slapd[2099]: conn=24038 fd=20 closed 
(connection lost)


Denis Bucher

-- 

Denis Bucher   Horus Digital Solutions s?rl  Each problem has a solution
___________________________________________________________________________
    T?l. +41-22-8000625     Fax: +41-22-8000622      www.hsolutions.ch

From dbucherml at hsolutions.ch  Thu Sep 11 14:33:50 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Thu, 11 Sep 2008 20:33:50 +0200
Subject: Very annoying IMAP problem (cyrus + Outlook)
In-Reply-To: <B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>
References: <48AE83E1.3050103@hsolutions.ch>	<alpine.LSU.1.10.0808221200020.30627@hermes-1.csi.cam.ac.uk>
	<48AEC613.1000405@hsolutions.ch> <48BC3991.80008@hsolutions.ch>
	<B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>
Message-ID: <48C9648E.5040404@hsolutions.ch>

Strange but it doesn't appear in the transaction logs.

Anyway, we think we solved the problem by deleting messages marked as 
being deleted ! ("Expunge" AFAIK ?)

I'll keep you posted in case of new information/discoveries/solutions

Denis

Wesley Craig a ?crit :
> On 01 Sep 2008, at 14:50, Denis BUCHER wrote:
>> What should I do next to solve my problem ?
> 
> There are actually a couple of places cyrus might give the fatal error 
> "word too long".  The prot routines should be recording the interactions 
> before passing the data up to the imap layer where the parsing error 
> occurs.  Are there any long lines in your telemetry?  The bad line 
> should directly proceed "* BYE Fatal error: word too long" in the 
> telemetry (if I'm reading imapd's fatal() routine correctly).
> 
> AFAIK, there's nothing to be done other than adjusting the MAXWORD 
> and/or MAXQUOTED limits.  That means upgrading or recompiling the old 
> version that you're on.
> 
> :wes
> 
>> Denis BUCHER a ?crit :
>>> David Carter a ?crit :
>>>> On Fri, 22 Aug 2008, Denis BUCHER wrote:
>>>>> As far as I understand, the cause of the problem is : * "Outlook is
>>>>> sending either a token or quoted string that is longer than 8K bytes."
>>>> Your problem is a mailbox which contains several thousand messages.
>>>> Possibly several thousand messages which Outlook hasn't seen 
>>>> previously.
>>>>
>>>> Outlook tries to construct a single IMAP command of the form:
>>>>
>>>>  UID FETCH uid,uid,uid,... <some set of fields>
>>>>
>>>> where the list of UIDs is larger than 8 KBytes in size.
>>>
>>> Ok that's what I have :
>>>
>>> a) Logs are present
>>> # ls -l /var/lib/imap/log/dbucher
>>> total 2508
>>> -rw------- 1 cyrus mail 355147 Aug 22 14:43 20235
>>> -rw------- 1 cyrus mail   5327 Aug 22 14:43 25058
>>> -rw------- 1 cyrus mail  10654 Aug 22 14:54 25415
>>> -rw------- 1 cyrus mail 355241 Aug 22 15:24 25416
>>> -rw------- 1 cyrus mail 355537 Aug 22 15:03 25417
>>> -rw------- 1 cyrus mail 355147 Aug 22 14:48 25576
>>> -rw------- 1 cyrus mail   5327 Aug 22 14:59 26381
>>> -rw------- 1 cyrus mail   5327 Aug 22 15:04 26763
>>> -rw------- 1 cyrus mail 355443 Aug 22 15:15 26765
>>> -rw------- 1 cyrus mail   5327 Aug 22 15:09 27095
>>> -rw------- 1 cyrus mail   5327 Aug 22 15:14 27752
>>> -rw------- 1 cyrus mail 360146 Aug 22 15:19 28135
>>> -rw------- 1 cyrus mail   5327 Aug 22 15:24 28463
>>> -rw------- 1 cyrus mail   5327 Aug 22 15:29 29125
>>> -rw------- 1 cyrus mail 355147 Aug 22 15:29 29127
>>>
>>> b) That's the UID FETCH :
>>> # grep "UID FETCH" *
>>> 20235:<1219408982<jbf7 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 20235:<1219408982<eke2 UID FETCH 1:7135 (UID FLAGS)
>>> 25416:<1219411440<kb1u UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 25416:<1219411440<qv47 UID FETCH 1:7135 (UID FLAGS)
>>> 25417:<1219409521<1ozq UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 25417:<1219409521<h7ki UID FETCH 1:7135 (UID FLAGS)
>>> 25576:<1219409287<ukf6 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 25576:<1219409287<9vks UID FETCH 1:7135 (UID FLAGS)
>>> 26765:<1219410214<y8b2 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 26765:<1219410214<b685 UID FETCH 1:7135 (UID FLAGS)
>>> 28135:<1219411131<7bfi UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 28135:<1219411131<dkkx UID FETCH 1:7135 (UID FLAGS)
>>> 29127:<1219411745<4g4y UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>> BODY.PEEK[HEADER] INTERNALDATE)
>>> 29127:<1219411745<cos6 UID FETCH 1:7135 (UID FLAGS)
>>>
>>> c) Most sessions in the logs seem to finish correctly :
>>> ...
>>> <1219411787<DONE
>>> ZZZZ LOGOUT
>>>> 1219411787>5mk6 OK Completed
>>> * BYE LOGOUT received
>>> ZZZZ OK Completed
>>>
>>> d) But not all :
>>> ==> 30887 <==
>>>> 1219413279>91rc OK Completed
>>> <1219413279<6leo IDLE
>>>> 1219413279>+ idling
>>> <1219413343<DONE
>>>> 1219413343>6leo OK Completed
>>> <1219413343<351h UID STORE 7136 +FLAGS (\Deleted \Seen)
>>>> 1219413343>* 7136 FETCH (FLAGS (\Deleted \Seen) UID 7136)
>>> 351h OK Completed
>>> <1219413343<dpau IDLE
>>>> 1219413343>+ idling
>>> [end of file]
>>>
>>> e) And there are many "Fatal error: word too long" but not with same
>>> number...
>>> Aug 22 14:43:03 atlantic imaps[25050]: Fatal error: word too long
>>> Aug 22 14:48:08 atlantic imaps[25063]: Fatal error: word too long
>>> Aug 22 14:53:24 atlantic imaps[17518]: Fatal error: word too long
>>> Aug 22 14:58:28 atlantic imaps[26379]: Fatal error: word too long
>>> Aug 22 15:03:34 atlantic imaps[26776]: Fatal error: word too long
>>> Aug 22 15:08:40 atlantic imaps[27118]: Fatal error: word too long
>>> Aug 22 15:13:45 atlantic imaps[27749]: Fatal error: word too long
>>> Aug 22 15:18:51 atlantic imaps[27174]: Fatal error: word too long
>>> Aug 22 15:24:01 atlantic imaps[28464]: Fatal error: word too long
>>> Aug 22 15:29:06 atlantic imaps[29123]: Fatal error: word too long
>>>
>>> Normally the watched account having had "Fatal error", I should find a
>>> fatal error in the transactions logs ? Or is nothing written in case of
>>> a Fatal error ? (Which I hope not ;-)
> 


Denis Bucher

-- 

Denis Bucher   Horus Digital Solutions s?rl  Each problem has a solution
___________________________________________________________________________
    T?l. +41-22-8000625     Fax: +41-22-8000622      www.hsolutions.ch

From pnfisher at berkeley.edu  Thu Sep 11 17:57:32 2008
From: pnfisher at berkeley.edu (Paul Fisher)
Date: Thu, 11 Sep 2008 14:57:32 -0700
Subject: Problem with skiplist
In-Reply-To: <20080911130229.GA28674@brong.net>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net>
Message-ID: <48C9944C.6080703@berkeley.edu>

Bron Gondwana wrote:
> 
> You really, really want a new version of cyrusdb_skiplist.c!  I
> recommend the attached one.  It's 2.3.12 plus the patches that will
> go into 2.3.13.

On a somewhat related note, we're planning to upgrade our production
Cyrus cluster tomorrow evening from 2.3.7 to 2.3.12p2 with a handful
of patches.  While skiplist has been mostly good to us in 2.3.7, we
had been planning to apply the following skiplist patches:

     cyrus-skiplist-locking-rework-2.3.12.diff
     cyrus-skiplist-safeunlock-2.3.12.diff

The code attached to your most recent message includes
"cyrus-skiplist-tuning-2.3.10.diff", which had not previously been
mentioned as an upstream candidate for 2.3.13, as well as a change to
"struct txn" to add "*next_txn" (and related code) that doesn't appear
to be part of the current set of FastMail patches or CVSHEAD.

Could you expand a bit on what skiplist code you're planning to push
upstream for 2.3.13?

Thanks,

Paul

From brong at fastmail.fm  Thu Sep 11 19:00:16 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Fri, 12 Sep 2008 09:00:16 +1000
Subject: Problem with skiplist
In-Reply-To: <48C9944C.6080703@berkeley.edu>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net> <48C9944C.6080703@berkeley.edu>
Message-ID: <20080911230016.GA9388@brong.net>

On Thu, Sep 11, 2008 at 02:57:32PM -0700, Paul Fisher wrote:
> Bron Gondwana wrote:
>>
>> You really, really want a new version of cyrusdb_skiplist.c!  I
>> recommend the attached one.  It's 2.3.12 plus the patches that will
>> go into 2.3.13.
>
> On a somewhat related note, we're planning to upgrade our production
> Cyrus cluster tomorrow evening from 2.3.7 to 2.3.12p2 with a handful
> of patches.  While skiplist has been mostly good to us in 2.3.7, we
> had been planning to apply the following skiplist patches:
>
>     cyrus-skiplist-locking-rework-2.3.12.diff
>     cyrus-skiplist-safeunlock-2.3.12.diff
>
> The code attached to your most recent message includes
> "cyrus-skiplist-tuning-2.3.10.diff", which had not previously been
> mentioned as an upstream candidate for 2.3.13, as well as a change to
> "struct txn" to add "*next_txn" (and related code) that doesn't appear
> to be part of the current set of FastMail patches or CVSHEAD.
>
> Could you expand a bit on what skiplist code you're planning to push
> upstream for 2.3.13?


Oops - you're right!  I'll repost with that taken out.  I must have
pushed the entire quilt series by mistake rather than just the patches
that are going upstream...  so much for doing stuff late at night.

I haven't updated the FastMail patches website yet - the new patch
in there is the nested-transactions, which isn't heavily tested yet.

That said - the one I posted is stable as well, we're running it in
production with all those patches - but what I'm pushing for 2.3.13
is just those two patches you mentioned above.  Here's a copy of
cyrusdb_skiplist.c with just those two.

Bron.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cyrusdb_skiplist.c
Type: text/x-csrc
Size: 59724 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080912/55c5a55f/attachment-0001.bin 

From brong at fastmail.fm  Thu Sep 11 19:11:02 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Fri, 12 Sep 2008 09:11:02 +1000
Subject: Problem with skiplist
In-Reply-To: <B576524D0905194499F90736CAA2758A01D8ECE2@DEEXC1U03.de.lucent.com>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net>
	<B576524D0905194499F90736CAA2758A01D8ECE2@DEEXC1U03.de.lucent.com>
Message-ID: <20080911231102.GB9388@brong.net>

On Thu, Sep 11, 2008 at 03:48:25PM +0200, DEMBKOWSKI, Henryk (Henryk) wrote:
> Bron,
> 
> Thank you for help.

No problem.

You may have noticed, I sent the wrong version of cyrusdb_skiplist.c.
The one I sent was still stable, but had two more patches that aren't
candidates for upstream at this point.

I've posted the new version to the list now.

> Do you think that we should also change linux kernel to  2.6.19.2 or
> higher?

Yes.  That's getting pretty old!  We're running 2.6.26.1 on most of
our servers.  In particular, there's a nasty mmap bug on 64 bit for
quite a few earlier versions.  .22 => .25 are quite broken.  My bug
report to LKML triggered quite a flamewar about it, and Linus came up
with a patch that worked nicely.

Ahh, I see the thread you referenced has a link to my post.

On the other hand:

"VM: Fix nasty and subtle race in shared mmap'ed page writeback"

This is unlikely to be the cause.  Cyrus doesn't use mmap writes,
only reads.  While we don't run kernels that old any more, the
skiplist problems are much more likely to be related to bugs in
the older skiplist code than kernel issues.

Bron.
 

From flathill at netspring.co.jp  Thu Sep 11 21:54:53 2008
From: flathill at netspring.co.jp (Seiichirou Hiraoka)
Date: Fri, 12 Sep 2008 10:54:53 +0900 (JST)
Subject: Japanese official ML for cyrus
In-Reply-To: <48C7B684.6060401@andrew.cmu.edu>
References: <20080910.153845.112612681.flathill@netspring.co.jp>
	<48C7B684.6060401@andrew.cmu.edu>
Message-ID: <20080912.105453.21916554.flathill@netspring.co.jp>

Hello Dave,

Thank you for your reply.
I will announce when I start Japanese mailing list
about cyrus.

Best regards,

- flathill

From: Dave McMurtrie <dave64 at andrew.cmu.edu>
Subject: Re: Japanese official ML for cyrus
Date: Wed, 10 Sep 2008 07:59:00 -0400

> Seiichirou Hiraoka wrote:
> > Hi,
> > 
> > Is there Japanese official ML concerning Cyrus-IMAP?
> > Is it scheduled to make it from lists.andrew.cmu.edu
> > in the future in case of not being?
> 
> Good morning,
> 
> Carnegie Mellon University does not maintain a Japanese mailing list for 
> Cyrus IMAP and there are currently no plans to do so.
> 
> Thank you,
> 
> Dave

From flathill at netspring.co.jp  Thu Sep 11 22:09:09 2008
From: flathill at netspring.co.jp (Seiichirou Hiraoka)
Date: Fri, 12 Sep 2008 11:09:09 +0900 (JST)
Subject: Can I use Intermediate SSL server certificate?
Message-ID: <20080912.110909.28800445.flathill@netspring.co.jp>

Hello,

Now, I use SSL server certificate without
intermediate certificate.

Nowadays, only the intermediate SSL server certificate
will be published in Verisign.

Please teach me if there is a method of using the
intermediate certificate with Cyrus.

Bests regards,

- flathill

From simon.matter at invoca.ch  Fri Sep 12 02:38:33 2008
From: simon.matter at invoca.ch (Simon Matter)
Date: Fri, 12 Sep 2008 08:38:33 +0200 (CEST)
Subject: Problem with skiplist
In-Reply-To: <20080911230016.GA9388@brong.net>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net> <48C9944C.6080703@berkeley.edu>
	<20080911230016.GA9388@brong.net>
Message-ID: <0254d5f8e954632cf1ad7124aeb2ee76.squirrel@webmail.bi.corp.invoca.ch>

> On Thu, Sep 11, 2008 at 02:57:32PM -0700, Paul Fisher wrote:
>> Bron Gondwana wrote:
>>>
>>> You really, really want a new version of cyrusdb_skiplist.c!  I
>>> recommend the attached one.  It's 2.3.12 plus the patches that will
>>> go into 2.3.13.
>>
>> On a somewhat related note, we're planning to upgrade our production
>> Cyrus cluster tomorrow evening from 2.3.7 to 2.3.12p2 with a handful
>> of patches.  While skiplist has been mostly good to us in 2.3.7, we
>> had been planning to apply the following skiplist patches:
>>
>>     cyrus-skiplist-locking-rework-2.3.12.diff
>>     cyrus-skiplist-safeunlock-2.3.12.diff
>>
>> The code attached to your most recent message includes
>> "cyrus-skiplist-tuning-2.3.10.diff", which had not previously been
>> mentioned as an upstream candidate for 2.3.13, as well as a change to
>> "struct txn" to add "*next_txn" (and related code) that doesn't appear
>> to be part of the current set of FastMail patches or CVSHEAD.
>>
>> Could you expand a bit on what skiplist code you're planning to push
>> upstream for 2.3.13?
>
>
> Oops - you're right!  I'll repost with that taken out.  I must have
> pushed the entire quilt series by mistake rather than just the patches
> that are going upstream...  so much for doing stuff late at night.
>
> I haven't updated the FastMail patches website yet - the new patch
> in there is the nested-transactions, which isn't heavily tested yet.
>
> That said - the one I posted is stable as well, we're running it in
> production with all those patches - but what I'm pushing for 2.3.13
> is just those two patches you mentioned above.  Here's a copy of
> cyrusdb_skiplist.c with just those two.

I have included both patches into our rpm packages some days ago and it
seems to do well. Just to mention a positive feedback.

Simon


From hdembkowski at alcatel-lucent.com  Fri Sep 12 09:48:36 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Fri, 12 Sep 2008 15:48:36 +0200
Subject: Last recovery
Message-ID: <B576524D0905194499F90736CAA2758A01D8F02B@DEEXC1U03.de.lucent.com>

Hi,

We are using tool validate-skiplist
(http://kolab.org/cgi-bin/viewcvs-kolab.cgi/utils/admin/)
to check if annotations.db is fine. Tool validate-skiplist returns
output like this

> validate-skiplist -v annotations.db
> Skiplist file Version 1.2
> Max level: 20
> Current level: 17
> 34415 active items
> Log start at 0x003C9ED8
> Last recovery on Wed Sep 10 01:10:40 2008
> 
> Checking log part...
> Found 3830 ADD, 5336 DELETE and 5431 COMMIT nodes in log.


We noticed that sometimes database is corrupted/repaired just after
"Last recovery" is changed. 
It seems that something is done which causes that database is
repaired/corrupted.  Do you know 
what is it?

Kind Regards,
Henryk



From russek at win-rar.com  Fri Sep 12 12:32:27 2008
From: russek at win-rar.com (Johannes =?ISO-8859-1?Q?Ru=DFek?=)
Date: Fri, 12 Sep 2008 18:32:27 +0200
Subject: another one for client certificates
Message-ID: <1221237147.23779.116.camel@admc.win-rar.local>

Hi Guys,
I'm trying to patch tls.c to make it able to pick different attributes
in the client cert to authenticate from and will also try to update the
openssl api in use if i get a bit help there.
if anyone else is using client certs and would lik to use them for cyrus
auth, which attributes would you use?
so far i came up with the current default commonName, the the userId
(UID) and pkcs9 email for virtual domains.
Anything else?
Johannes
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 2616 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080912/a307acf0/attachment.bin 

From adam at morrison-ind.com  Fri Sep 12 16:43:01 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Fri, 12 Sep 2008 16:43:01 -0400
Subject: Problem with skiplist
In-Reply-To: <0254d5f8e954632cf1ad7124aeb2ee76.squirrel@webmail.bi.corp.invoca.ch>
References: <B576524D0905194499F90736CAA2758A01D8EBD2@DEEXC1U03.de.lucent.com>
	<20080911130229.GA28674@brong.net> <48C9944C.6080703@berkeley.edu>
	<20080911230016.GA9388@brong.net>
	<0254d5f8e954632cf1ad7124aeb2ee76.squirrel@webmail.bi.corp.invoca.ch>
Message-ID: <1221252181.5528.13.camel@linux-nnci.site>

> > That said - the one I posted is stable as well, we're running it in
> > production with all those patches - but what I'm pushing for 2.3.13
> > is just those two patches you mentioned above.  Here's a copy of
> > cyrusdb_skiplist.c with just those two.
> I have included both patches into our rpm packages some days ago and it
> seems to do well. Just to mention a positive feedback.

Have you published these fixed packages?


From goetz at shomitefo.de  Fri Sep 12 16:56:36 2008
From: goetz at shomitefo.de (Goetz Babin-Ebell)
Date: Fri, 12 Sep 2008 22:56:36 +0200
Subject: another one for client certificates
In-Reply-To: <1221237147.23779.116.camel@admc.win-rar.local>
References: <1221237147.23779.116.camel@admc.win-rar.local>
Message-ID: <48CAD784.70904@shomitefo.de>

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Johannes Ru?ek wrote:
| Hi Guys,
Hello Johannes,

| I'm trying to patch tls.c to make it able to pick different attributes
| in the client cert to authenticate from and will also try to update the
| openssl api in use if i get a bit help there.
While I'm very short of time (and quite lazy when I do have some),
I'm willing to look into it...

| if anyone else is using client certs and would lik to use them for cyrus
| auth, which attributes would you use?
| so far i came up with the current default commonName, the the userId
| (UID) and pkcs9 email for virtual domains.
| Anything else?

Do you also plan to look into the subjectAltName extension ?


Goetz

- --
DMCA: The greed of the few outweighs the freedom of the many
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.4-svn0 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFIyteD2iGqZUF3qPYRAu8TAJ4hqb/pvY+ClGMxIgNtyoYoshxmLgCePY2Y
Nt/RdmhoHjPUiRn07yyu2xw=
=na5Q
-----END PGP SIGNATURE-----

From emlists at gmail.com  Fri Sep 12 22:34:11 2008
From: emlists at gmail.com (Adam D)
Date: Fri, 12 Sep 2008 19:34:11 -0700
Subject: Issues with user.sub files - leaves imapd running at 99 % of processor
Message-ID: <48CB26A3.6090603@gmail.com>

I have noticed this error in the log:
Sep 12 18:57:44 vts-post cyrus/imap[19629]: IOERROR: locking
/var/lib/cyrus/domain/W/domain1/user/A/userbox.sub: Interrupted system call

Soon afterwards I notice imapd runs at 99.8 % and I can not kill the
process.  It looks like the file is locked and can't be written to?  I
saw another file called userbox.sub.NEW but even that files can't be
read.  When I attempt the terminal freezes.  I also noticed the system
can't be rebooted as well.  I don't know what could be causing this. 
Does anyone have any incite? 

Example:
-rw------- 1 cyrus mail  31K Sep 12 18:22 user.seen
-rw------- 1 cyrus mail  14K May 24 10:21 user.sub
-rw------- 1 cyrus mail 4.0K Sep 11 18:25 user.sub.NEW

I can view user.sub but it has not been updated since May and the
user.sub.NEW apears as an binary file or a DB


  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+ 
COMMAND                                 
19484 cyrus     25   0  154m 4772 3776 R 99.8  0.8   7:51.32 imapd     

-Adam

From adam at morrison-ind.com  Sun Sep 14 08:47:02 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Sun, 14 Sep 2008 08:47:02 -0400
Subject: info correct / quota wrong
Message-ID: <1221396422.8486.19.camel@linux-nnci.site>

After migrating and updating my IMAP server everything seems to working,
but the quota reports wrong information for *SOME* mailboxes, seemingly
at random

cyrus-imapd-2.3.12p2-1 (CentOS5)

The quota value is crazy wrong!

localhost.localdomain> info user.fred
{user.fred}:
  condstore: false
  duplicatedeliver: false
  lastpop:  
  lastupdate: 14-Sep-2008 00:32:16 -0400
  partition: default
  sharedseen: false
  size: 127583

-bash-3.2$ /usr/lib/cyrus-imapd/quota -f  | grep fred
       0          4401742 user.fred

-bash-3.2$ du -sk /var/spool/imap/f/user/fred/
225296	/var/spool/imap/f/user/fred/

I can believe the result of "?user.fred", but the quota report is
clearly wrong.
-- 
          Consonance: an Open Source .NET OpenGroupware client.
 Contact:awilliam at whitemiceconsulting.com   http://freshmeat.net/projects/consonance/


From egoitz at gmail.com  Sun Sep 14 10:36:27 2008
From: egoitz at gmail.com (Egoitz Aurrekoetxea)
Date: Sun, 14 Sep 2008 16:36:27 +0200
Subject: Cyrus IMAP/POP Banner
Message-ID: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>

Hi mates,

I have been googling over there and haven't find the answer to my question
just another man looking for the same as me... I wanted to change the banner
that cyrus imap and pop sends when you connect to them... basically the
server greeting... I think it could be quite dangerous to show the version
you're running... even the server you're running. Please could be anyway of
doing this? how could I get my goal? For example when you telnet to port 110
or 143 to be shown :

+OK IMAP Server

and nothing else....


bye!!! zenkz!!!

-- 
Egoitz Aurrekoetxea
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080914/ffa836d8/attachment.html 

From egoitz at gmail.com  Sun Sep 14 11:12:21 2008
From: egoitz at gmail.com (Egoitz Aurrekoetxea)
Date: Sun, 14 Sep 2008 17:12:21 +0200
Subject: Cyrus IMAP and saslauthd
Message-ID: <136f2cf30809140812n6e6a9701vdfc1201e97df1a21@mail.gmail.com>

Hi mates,

I'm running Cyrus IMAP without saslauthd with cyrus-sasl library at this
moment and integrated with Postfix. The OS I'm running is FreeBSD... it has
taken me sometime to set up this testing server... I have tried several
times to set cyrus imap auth against saslauthd... I can't get my goal so now
have had to switch to auxprop with mysql... but this IMHO has a little
disadvantage... with saslauthd and X number of procceses forked you have
like a "pool" of connections (what in postfix config is called proxy daemon
too) but without saslauthd and with bulk connections to database through
auxprop perhaps you could cause DOS to you're mysql server if you receive a
dictionarie attack for example... I have read that it's possible to set
saslauthd with mysql BUT without crypted passwords on database... that
wouldn't mind me... could you please advise some howto or doc please? All
doc I found is for being set up with crypted passwords and through pam...
but this has run me into some troubles in freebsd... because I think
pam-mysql doesn't work quite nice on freebsd... so could you please advise
me some doc or howto setup cyrus imap and postfix auth through saslauthd? I
think it's a concept problem because I don't understand quite well how
saslauth works and will config file reads and so...



Zenk really.

-- 
Egoitz Aurrekoetxea
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080914/838f243d/attachment.html 

From adam at morrison-ind.com  Sun Sep 14 11:33:22 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Sun, 14 Sep 2008 11:33:22 -0400
Subject: Cyrus IMAP/POP Banner
In-Reply-To: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>
References: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>
Message-ID: <20080914113322.wyibyqw60ws4kw4w@tyr.morrison.iserv.net>

> I have been googling over there and haven't find the answer to my question
> just another man looking for the same as me... I wanted to change the banner
> that cyrus imap and pop sends when you connect to them... basically the
> server greeting... I think it could be quite dangerous to show the version
> you're running... even the server you're running. Please could be anyway of
> doing this? how could I get my goal? For example when you telnet to port 110
> or 143 to be shown :
> +OK IMAP Server
> and nothing else....

man imapd.conf
<quote>
serverinfo: on

The  server  information to display in the greeting and capability
responses. Information is displayed as follows:

"off" = no server information in the greeting or capabilities
"min" = servername in the greeting; no server information  in  the
capabilities
"on"  =  servername  and  product version in the greeting; product
version in the capabilities

Allowed values: off, min, on
</quote>


From adam at morrison-ind.com  Sun Sep 14 12:33:19 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Sun, 14 Sep 2008 12:33:19 -0400
Subject: info correct / quota wrong
In-Reply-To: <1221396422.8486.19.camel@linux-nnci.site>
References: <1221396422.8486.19.camel@linux-nnci.site>
Message-ID: <20080914123319.57ae5ocklccosswo@tyr.morrison.iserv.net>

Quoting Adam Tauno Williams <adam at morrison-ind.com>:
> After migrating and updating my IMAP server everything seems to working,
> but the quota reports wrong information for *SOME* mailboxes, seemingly
> at random
> cyrus-imapd-2.3.12p2-1 (CentOS5)
> The quota value is crazy wrong!
> localhost.localdomain> info user.fred
> {user.fred}:
>   condstore: false
>   duplicatedeliver: false
>   lastpop:
>   lastupdate: 14-Sep-2008 00:32:16 -0400
>   partition: default
>   sharedseen: false
>   size: 127583
> -bash-3.2$ /usr/lib/cyrus-imapd/quota -f  | grep fred
>        0          4401742 user.fred
> -bash-3.2$ du -sk /var/spool/imap/f/user/fred/
> 225296	/var/spool/imap/f/user/fred/
> I can believe the result of "?user.fred", but the quota report is
> clearly wrong.

I've force complete recreation of the cyrus quota database;  and it  
has come up with the same numbers.


service cyrus-imapd stop

[root at sardine imap]# pwd
/var/lib/imap
[root at sardine imap]# rm -f ./db.backup2/quotas.db ./quotas.db  
./db.backup1/quotas.db

service cyrus-imapd stop


From dwhite at olp.net  Sun Sep 14 15:09:05 2008
From: dwhite at olp.net (Dan White)
Date: Sun, 14 Sep 2008 14:09:05 -0500
Subject: Cyrus IMAP and saslauthd
In-Reply-To: <136f2cf30809140812n6e6a9701vdfc1201e97df1a21@mail.gmail.com>
References: <136f2cf30809140812n6e6a9701vdfc1201e97df1a21@mail.gmail.com>
Message-ID: <48CD6151.4040500@olp.net>

Egoitz Aurrekoetxea wrote:
> Hi mates,
>
> I'm running Cyrus IMAP without saslauthd with cyrus-sasl library at 
> this moment and integrated with Postfix. The OS I'm running is 
> FreeBSD... it has taken me sometime to set up this testing server... I 
> have tried several times to set cyrus imap auth against saslauthd... I 
> can't get my goal so now have had to switch to auxprop with mysql... 
> but this IMHO has a little disadvantage... with saslauthd and X number 
> of procceses forked you have like a "pool" of connections (what in 
> postfix config is called proxy daemon too) but without saslauthd and 
> with bulk connections to database through auxprop perhaps you could 
> cause DOS to you're mysql server if you receive a dictionarie attack 
> for example... I have read that it's possible to set saslauthd with 
> mysql BUT without crypted passwords on database... that wouldn't mind 
> me... could you please advise some howto or doc please? All doc I 
> found is for being set up with crypted passwords and through pam... 
> but this has run me into some troubles in freebsd... because I think 
> pam-mysql doesn't work quite nice on freebsd... so could you please 
> advise me some doc or howto setup cyrus imap and postfix auth through 
> saslauthd? I think it's a concept problem because I don't understand 
> quite well how saslauth works and will config file reads and so...
Egoitz,

See the man page for saslauthd for available saslauthd backend mechanisms.

Other than PAM, you may be able to use nss-mysql along with the getpwent 
or shadow backends.

saslauthd is also documented in 'doc/sysadmin.html' in the sasl source.

- Dan

From egoitz at gmail.com  Sun Sep 14 21:33:32 2008
From: egoitz at gmail.com (Egoitz Aurrekoetxea)
Date: Mon, 15 Sep 2008 03:33:32 +0200
Subject: Problem with pam_mysql, saslauthd and ONLY imap
Message-ID: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>

Hi mates!!


Well some days and hours now testing cyrus... lol; well the problem is that
I have decided to try auth throgh pam_mysql with saslauthd... it works for
postfix smtp auth and for pop3. When you do a testsaslauthd or try to login
via IMAP it does't work... it sais :

In auth.log :
Sep 15 02:27:45 correopiloto imap[1741]: sql_select option missing
Sep 15 02:27:45 correopiloto imap[1741]: auxpropfunc error no mechanism
available
Sep 15 02:27:45 correopiloto saslauthd[1216]: do_auth         : auth
failure: [user=egoitz at ramattack.net] [service=imap] [realm=ramattack.net]
[mech=pam] [reason=PAM auth error]

In messages :

Sep 15 02:27:45 correopiloto imap[1741]: sql_select option missing
Sep 15 02:27:45 correopiloto imap[1741]: auxpropfunc error no mechanism
available
Sep 15 02:27:45 correopiloto imap[1741]: badlogin: localhost [127.0.0.1]
plaintext egoitz at ramattack.net SASL(-13): authentication failure: checkpass
failed

It's like it hadn't been compiled for using saslauthd... but... cyrus pop3
works fine (and you know imap and pop share config file...) and Postfix
smtpd auth too!!

If in the file I set pwcheck to auxprop and uncomment the end sasl_sql lines
it works nice!! but if I try to use saslauthd doesn't work and can't loging
too through cyradm... Any help is apreciated please....


The config file is :

# $FreeBSD: ports/mail/cyrus-imapd23/files/imapd.conf,v 1.13 2004/11/22
08:15:15 ume Exp $
#
# Sample configurations file for Cyrus IMAPd
# Most lines in this file are commented; in this case the default is used.
# The commented lines (usually) contain the default value

# The pathname of the IMAP configuration directory
#
#configdirectory: /var/imap
configdirectory: /expert/correo/imap

# The partition name used by default for new mailboxes
#
#defaultpartition: default

# The directory for the different partitions
#
#partition-default: /var/spool/imap
partition-default: /expert/correo/spool/imap

# Use the UNIX separator character '/' for delimiting levels of
# mailbox hierarchy.  The default is to use the netnews separator
# character '.'.
#unixhierarchysep: no
unixhierarchysep: yes

# Use the alternate IMAP namespace, where personal folders reside at
# the same level in the hierarchy as INBOX.
#
#altnamespace: no
altnamespace: yes

# If using the alternate IMAP namespace, the prefix for the other
# users namespace.  The hierarchy delimiter will be automatically
# appended.
#
#userprefix: Other Users

# If using the alternate IMAP namespace, the prefix for the shared
# namespace.  The hierarchy delimiter will be automatically appended.
#
#sharedprefix: Shared Folders

# The umask value used by various Cyrus IMAP programs
#
#umask: 077

# This is the hostname visible in the greeting messages of the POP,
# IMAP and LMTP daemons. If it is unset, then the result returned from
# gethostname(2) is used.
#
#servername: <result returned by gethostname(2)>

# Whether to allow anonymous logins
#
#allowanonymouslogin: no

# Allow the use of cleartext passwords on the wire.
#
allowplaintext: yes

# The percent  of  quota  utilization  over  which  the server generates
# warnings.
#
quotawarn: 90

# The length of the IMAP server's inactivity autologout timer, in minutes.
# The  minimum  value  is  30,  the default.
#
#timeout: 30

# The interval (in seconds) for polling the mailbox for changes while
# running the IDLE command.  This option is used when idled can not be
# contacted or when polling is used exclusively.  The minimum value is
# 1.  A value of 0 will disable polling (and disable IDLE if polling
# is the only method available).
#
#imapidlepoll: 60

# If enabled, the server responds to an ID command with a parameter
# list containing: version, vendor, support-url, os, os-version,
# command, arguments, environment.  Otherwise the server returns NIL.
#
#imapidresponse: yes

# Set the length of the POP server's inactivity autologout timer, in
# minutes.  The minimum value is 10, the default.
#
#poptimeout: 10

# Set the minimum amount of time the server forces users to wait between
# successive POP logins, in  minutes.  The default is 0.
#
#popminpoll: 0

# The number of days advertised as being the minimum a message may be
# left on the POP server before it is deleted (via the CAPA command,
# defined in the POP3 Extension Mechanism, which some clients may
# support).  "NEVER", the default, may be specified with a negative
# number.  The Cyrus POP3 server never deletes mail, no matter what
# the value of this parameter is.  However, if a site implements a
# less liberal policy, it needs to change this parameter accordingly.
#
#popexpiretime: 0

# The list of userids with administrative rights.  Separate each userid
# with a space.  We recommend that administrator userids be separate from
# standard userids.  Sites using Kerberos authentication may use separate
# "admin" instances.
#
#admins: <none>
admins: cyrus

# A list of users and groups that are allowed to proxy for other
# users, seperated by spaces.  Any user listed in this will be allowed
# to login for any other user: use with caution.
#
#proxyservers: <none>

# The Access Control List (ACL) placed on a newly-created (non-user)
# mailbox that does not have a parent mailbox.
#
#defaultacl: anyone lrs

# The pathname of the news spool directory.  Only used if the partition-news
# configuration option is set.
#
#newsspool: <no default>

# Prefix to be prepended to newsgroup names to make the corresponding IMAP
# mailbox names.
#
#newsprefix: <none>

# If nonzero, normal users may create their own IMAP accounts by creating
# the mailbox INBOX.  The user's quota is set to the value if it is
positive,
# otherwise the user has unlimited quota.
#
#autocreatequota: 0

# Include notations in the protocol telemetry logs indicating the number
# of seconds since the last command or response.
#
#logtimestamps: no

# Number of seconds to pause after a successful plaintext login.  For
systems
# that support strong authentication, this permits users to perceive a cost
# of using plaintext passwords.
#
#plaintextloginpause: 0

# The pathname of srvtab file containing the server's private key.
# This option is passed to the SASL library and overrides its default
# setting.
#
#srvtab: /etc/srvtab

# The list of remote realms whose users may log in using  cross-realm
# authentications.   Seperate each realm name by a space.  This option is
# only used when the server is compiled with Kerberos authentication.
#
#loginrealms: <none>

# If enabled, any authentication identity which has a rights on a user's
# INBOX may log in as that user.  This option is only used when the server
# is compiled with Kerberos authentication.
#
#loginuseacl: no

# If enabled, lmtpd attempts to only write one copy of a message per
# partition and create hard links, resulting in a potentially large
# disk savings.
#
#singleinstancestore: yes

# If enabled, lmtpd will suppress delivery of a message to a mailbox
# if a message with the same message-id (or resent-message-id) is
# recorded as having already been delivered to the mailbox.  Records
# the mailbox and message-id/resent-message-id of all successful
# deliveries.
#
#duplicatesuppression: yes

# If enabled, lmtpd rejects messages with 8-bit characters in the
# headers.  Otherwise, 8-bit characters are changed to `X'.  (A proper
# soultion to non-ASCII characters in headers is offered by RFC 2047
# and its predecessors.)
#
#reject8bit: no

# Maximum incoming LMTP message size.  If set, lmtpd will reject
# messages larger than maxmessagesize bytes.  The default is to allow
# messages of any size.
#
#maxmessagesize: <unlimited>
maxmessagesize: 20971520
lmtp_over_quota_perm_failure: yes

# Userid used to deliver messages to shared folders.  For example, if
# set to "bb", email sent to "bb+shared.blah" would be delivered to
# the "shared.blah" folder.  By default, an email address of
# "+shared.blah" would be used.
#postuser: <none>

# If enabled at compile time, this specifies a URL to reply when
# Netscape asks the server where the mail administration HTTP server
# is.  The default is a site at CMU with a hopefully informative
# message; administrators should set this to a local resource with
# some information of greater use.
#
#netscapeurl: http://andrew2.andrew.cmu.edu/cyrus/imapd/netscapeadmin.html

# Notifyd(8) method to use for "MAIL" notifications.  If not set,
# "MAIL" notifications are disabled.
#
#mailnotifier: <no default>

# Notifyd(8) method to use for "SIEVE" notifications.  If not set,
# "SIEVE" notifications are disabled.
#
# This method is only used when no method is specified in the script.
#
#sievenotifier: <no default>

# If enabled, lmtpd will look for Sieve scripts in user's home
# directories: ~user/.sieve.
#
sieveusehomedir: false

# If sieveusehomedir is false, this directory is searched for Sieve scripts.
# The active Sieve script is s called "default", placed in the users sieve
# sieve directory (ie. /var/imap/sieve/u/user).
#
#sievedir: /var/imap/sieve
sievedir: /expert/correo/imap/sieve

# The pathname of the sendmail executable.  Sieve uses sendmail for
# sending rejections, redirects and vaca- tion responses.
#
#sendmail: /usr/sbin/sendmail

# Username that is used as the 'From' address in rejection MDNs
# produced by sieve.
#
#postmaster: postmaster

# If enabled, the partitions will also be hashed, in addition to the hashing
# done on configuration directories.  This is recommended if one partition
has
# a very bushy mailbox tree.
#
#hashimapspool: false
hashimapspool: true

# Maximum size (in kilobytes) any sieve script can be, enforced at
# submission by timsieved(8).
#
#sieve_maxscriptsize: 32

# Maximum number of sieve scripts any user may have, enforced at
# submission by timsieved(8).
#
#sieve_maxscripts: 5

# The cyrusdb backend to use for mailbox annotations.
# Allowed values: berkeley, skiplist
#
#annotation_db: skiplist

# The cyrusdb backend to use for the duplicate delivery suppression
# and sieve.
# Allowed values: berkeley, berkeley-nosync, skiplist
#
#duplicate_db: berkeley-nosync

# The cyrusdb backend to use for the mailbox list.
# Allowed values: flat, berkeley, skiplist
#
#mboxlist_db: skiplist

# The cyrusdb backend to use for the pts cache.
# Allowed values: berkeley, skiplist
#
#ptscache_db: berkeley

# The cyrusdb backend to use for the seen state.
# Allowed values: flat, berkeley, skiplist
#
#seenstate_db: skiplist

# The cyrusdb backend to use for the subscriptions list.
# Allowed values: flat, berkeley, skiplist
#
#subscription_db: flat

# The cyrusdb backend to use for the TLS cache.
# Allowed values: berkeley, berkeley-nosync, skiplist
#
#tlscache_db: berkeley-nosync

# Maximum SSF (security strength factor) that the server will allow a
# client to negotiate.
#
#sasl_maximum_layer: 256

# The minimum SSF that the server will allow a client to negotiate.  A
# value of 1 requires integrity protection; any higher value requires
# some amount of encryption.
#
#sasl_minimum_layer: 0

# The mechanism used by the server to verify plaintext passwords.  Possible
# values include "auxprop" or "saslauthd"
#
sasl_pwcheck_method: saslauthd
# If enabled,  the SASL library will automatically create authentication
# secrets when given a plaintext password.  See the SASL documentation.
#
#sasl_auto_transition: no

# Whitespace separated list of mechanisms to allow (e.g. 'plain otp').
# Used to restrict the mechanisms to a subset of the installed
# plugins. The default is all available.
#
#sasl_mech_list: cram-md5 digest-md5
sasl_mech_list: plain

# Location of the opiekeys file
#
#sasl_opiekeys: /etc/opiekeys

# File containing the global certificate used for ALL services (imap,
# pop3, lmtp).
#
#tls_cert_file: <none>

# File containing the private key belonging to the global server
# certificate.
#
#tls_key_file: <none>

# File containing the certificate used for imap ONLY.  If not
# specified, the global certificate is used.  A value of "disabled"
# will disable SSL/TLS for imap.
#
#imap_tls_cert_file: <none>

# File containing the private key belonging to the imap-specific
# server certificate.  If not specified, the global private key is
# used.  A value of "disabled" will disable SSL/TLS for imap.
#
#imap_tls_key_file: <none>

# File containing the certificate used for pop3 ONLY.  If not
# specified, the global certificate is used.  A value of "disabled"
# will disable SSL/TLS for pop3.
#
#pop3_tls_cert_file: <none>

# File containing the private key belonging to the pop3-specific
# server certificate.  If not specified, the global private key is
# used.  A value of "disabled" will disable SSL/TLS for pop3.
#
#pop3_tls_key_file: <none>

# File containing the certificate used for lmtp ONLY.  If not
# specified, the global certificate is used.  A value of "disabled"
# will disable TLS for lmtp.
#
#lmtp_tls_cert_file: <none>

# File containing the private key belonging to the lmtp-specific
# server certificate.  If not specified, the global private key is
# used.  A value of "disabled" will disable TLS for lmtp.
#
#lmtp_tls_key_file: <none>

# File containing the certificate used for sieve ONLY.  If not
# specified, the global certificate is used.  A value of "disabled"
# will disable TLS for sieve.
#
#sieve_tls_cert_file: <none>

# File containing the private key belonging to the sieve-specific
# server certificate.  If not specified, the global private key is
# used.  A value of "disabled" will disable TLS for sieve.
#
#sieve_tls_key_file: <none>

# File containing one or more Certificate Authority (CA) certificates.
#
#tls_ca_file: <none>

# Path to directory with certificates of CAs.
#
#tls_ca_path: <none>

# The length of time (in minutes) that a TLS session will be cached
# for later reuse.  The maximum value is 1440 (24 hours), the default.
# A value of 0 will disable session caching.
#
#tls_session_timeout: 1440

# The right that a user needs to delete a mailbox.
#
#deleteright: c

# Unix domain socket that lmtpd listens on, used by deliver(8).
#
#lmtpsocket: /var/imap/socket/lmtp
lmtpsocket: /expert/correo/imap/socket/lmtp

# Unix domain socket that idled listens on.
#
#idlesocket: /var/imap/socket/idle
idlesocket: /expert/correo/imap/socket/idle

# Unix domain socket that the new mail notification daemon listens on.
#
#notifysocket: /var/imap/socket/notify
notifysocket: /expert/correo/imap/socket/notify

serverinfo: no



virtdomains: on
defaultdomain: correopiloto.ramattack.net

# sasl_auxprop_plugin: sql
# sasl_sql_engine: mysql
# sasl_sql_user: imapuser
# sasl_sql_passwd: niu69lqh
# sasl_sql_hostnames: 127.0.0.1
# sasl_sql_database: mail
# sasl_sql_select: select clave from usuarios where email = '%u@%r' and
activo=1
#sasl_sql_verbose: true

lmtp_downcase_rcpt: on

#
# EOF







I'm running FreeBSD and all is installed though FreeBSD ports...

Thank you very much people :)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080915/f17ff93d/attachment-0001.html 

From farislinux at yahoo.com  Mon Sep 15 01:00:32 2008
From: farislinux at yahoo.com (faris)
Date: Sun, 14 Sep 2008 22:00:32 -0700 (PDT)
Subject: Cyrus Imap Benchmark
Message-ID: <958148.10945.qm@web33204.mail.mud.yahoo.com>

?
Hi All,
?
I?have a special requirement and need to?benchmark cyrus imap with 100K mailboxes having sasld with mysql authentication. the benchmark will be writing mails with 400KB size attachement to all 100K mailboxes, while reading all the?100k mailboxes simultanously,?each mailbox have 10MB quota allocated.
?
Following is the configuration of the server which i am planning to use for the loadtest.
?
Server Conf: Intel(R) Xeon(TM) CPU 3.80GHz X 4, 4GB ram
OS: Red Hat Enterprise Linux Server release 5.1
cyrus-sasl-2.1.22-4
cyrus-imapd-2.3.7-1.1.el5
pam_mysql-0.7-0.4.rc1.el5.2
MySQL-server-4.0.24-0
postfix-2.3.11-1.rhel5
?
Can anybody tell me what is a maximum amount of mailboxes cyrus-imapd supports? also is it possbile for me to go upto 200K mailboxes in a single node ? Are there any tools available to do the benchmark for this scanario ? 
?
Please advice, 
?
Farislinux


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080914/7f3ea0e1/attachment.html 

From dwhite at olp.net  Mon Sep 15 01:16:05 2008
From: dwhite at olp.net (Dan White)
Date: Mon, 15 Sep 2008 00:16:05 -0500
Subject: Problem with pam_mysql, saslauthd and ONLY imap
In-Reply-To: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>
References: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>
Message-ID: <48CDEF95.8050608@olp.net>

Egoitz Aurrekoetxea wrote:
> Hi mates!!
>
> Well some days and hours now testing cyrus... lol; well the problem is 
> that I have decided to try auth throgh pam_mysql with saslauthd... it 
> works for postfix smtp auth and for pop3. When you do a testsaslauthd 
> or try to login via IMAP it does't work... it sais :
>
> In auth.log :
> Sep 15 02:27:45 correopiloto imap[1741]: sql_select option missing
> Sep 15 02:27:45 correopiloto imap[1741]: auxpropfunc error no 
> mechanism available
> Sep 15 02:27:45 correopiloto saslauthd[1216]: do_auth         : auth 
> failure: [user=egoitz at ramattack.net <mailto:egoitz at ramattack.net>] 
> [service=imap] [realm=ramattack.net <http://ramattack.net>] [mech=pam] 
> [reason=PAM auth error]
>
> If in the file I set pwcheck to auxprop and uncomment the end sasl_sql 
> lines it works nice!! but if I try to use saslauthd doesn't work and 
> can't loging too through cyradm... Any help is apreciated please....
>
> #sasl_maximum_layer: 256
> #sasl_minimum_layer: 0
> sasl_pwcheck_method: saslauthd
> #sasl_auto_transition: no
> sasl_mech_list: plain
> #sasl_opiekeys: /etc/opiekeys
> virtdomains: on
> defaultdomain: correopiloto.ramattack.net 
> <http://correopiloto.ramattack.net>
>
> # sasl_auxprop_plugin: sql
> # sasl_sql_engine: mysql
> # sasl_sql_user: imapuser
> # sasl_sql_passwd: niu69lqh
> # sasl_sql_hostnames: 127.0.0.1 <http://127.0.0.1>
> # sasl_sql_database: mail
> # sasl_sql_select: select clave from usuarios where email = '%u@%r' 
> and activo=1
> #sasl_sql_verbose: true
>
> I'm running FreeBSD and all is installed though FreeBSD ports...
>
> Thank you very much people :)


Egoitz,

Can you post your Postfix sasl config for comparison (smtpd.conf).

To rule out a client side inconsistency, you can use pop3test, imtest 
and smtptest to test with.

- Dan

From simon.matter at invoca.ch  Mon Sep 15 02:27:31 2008
From: simon.matter at invoca.ch (Simon Matter)
Date: Mon, 15 Sep 2008 08:27:31 +0200 (CEST)
Subject: info correct / quota wrong
In-Reply-To: <20080914123319.57ae5ocklccosswo@tyr.morrison.iserv.net>
References: <1221396422.8486.19.camel@linux-nnci.site>
	<20080914123319.57ae5ocklccosswo@tyr.morrison.iserv.net>
Message-ID: <da874026ce9e8eab0eb4fc2f31e84f52.squirrel@webmail.bi.corp.invoca.ch>

> Quoting Adam Tauno Williams <adam at morrison-ind.com>:
>> After migrating and updating my IMAP server everything seems to working,
>> but the quota reports wrong information for *SOME* mailboxes, seemingly
>> at random
>> cyrus-imapd-2.3.12p2-1 (CentOS5)
>> The quota value is crazy wrong!
>> localhost.localdomain> info user.fred
>> {user.fred}:
>>   condstore: false
>>   duplicatedeliver: false
>>   lastpop:
>>   lastupdate: 14-Sep-2008 00:32:16 -0400
>>   partition: default
>>   sharedseen: false
>>   size: 127583
>> -bash-3.2$ /usr/lib/cyrus-imapd/quota -f  | grep fred
>>        0          4401742 user.fred
>> -bash-3.2$ du -sk /var/spool/imap/f/user/fred/
>> 225296	/var/spool/imap/f/user/fred/
>> I can believe the result of "???user.fred", but the quota report is
>> clearly wrong.
>
> I've force complete recreation of the cyrus quota database;  and it
> has come up with the same numbers.
>
>
> service cyrus-imapd stop
>
> [root at sardine imap]# pwd
> /var/lib/imap
> [root at sardine imap]# rm -f ./db.backup2/quotas.db ./quotas.db
> ./db.backup1/quotas.db
>
> service cyrus-imapd stop

You may try to first fix mailbox metadata with reconstruct -r -f on those
mailboxes. This is what helped when I had such problems.

Simon


From Hagedorn at uni-koeln.de  Mon Sep 15 03:21:12 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Mon, 15 Sep 2008 09:21:12 +0200
Subject: Cyrus Imap Benchmark
In-Reply-To: <958148.10945.qm@web33204.mail.mud.yahoo.com>
References: <958148.10945.qm@web33204.mail.mud.yahoo.com>
Message-ID: <B8CDEEBACF37A48EF5296C34@tyrion.rrz.uni-koeln.de>

Hi faris,

--On 14. September 2008 22:00:32 -0700 faris <farislinux at yahoo.com> wrote:

> I?have a special requirement and need to?benchmark cyrus imap with 100K
> mailboxes having sasld with mysql authentication. the benchmark will be
> writing mails with 400KB size attachement to all 100K mailboxes, while
> reading all the?100k mailboxes simultanously,

do you *really* expect 100k concurrent IMAP connections??

>?each mailbox have 10MB
> quota allocated. ?
> Following is the configuration of the server which i am planning to use
> for the loadtest. ?
> Server Conf: Intel(R) Xeon(TM) CPU 3.80GHz X 4, 4GB ram
> OS: Red Hat Enterprise Linux Server release 5.1
> cyrus-sasl-2.1.22-4
> cyrus-imapd-2.3.7-1.1.el5
> pam_mysql-0.7-0.4.rc1.el5.2
> MySQL-server-4.0.24-0
> postfix-2.3.11-1.rhel5
> ?
> Can anybody tell me what is a maximum amount of mailboxes cyrus-imapd
> supports?

Do you mean mailboxes or accounts? We have around 50,000 users with 105,000 
mailboxes on a single server. There is no real maximum, AFAIK.

> also is it possbile for me to go upto 200K mailboxes in a
> single node ?

Certainly. The issue isn't the number of mailboxes, it's the number of 
connections. We currently don't have more than 1,200 of those at a time. I 
don't think you could get anywhere near 100,000 on a single server.
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080915/c589c255/attachment.bin 

From Hagedorn at uni-koeln.de  Mon Sep 15 04:22:29 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Mon, 15 Sep 2008 10:22:29 +0200
Subject: snmp monitoring two cyrus instances on one machine
In-Reply-To: <48C6B91F.20102@UGent.be>
References: <48C53C35.9050706@UGent.be>
	<C840FCBF46507C0A99B00DA8@tyrion.rrz.uni-koeln.de>
	<48C6B91F.20102@UGent.be>
Message-ID: <679934C538B12DA5EE0DF29E@tyrion.rrz.uni-koeln.de>

--On 9. September 2008 19:57:51 +0200 Rudy Gevaert <Rudy.Gevaert at UGent.be> 
wrote:

>>> On each machine I run two cyrus instances.
>>
>> Using different IP addresses or just different ports?
>
> different ip's.  But they both connect to /var/run/agentx

That's right, I forgot about that. I'd guess you'd have to use separate 
sockets for the two instances. I just noticed that you can specify the 
socket with the -x flag to cyrus-master. Maybe that helps? You'd have to 
run separate instances of snmpd as well, I suppose.
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080915/0830c02f/attachment.bin 

From brong at fastmail.fm  Mon Sep 15 05:08:24 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Mon, 15 Sep 2008 19:08:24 +1000
Subject: Cyrus Imap Benchmark
In-Reply-To: <958148.10945.qm@web33204.mail.mud.yahoo.com>
References: <958148.10945.qm@web33204.mail.mud.yahoo.com>
Message-ID: <1221469704.18784.1273993977@webmail.messagingengine.com>


On Sun, 14 Sep 2008 22:00:32 -0700 (PDT), "faris" <farislinux at yahoo.com> said:
> ?
> Hi All,
> ?
> I?have a special requirement and need to?benchmark cyrus imap with 100K
> mailboxes having sasld with mysql authentication. the benchmark will be
> writing mails with 400KB size attachement to all 100K mailboxes, while
> reading all the?100k mailboxes simultanously,?each mailbox have 10MB
> quota allocated.
> ?
> Following is the configuration of the server which i am planning to use
> for the loadtest.
> ?
> Server Conf: Intel(R) Xeon(TM) CPU 3.80GHz X 4,

That's an awful lot of CPU.

> 4GB ram

That's an awfully small amount of RAM

(our biggest machines have 32GB RAM and a _single_ CPU.  They're not CPU
 limited)

> OS: Red Hat Enterprise Linux Server release 5.1
> cyrus-sasl-2.1.22-4
> cyrus-imapd-2.3.7-1.1.el5

that's getting old.  In particular, it has skiplist bugs, and you'll be
wanting skiplist for your mailboxes.db.  Can you upgrade it?

> pam_mysql-0.7-0.4.rc1.el5.2
> MySQL-server-4.0.24-0

I take back my "getting old" statement!  That's ancient.  Then again,
unlikely to be an issue.

> postfix-2.3.11-1.rhel5

I see an awfully big lack of information about your disk configuration here,
given that IO is going to be your limiting factor.  Care about that above
the other specs.  Seriously.

> Can anybody tell me what is a maximum amount of mailboxes cyrus-imapd
> supports? also is it possbile for me to go upto 200K mailboxes in a
> single node ? Are there any tools available to do the benchmark for this
> scanario ? 

We've had 200k mailboxes.  It's pushing sanity a bit.  I assume you mean
200k users, rather than 200k folders.

We have that many on a single machine, but we don't keep them on a single
instance these days, mainly because restoring that much disk after a
filesystem failure takes too long.  Instead, we split everything into
300Gb instances.  There may be up to 30 or so of them on a single machine
if the disk arrays are big enough.

Then again, we have in the past.  Cyrus coped fine.  You'll be wanting
that extra RAM and a 64bit kernel though, so you can actually cache the
hundreds of thousands of cyrus.index files.  Also, you'll want to have
split meta and meta files (cyrus.header, cyrus.index, cyrus.cache) on
really fast drives.  We use 10k or 15k RPM drives in RAID1 for meta.

Regards,

Bron.
-- 
  Bron Gondwana
  brong at fastmail.fm


From egoitz at gmail.com  Mon Sep 15 09:12:15 2008
From: egoitz at gmail.com (Egoitz Aurrekoetxea)
Date: Mon, 15 Sep 2008 15:12:15 +0200
Subject: Problem with pam_mysql, saslauthd and ONLY imap
In-Reply-To: <48CDEF95.8050608@olp.net>
References: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>
	<48CDEF95.8050608@olp.net>
Message-ID: <136f2cf30809150612l32607db1i929bbd9589f6ff0c@mail.gmail.com>

Hi!!

I have reinstalled the whole testing machine trying to solve the problem
(with the same config files)... but no way... pop and smtp work but not
IMAP.... smtpd.conf file (of /usr/local/lib/sasl2) constains :

pwcheck_method: saslauthd
mech_list: PLAIN LOGIN

just this....


and if I use pop3test or smtptest... checks are ok and I can logon... but...
look with imtest :

correopiloto# imtest  -aegoitz at ramattack.net -mplain
WARNING: no hostname supplied, assuming localhost

S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID AUTH=PLAIN SASL-IR] server
ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID AUTH=PLAIN SASL-IR ACL
RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME
UNSELECT CHILDREN MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT
THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE URLAUTH
S: C01 OK Completed
Please enter your password:
C: A01 AUTHENTICATE PLAIN AGVnb2l0ekByYW1hdHRhY2submV0ADA1MDIwNQ==
S: A01 NO authentication failure
Authentication failed. generic failure
Security strength factor: 0
quit
* BAD Invalid tag
./ logout
* BYE LOGOUT received
./ OK Completed
Connection closed.



In auth.log we can see :

Sep 15 14:00:54 correopiloto imap[835]: sql_select option missing
Sep 15 14:00:54 correopiloto imap[835]: auxpropfunc error no mechanism
available
Sep 15 14:00:57 correopiloto saslauthd[488]: do_auth         : auth failure:
[user=egoitz at ramattack.net] [service=imap] [realm=ramattack.net] [mech=pam]
[reason=PAM auth error]

In messages :

Sep 15 14:02:40 correopiloto imap[835]: badlogin: localhost [127.0.0.1]
PLAIN [SASL(-13): authentication failure: Password verification failed]


In debug :

Sep 15 14:02:40 correopiloto saslauthd[487]: DEBUG: auth_pam:
pam_authenticate failed: authentication error

the pam.d files (imap, pop and smtp are the three the same)

correopiloto# more imap
auth    required   /usr/local/lib/pam_mysql.so user=pruebas passwd=pruebas
host=127.0.0.1 db=mail table=usuarios usercolumn=email passwdcolumn=clave
crypt=0
account sufficient /usr/local/lib/pam_mysql.so user=pruebas passwd=pruebas
host=127.0.0.1 db=mail table=usuarios usercolumn=email passwdcolumn=clave
crypt=0

Any ideas mates? :) :) :)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080915/a3125cca/attachment-0001.html 

From jmadden at ivytech.edu  Mon Sep 15 09:17:12 2008
From: jmadden at ivytech.edu (John Madden)
Date: Mon, 15 Sep 2008 09:17:12 -0400
Subject: Cyrus Imap Benchmark
In-Reply-To: <958148.10945.qm@web33204.mail.mud.yahoo.com>
References: <958148.10945.qm@web33204.mail.mud.yahoo.com>
Message-ID: <1221484632.30876.33.camel@localhost.localdomain>

On Sun, 2008-09-14 at 22:00 -0700, faris wrote:
> Can anybody tell me what is a maximum amount of mailboxes cyrus-imapd
> supports? also is it possbile for me to go upto 200K mailboxes in a
> single node ? Are there any tools available to do the benchmark for
> this scanario ?  

We have upwards of 360k accounts depending on the time of the year.
Cyrus scales just fine, but the disks do not.  32 spindles isn't enough
and I don't know what would be.  It can certainly be done on a single
machine, i/o not withstanding. =)

John





-- 
John Madden
Sr. UNIX Systems Engineer
Ivy Tech Community College of Indiana
jmadden at ivytech.edu


From dwhite at olp.net  Mon Sep 15 09:39:16 2008
From: dwhite at olp.net (Dan White)
Date: Mon, 15 Sep 2008 08:39:16 -0500
Subject: Problem with pam_mysql, saslauthd and ONLY imap
In-Reply-To: <136f2cf30809150612l32607db1i929bbd9589f6ff0c@mail.gmail.com>
References: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>	
	<48CDEF95.8050608@olp.net>
	<136f2cf30809150612l32607db1i929bbd9589f6ff0c@mail.gmail.com>
Message-ID: <48CE6584.6030208@olp.net>

Egoitz Aurrekoetxea wrote:
> Hi!!
>
> I have reinstalled the whole testing machine trying to solve the 
> problem (with the same config files)... but no way... pop and smtp 
> work but not IMAP.... smtpd.conf file (of /usr/local/lib/sasl2) 
> constains :
>
> pwcheck_method: saslauthd
> mech_list: PLAIN LOGIN
>
> just this....
>
>
> and if I use pop3test or smtptest... checks are ok and I can logon... 
> but... look with imtest :
>
> correopiloto# imtest  -aegoitz at ramattack.net 
> <mailto:aegoitz at ramattack.net> -mplain
> WARNING: no hostname supplied, assuming localhost
>
> S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID AUTH=PLAIN SASL-IR] 
> server ready

You may be aware, but including the AUTHENTICATE line from the output, 
when performing PLAIN/LOGIN authentications, makes it trivial for 
someone to uunencode your username and password. You should consider 
that password compromised.

> S: A01 NO authentication failure
>
> In auth.log we can see :
>
> Sep 15 14:00:54 correopiloto imap[835]: sql_select option missing
> Sep 15 14:00:54 correopiloto imap[835]: auxpropfunc error no mechanism 
> available
> Sep 15 14:00:57 correopiloto saslauthd[488]: do_auth         : auth 
> failure: [user=egoitz at ramattack.net <mailto:egoitz at ramattack.net>] 
> [service=imap] [realm=ramattack.net <http://ramattack.net>] [mech=pam] 
> [reason=PAM auth error]
>
> In messages :
>
> Sep 15 14:02:40 correopiloto imap[835]: badlogin: localhost [127.0.0.1 
> <http://127.0.0.1>] PLAIN [SASL(-13): authentication failure: Password 
> verification failed]

You may have better luck trouble shooting this as a PAM configuration issue.

I tried searching for a PAM testing tool and ran across 'pamtester':

http://pamtester.sourceforge.net/

I was able to test like this:

./pamtester imap jsmith authenticate
Password: xxx
pamtester: successfully authenticated

- Dan

From egoitz at gmail.com  Mon Sep 15 17:41:21 2008
From: egoitz at gmail.com (Egoitz Aurrekoetxea)
Date: Mon, 15 Sep 2008 23:41:21 +0200
Subject: Problem with pam_mysql, saslauthd and ONLY imap
In-Reply-To: <48CE8C35.30408@olp.net>
References: <136f2cf30809141833s771cf7d7s7a23107d062ed5e1@mail.gmail.com>
	<48CDEF95.8050608@olp.net>
	<136f2cf30809150612l32607db1i929bbd9589f6ff0c@mail.gmail.com>
	<48CE6584.6030208@olp.net>
	<136f2cf30809150711x7e23d3d6oa18e191a374e9c3a@mail.gmail.com>
	<48CE7266.3020202@olp.net>
	<136f2cf30809150920p2c899848mc32d34be284b6000@mail.gmail.com>
	<48CE8C35.30408@olp.net>
Message-ID: <136f2cf30809151441t58bd5a24p8802f12830659d31@mail.gmail.com>

Hi!!

I have get at the end make imap to work... testsaslauthd for imap gave OK!
but now cyradm doesn't work... you know sais perl : no worth mech found and
those stuff I'll continue reviewing myself... I'll tell you... hey mates
very thanked for all you're help :) sincerely thanks a lot I was quite
lost...  I'll tell you what I have done after everything works :)

Bye!!!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080915/b0fda359/attachment.html 

From mikeegg1 at mac.com  Mon Sep 15 17:50:38 2008
From: mikeegg1 at mac.com (Mike Eggleston)
Date: Mon, 15 Sep 2008 16:50:38 -0500
Subject: MUA not noticing new mail
In-Reply-To: <20080829174848.GP27711@it.is.rice.edu>
References: <20080829135540.GB16215@mail.mac.com>
	<20080829141318.GJ27711@it.is.rice.edu>
	<5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu>
	<20080829174848.GP27711@it.is.rice.edu>
Message-ID: <20080915215038.GA8526@mail.mac.com>

On Fri, 29 Aug 2008, Kenneth Marshall might have said:

> On Fri, Aug 29, 2008 at 01:34:24PM -0400, Wesley Craig wrote:
> > On 29 Aug 2008, at 10:13, Kenneth Marshall wrote:
> >> We tried many IDLE options here, but so many clients had poor IDLE
> >> support that we ended up turning it off. The number of help desk
> >> calls such as the one above dropped essentially to zero after the
> >> change.
> >
> > I wonder if you have some practical experience to share, e.g., which 
> > clients & versions have poor IDLE support?
> >
> > :wes
> >
> Outlook/Outlook Express drove the change for us. They would open
> multiple IMAP connections (sent folder, deleted folder, INBOX, ...)
> but the only folder for which they would issue the IDLE command for
> properly was the INBOX. From the behavior of other clients, many
> had the same issue. Apparently Outlook counted on the IDLE for the
> INBOX counting for all additional IMAP connections to the same
> server.
> 
> Ken

I turned idled back on this morning as the user says she is still missing
emails. This particular user has hundreds of folders and hundreds of
sieve rules to automatically file messages into these folders (co-worker
messages go into co-worker folders and she wants to be notified (unread
count) that there's a message in a co-worker's folder, etc.). Is there
a setting on sieve I need to tune?

Mike

From jvoorhees1 at gmail.com  Mon Sep 15 17:55:28 2008
From: jvoorhees1 at gmail.com (Jason Voorhees)
Date: Mon, 15 Sep 2008 16:55:28 -0500
Subject: Cyrus IMAP/POP Banner
In-Reply-To: <20080914113322.wyibyqw60ws4kw4w@tyr.morrison.iserv.net>
References: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>
	<20080914113322.wyibyqw60ws4kw4w@tyr.morrison.iserv.net>
Message-ID: <48CED9D0.7000300@gmail.com>

Hi:

I'm using cyrus-imapd 2.3.7 on CentOS 5.2 and I can't find serverinfo 
directive in its manual page.

$ man -P cat imapd.conf | grep -i serverinfo

Returns nothing!

Is that directive only available in recent versions of cyrus-imapd?

Adam Tauno Williams escribi?:
>> I have been googling over there and haven't find the answer to my question
>> just another man looking for the same as me... I wanted to change the banner
>> that cyrus imap and pop sends when you connect to them... basically the
>> server greeting... I think it could be quite dangerous to show the version
>> you're running... even the server you're running. Please could be anyway of
>> doing this? how could I get my goal? For example when you telnet to port 110
>> or 143 to be shown :
>> +OK IMAP Server
>> and nothing else....
> 
> man imapd.conf
> <quote>
> serverinfo: on
> 
> The  server  information to display in the greeting and capability
> responses. Information is displayed as follows:
> 
> "off" = no server information in the greeting or capabilities
> "min" = servername in the greeting; no server information  in  the
> capabilities
> "on"  =  servername  and  product version in the greeting; product
> version in the capabilities
> 
> Allowed values: off, min, on
> </quote>
> 
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

From ktm at rice.edu  Mon Sep 15 18:41:49 2008
From: ktm at rice.edu (Kenneth Marshall)
Date: Mon, 15 Sep 2008 17:41:49 -0500
Subject: MUA not noticing new mail
In-Reply-To: <20080915215038.GA8526@mail.mac.com>
References: <20080829135540.GB16215@mail.mac.com>
	<20080829141318.GJ27711@it.is.rice.edu>
	<5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu>
	<20080829174848.GP27711@it.is.rice.edu>
	<20080915215038.GA8526@mail.mac.com>
Message-ID: <20080915224149.GF22468@it.is.rice.edu>

On Mon, Sep 15, 2008 at 04:50:38PM -0500, Mike Eggleston wrote:
> On Fri, 29 Aug 2008, Kenneth Marshall might have said:
> 
> > On Fri, Aug 29, 2008 at 01:34:24PM -0400, Wesley Craig wrote:
> > > On 29 Aug 2008, at 10:13, Kenneth Marshall wrote:
> > >> We tried many IDLE options here, but so many clients had poor IDLE
> > >> support that we ended up turning it off. The number of help desk
> > >> calls such as the one above dropped essentially to zero after the
> > >> change.
> > >
> > > I wonder if you have some practical experience to share, e.g., which 
> > > clients & versions have poor IDLE support?
> > >
> > > :wes
> > >
> > Outlook/Outlook Express drove the change for us. They would open
> > multiple IMAP connections (sent folder, deleted folder, INBOX, ...)
> > but the only folder for which they would issue the IDLE command for
> > properly was the INBOX. From the behavior of other clients, many
> > had the same issue. Apparently Outlook counted on the IDLE for the
> > INBOX counting for all additional IMAP connections to the same
> > server.
> > 
> > Ken
> 
> I turned idled back on this morning as the user says she is still missing
> emails. This particular user has hundreds of folders and hundreds of
> sieve rules to automatically file messages into these folders (co-worker
> messages go into co-worker folders and she wants to be notified (unread
> count) that there's a message in a co-worker's folder, etc.). Is there
> a setting on sieve I need to tune?
> 
> Mike
> 
Sieve is not even part of the imap spec and does not have an effect on
IDLE handling by the client. It sounds like a worst-case scenario where
unusual mail handling process meets poor IDLE implementation. There is
nothing tuneable on the sieve side. If the client were implementing the
spec correctly then it would be getting notified when you have IDLE enabled,
but like I said above, those clients are few and far between. Let me know
if you figure something out that can handle this situation. The only thing
that I can think of is to have the sieve rules deliver to both the INBOX
and the specific folder and then only monitor the INBOX for new mail. I
suspect that would require changes to the workflow that may not be acceptable.

Cheers,
Ken


From mikeegg1 at mac.com  Mon Sep 15 20:04:30 2008
From: mikeegg1 at mac.com (Mike Eggleston)
Date: Mon, 15 Sep 2008 19:04:30 -0500
Subject: MUA not noticing new mail
In-Reply-To: <20080915224149.GF22468@it.is.rice.edu>
References: <20080829135540.GB16215@mail.mac.com>
	<20080829141318.GJ27711@it.is.rice.edu>
	<5B1D1E5B-B6C3-46A1-AFB6-2662CC5F6621@umich.edu>
	<20080829174848.GP27711@it.is.rice.edu>
	<20080915215038.GA8526@mail.mac.com>
	<20080915224149.GF22468@it.is.rice.edu>
Message-ID: <20080916000430.GA4875@mail.mac.com>

On Mon, 15 Sep 2008, Kenneth Marshall might have said:

> On Mon, Sep 15, 2008 at 04:50:38PM -0500, Mike Eggleston wrote:
> > On Fri, 29 Aug 2008, Kenneth Marshall might have said:
> > 
> > > On Fri, Aug 29, 2008 at 01:34:24PM -0400, Wesley Craig wrote:
> > > > On 29 Aug 2008, at 10:13, Kenneth Marshall wrote:
> > > >> We tried many IDLE options here, but so many clients had poor IDLE
> > > >> support that we ended up turning it off. The number of help desk
> > > >> calls such as the one above dropped essentially to zero after the
> > > >> change.
> > > >
> > > > I wonder if you have some practical experience to share, e.g., which 
> > > > clients & versions have poor IDLE support?
> > > >
> > > > :wes
> > > >
> > > Outlook/Outlook Express drove the change for us. They would open
> > > multiple IMAP connections (sent folder, deleted folder, INBOX, ...)
> > > but the only folder for which they would issue the IDLE command for
> > > properly was the INBOX. From the behavior of other clients, many
> > > had the same issue. Apparently Outlook counted on the IDLE for the
> > > INBOX counting for all additional IMAP connections to the same
> > > server.
> > > 
> > > Ken
> > 
> > I turned idled back on this morning as the user says she is still missing
> > emails. This particular user has hundreds of folders and hundreds of
> > sieve rules to automatically file messages into these folders (co-worker
> > messages go into co-worker folders and she wants to be notified (unread
> > count) that there's a message in a co-worker's folder, etc.). Is there
> > a setting on sieve I need to tune?
> > 
> > Mike
> > 
> Sieve is not even part of the imap spec and does not have an effect on
> IDLE handling by the client. It sounds like a worst-case scenario where
> unusual mail handling process meets poor IDLE implementation. There is
> nothing tuneable on the sieve side. If the client were implementing the
> spec correctly then it would be getting notified when you have IDLE enabled,
> but like I said above, those clients are few and far between. Let me know
> if you figure something out that can handle this situation. The only thing
> that I can think of is to have the sieve rules deliver to both the INBOX
> and the specific folder and then only monitor the INBOX for new mail. I
> suspect that would require changes to the workflow that may not be acceptable.
> 
> Cheers,
> Ken
> 

Thanks for your thoughts. Seems odd that Outlook and Mac Mail would
both not follow the spec. I think this user's approach is inefficient
and all mail should be delivered to the INBOX and worked/filed/deleted
from there. Oh well, It's not my place to say.

Mike

From simon.matter at invoca.ch  Tue Sep 16 02:55:32 2008
From: simon.matter at invoca.ch (Simon Matter)
Date: Tue, 16 Sep 2008 08:55:32 +0200 (CEST)
Subject: Cyrus IMAP/POP Banner
In-Reply-To: <48CED9D0.7000300@gmail.com>
References: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>
	<20080914113322.wyibyqw60ws4kw4w@tyr.morrison.iserv.net>
	<48CED9D0.7000300@gmail.com>
Message-ID: <b1371913432b10a424563f42bc23d3de.squirrel@webmail.bi.corp.invoca.ch>

> Hi:
>
> I'm using cyrus-imapd 2.3.7 on CentOS 5.2 and I can't find serverinfo
> directive in its manual page.
>
> $ man -P cat imapd.conf | grep -i serverinfo
>
> Returns nothing!

What shows this?
zgrep serverinfo /usr/share/man/man5/imapd.conf.5.gz

Simon

> Is that directive only available in recent versions of cyrus-imapd?
>
> Adam Tauno Williams escribi?:
>>> I have been googling over there and haven't find the answer to my
>>> question
>>> just another man looking for the same as me... I wanted to change the
>>> banner
>>> that cyrus imap and pop sends when you connect to them... basically the
>>> server greeting... I think it could be quite dangerous to show the
>>> version
>>> you're running... even the server you're running. Please could be
>>> anyway of
>>> doing this? how could I get my goal? For example when you telnet to
>>> port 110
>>> or 143 to be shown :
>>> +OK IMAP Server
>>> and nothing else....
>>
>> man imapd.conf
>> <quote>
>> serverinfo: on
>>
>> The  server  information to display in the greeting and capability
>> responses. Information is displayed as follows:
>>
>> "off" = no server information in the greeting or capabilities
>> "min" = servername in the greeting; no server information  in  the
>> capabilities
>> "on"  =  servername  and  product version in the greeting; product
>> version in the capabilities
>>
>> Allowed values: off, min, on
>> </quote>
>>
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>



From michael.menge at zdv.uni-tuebingen.de  Tue Sep 16 05:40:33 2008
From: michael.menge at zdv.uni-tuebingen.de (Michael Menge)
Date: Tue, 16 Sep 2008 11:40:33 +0200
Subject: Cyrus IMAP/POP Banner
In-Reply-To: <b1371913432b10a424563f42bc23d3de.squirrel@webmail.bi.corp.invoca.ch>
References: <136f2cf30809140736x753550e8rc61e89cfa446ca98@mail.gmail.com>
	<20080914113322.wyibyqw60ws4kw4w@tyr.morrison.iserv.net>
	<48CED9D0.7000300@gmail.com>
	<b1371913432b10a424563f42bc23d3de.squirrel@webmail.bi.corp.invoca.ch>
Message-ID: <20080916114033.o9dnx2pzq4g00csw@webmail.uni-tuebingen.de>

The Option was introduced in 2.3.12

Changes to the Cyrus IMAP Server since 2.3.11

* Added serverinfo option to control the information displayed in
         banner greetings and capability responses.




Quoting Simon Matter <simon.matter at invoca.ch>:

>> Hi:
>>
>> I'm using cyrus-imapd 2.3.7 on CentOS 5.2 and I can't find serverinfo
>> directive in its manual page.
>>
>> $ man -P cat imapd.conf | grep -i serverinfo
>>
>> Returns nothing!
>
> What shows this?
> zgrep serverinfo /usr/share/man/man5/imapd.conf.5.gz
>
> Simon
>
>> Is that directive only available in recent versions of cyrus-imapd?
>>
>> Adam Tauno Williams escribi?:
>>>> I have been googling over there and haven't find the answer to my
>>>> question
>>>> just another man looking for the same as me... I wanted to change the
>>>> banner
>>>> that cyrus imap and pop sends when you connect to them... basically the
>>>> server greeting... I think it could be quite dangerous to show the
>>>> version
>>>> you're running... even the server you're running. Please could be
>>>> anyway of
>>>> doing this? how could I get my goal? For example when you telnet to
>>>> port 110
>>>> or 143 to be shown :
>>>> +OK IMAP Server
>>>> and nothing else....
>>>
>>> man imapd.conf
>>> <quote>
>>> serverinfo: on
>>>
>>> The  server  information to display in the greeting and capability
>>> responses. Information is displayed as follows:
>>>
>>> "off" = no server information in the greeting or capabilities
>>> "min" = servername in the greeting; no server information  in  the
>>> capabilities
>>> "on"  =  servername  and  product version in the greeting; product
>>> version in the capabilities
>>>
>>> Allowed values: off, min, on
>>> </quote>
>>>
>>> ----
>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>



--------------------------------------------------------------------------------
M.Menge                                 Tel.: (49) 7071/29-70316
Universitaet Tuebingen                  Fax.: (49) 7071/29-5912
Zentrum fuer Datenverarbeitung          mail:  
michael.menge at zdv.uni-tuebingen.de
Waechterstrasse 76
72074 Tuebingen
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5339 bytes
Desc: S/MIME krytographische Unterschrift
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080916/12ddb305/attachment-0001.bin 

From joydeep at infoservices.in  Tue Sep 16 05:59:48 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Tue, 16 Sep 2008 15:29:48 +0530
Subject: suggestion need to design an  email system.
Message-ID: <48CF8394.9050207@infoservices.in>

Dear list,

I have a running email system which I made in 2006 based on
postfix+cyrus+openldap. The authentication is based on openldap.
I have done some reading through net and find a new mail server dovecot.
I have to create another email system for multidomain based hosting
server where both scalability as well as performance should be in prime
consideration. I need your kind suggestion for this. shall I use dovecot
or cyrus can fit my requirement ? another important questing ; Is there
any webinterface which can manage the mail system based on LDAP ?
There are many with MySql but any application which can work with
postfix+cyrus+openldap ?

thanks


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

From joydeep at infoservices.in  Tue Sep 16 06:08:28 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Tue, 16 Sep 2008 15:38:28 +0530
Subject: suggestion need to design an  email system.
Message-ID: <48CF859C.2080407@infoservices.in>

Dear list,

I have a running email system which I made in 2006 based on
postfix+cyrus+openldap. The authentication is based on openldap.
I have done some reading through net and find a new mail server dovecot.
I have to create another email system for multidomain based hosting
server where both scalability as well as performance should be in prime
consideration. I need your kind suggestion for this. shall I use dovecot
or cyrus can fit my requirement ? another important questing ; Is there
any webinterface which can manage the mail system based on LDAP ?
There are many with MySql but any application which can work with
postfix+cyrus+openldap ?

thanks


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From lartc at manchotnetworks.net  Tue Sep 16 06:53:13 2008
From: lartc at manchotnetworks.net (lartc)
Date: Tue, 16 Sep 2008 12:53:13 +0200
Subject: [OT] m$ activesync with cyrus backend
Message-ID: <1221562393.3692.31.camel@sumatra.ccuse.com>

hi all,

an off-topic question, but maybe you can help.

i've got a lot of iphones to deploy and funambol will only sync contacts
(apple has not placed access to calender/notes/tasks in their api).

iphone does support activesync to do wireless sync to an exchange
server.

is there a way to mimic exchange server in the linux environment where i
can keep my cyrus/postfix/amavis install -- is there a linux app that
speaks "exchange"?

cheers

charles



From adam at morrison-ind.com  Tue Sep 16 06:57:47 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Tue, 16 Sep 2008 06:57:47 -0400
Subject: suggestion need to design an  email system.
In-Reply-To: <48CF8394.9050207@infoservices.in>
References: <48CF8394.9050207@infoservices.in>
Message-ID: <1221562667.7022.5.camel@linux-nnci.site>

> I have a running email system which I made in 2006 based on
> postfix+cyrus+openldap. The authentication is based on openldap.
> I have done some reading through net and find a new mail server dovecot.
> I have to create another email system for multidomain based hosting
> server where both scalability as well as performance should be in prime
> consideration. I need your kind suggestion for this. shall I use dovecot
> or cyrus can fit my requirement ? 

I don't know why anyone would use a server other than Cyrus;  Cyrus'
scalability is very well known, configuration is simple, performance is
awesome, and the depth of features is unique among Open Source servers.

> another important questing ; Is there
> any webinterface which can manage the mail system based on LDAP ?

No idea since I don't understand what "?manage the mail system" means.

> There are many with MySql but any application which can work with
> postfix+cyrus+openldap ?

Sure, if you want to do anything with MySQL there are usually hundreds
of poorly maintained solutions.   If scale is an issue I'd stuck with
OpenLDAP, *nothing* is faster than OpenLDAP, and Symas has the
benchmarks to prove it.


From farislinux at yahoo.com  Tue Sep 16 07:04:15 2008
From: farislinux at yahoo.com (faris)
Date: Tue, 16 Sep 2008 04:04:15 -0700 (PDT)
Subject: Subject: Re: Cyrus Imap Benchmark
Message-ID: <827107.16113.qm@web33206.mail.mud.yahoo.com>

Dear Hagedorn,
?
We have 100K accounts expecting 1000 concurrent IMAP connections. 
?
Thanks,
?
Faris??


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080916/5e49baa0/attachment.html 

From lartc at manchotnetworks.net  Tue Sep 16 07:15:45 2008
From: lartc at manchotnetworks.net (lartc)
Date: Tue, 16 Sep 2008 13:15:45 +0200
Subject: suggestion need to design an  email system.
In-Reply-To: <1221562667.7022.5.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
Message-ID: <1221563745.3692.39.camel@sumatra.ccuse.com>

hi,

<snip>
> > another important questing ; Is there
> > any webinterface which can manage the mail system based on LDAP ?

yes there is -- and it's great.

https://oss.gonicus.de/labs/gosa/

gosa manages your ldap, and therefore your mail system. takes a bit of
setup, but all your accounts can be managed here. 

cheers




From farislinux at yahoo.com  Tue Sep 16 07:17:04 2008
From: farislinux at yahoo.com (faris)
Date: Tue, 16 Sep 2008 04:17:04 -0700 (PDT)
Subject: Cyrus Imap Benchmark
Message-ID: <556741.10875.qm@web33201.mail.mud.yahoo.com>

Dear Bron,
?
If i upgrade cyrus-imap to a newer version, will it effect the current mailboxes ?
?
When we partition drives, we make (3 drives) raid5 array with ext3 partitions. we can expand RAM but how can we 
?
Also u said to split meta for more effeciency.. how can we do split it?
?
Thanks,
?
Faris


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080916/5f06d2d7/attachment.html 

From joydeep at infoservices.in  Tue Sep 16 07:32:54 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Tue, 16 Sep 2008 17:02:54 +0530
Subject: suggestion need to design an  email system.
In-Reply-To: <1221562667.7022.5.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
Message-ID: <48CF9966.4090900@infoservices.in>

Adam Tauno Williams wrote:
>> I have a running email system which I made in 2006 based on
>> postfix+cyrus+openldap. The authentication is based on openldap.
>> I have done some reading through net and find a new mail server dovecot.
>> I have to create another email system for multidomain based hosting
>> server where both scalability as well as performance should be in prime
>> consideration. I need your kind suggestion for this. shall I use dovecot
>> or cyrus can fit my requirement ? 
>>     
>
> I don't know why anyone would use a server other than Cyrus;  Cyrus'
> scalability is very well known, configuration is simple, performance is
> awesome, and the depth of features is unique among Open Source servers.
>
>   
>> another important questing ; Is there
>> any webinterface which can manage the mail system based on LDAP ?
>>     
>
> No idea since I don't understand what "?manage the mail system" means.
>
>   

Hi Adam,

Thanks for your kind response.
I am looking an webinterface  like gui-cyradm or any other which can
allow the admin to create/delete account and domain from a web
interface. The problem is I have not found anything which can work based
on openldap. Even gui-cyradm need mysql for user authentication.
Could you kindly suggest anything ?
thanks
>> There are many with MySql but any application which can work with
>> postfix+cyrus+openldap ?
>>     
>
> Sure, if you want to do anything with MySQL there are usually hundreds
> of poorly maintained solutions.   If scale is an issue I'd stuck with
> OpenLDAP, *nothing* is faster than OpenLDAP, and Symas has the
> benchmarks to prove it.
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From joydeep at infoservices.in  Tue Sep 16 07:40:21 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Tue, 16 Sep 2008 17:10:21 +0530
Subject: suggestion need to design an  email system.
In-Reply-To: <1221563745.3692.39.camel@sumatra.ccuse.com>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>
	<1221563745.3692.39.camel@sumatra.ccuse.com>
Message-ID: <48CF9B25.60108@infoservices.in>

lartc wrote:
> hi,
>
> <snip>
>   
>>> another important questing ; Is there
>>> any webinterface which can manage the mail system based on LDAP ?
>>>       
>
> yes there is -- and it's great.
>
> https://oss.gonicus.de/labs/gosa/
>
> gosa manages your ldap, and therefore your mail system. takes a bit of
> setup, but all your accounts can be managed here. 
>   

Thanks for the link, but anything which is only for the email server ?
any thin application ?
Presently I do the management using egroupware
> cheers
>
>
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
>   


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From lartc at manchotnetworks.net  Tue Sep 16 07:56:04 2008
From: lartc at manchotnetworks.net (lartc)
Date: Tue, 16 Sep 2008 13:56:04 +0200
Subject: suggestion need to design an  email system.
In-Reply-To: <48CF9B25.60108@infoservices.in>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<1221563745.3692.39.camel@sumatra.ccuse.com>
	<48CF9B25.60108@infoservices.in>
Message-ID: <1221566164.3692.44.camel@sumatra.ccuse.com>

hi,

well, you can edit the gosa config file to only show you the users and
their e-mail, etc. you're not obligated to use the entire system ... 

when install it for clients, i only leave a few pieces of functionality
(so they don't blow their foot off).

cheers

charles



From cvizitiu at gbif.org  Tue Sep 16 08:17:57 2008
From: cvizitiu at gbif.org (Ciprian Marius Vizitiu)
Date: Tue, 16 Sep 2008 14:17:57 +0200
Subject: Which 2.3.x version to match 2.2.12 in stability? :-)
Message-ID: <038301c917f6$40b64310$c222c930$@org>

Hi everyone, 

 

As much as I hate it time has come to upgrade my very well behaved Cyrus
imapd so I was wondering: given the rock solid stability I have experienced
with 2.2.12 is there any 2.3.x Cyrus with some close record of stability?
What is your experience? I don't care about replication, I only run one
server for 40 mailboxes, true some of my users have like 25.000 emails in
one folder but no fancy features required just "plain IMAP". :-) What would
be your advice? Ok, other than "stay with 2.2.12!"? 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080916/b71165fe/attachment.html 

From list at joreybump.com  Tue Sep 16 08:46:00 2008
From: list at joreybump.com (Jorey Bump)
Date: Tue, 16 Sep 2008 08:46:00 -0400
Subject: Which 2.3.x version to match 2.2.12 in stability? :-)
In-Reply-To: <038301c917f6$40b64310$c222c930$@org>
References: <038301c917f6$40b64310$c222c930$@org>
Message-ID: <48CFAA88.6030707@joreybump.com>

Ciprian Marius Vizitiu wrote, at 09/16/2008 08:17 AM:

> As much as I hate it time has come to upgrade my very well behaved Cyrus
> imapd so I was wondering: given the rock solid stability I have
> experienced with 2.2.12 is there any 2.3.x Cyrus with some close record
> of stability? What is your experience? I don't care about replication, I
> only run one server for 40 mailboxes, true some of my users have like
> 25.000 emails in one folder but no fancy features required just "plain
> IMAP". :-) What would be your advice? Ok, other than "stay with 2.2.12!"?

I don't think there's much choice other than the latest testing release,
2.3.12p2. It has the most features to date and addresses some
significant bugs. I have sites that match your profile, and I've been
pleased with it, so far. I've been following the the 2.3.x series for a
while, now, and wouldn't go back to any previous version.



From Hagedorn at uni-koeln.de  Tue Sep 16 09:22:38 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Tue, 16 Sep 2008 15:22:38 +0200
Subject: Which 2.3.x version to match 2.2.12 in stability? :-)
In-Reply-To: <038301c917f6$40b64310$c222c930$@org>
References: <038301c917f6$40b64310$c222c930$@org>
Message-ID: <089B31F85C01FB5D66ED75FD@tyrion.rrz.uni-koeln.de>

--On 16. September 2008 14:17:57 +0200 Ciprian Marius Vizitiu 
<cvizitiu at gbif.org> wrote:

> As much as I hate it time has come to upgrade my very well behaved Cyrus
> imapd so I was wondering: given the rock solid stability I have
> experienced with 2.2.12 is there any 2.3.x Cyrus with some close record
> of stability?

Sure! 2.3.x is at least as stable as 2.2.x, I'd say even more so. We're 
currently running 2.3.11, but I'd use the latest version. We're planning on 
upgrading soon.
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080916/2eba6e55/attachment.bin 

From dwhite at olp.net  Tue Sep 16 09:50:39 2008
From: dwhite at olp.net (Dan White)
Date: Tue, 16 Sep 2008 08:50:39 -0500
Subject: Cyrus Imap Benchmark
In-Reply-To: <556741.10875.qm@web33201.mail.mud.yahoo.com>
References: <556741.10875.qm@web33201.mail.mud.yahoo.com>
Message-ID: <48CFB9AF.7050607@olp.net>

faris wrote:
> Dear Bron,
>  
> If i upgrade cyrus-imap to a newer version, will it effect the current 
> mailboxes ?
>  
> When we partition drives, we make (3 drives) raid5 array with ext3 
> partitions. we can expand RAM but how can we
>  
> Also u said to split meta for more effeciency.. how can we do split it?
>  
> Thanks,
>  
> Faris
>

Faris,

There are several upgrade issues addressed in the documentation, 
including how to split meta data into its own partition. See 
'doc/install-upgrade.html' in the latest release.

- Dan

From wes at umich.edu  Tue Sep 16 12:54:29 2008
From: wes at umich.edu (Wesley Craig)
Date: Tue, 16 Sep 2008 12:54:29 -0400
Subject: Which 2.3.x version to match 2.2.12 in stability? :-)
In-Reply-To: <038301c917f6$40b64310$c222c930$@org>
References: <038301c917f6$40b64310$c222c930$@org>
Message-ID: <11E2D8A5-D85C-4DE8-BC0F-491B6B523E8D@umich.edu>

I'd suggest waiting for 2.3.13, which is likely to appear soon.  It  
will have numerous significant bug fixes.  In fact, if you're  
planning to do any testing, contributing to the testing of 2.3.13  
release candidates would be very helpful.

:wes

On 16 Sep 2008, at 08:17, Ciprian Marius Vizitiu wrote:
> As much as I hate it time has come to upgrade my very well behaved  
> Cyrus imapd so I was wondering: given the rock solid stability I  
> have experienced with 2.2.12 is there any 2.3.x Cyrus with some  
> close record of stability? What is your experience? I don't care  
> about replication, I only run one server for 40 mailboxes, true  
> some of my users have like 25.000 emails in one folder but no fancy  
> features required just "plain IMAP". :-) What would be your advice?  
> Ok, other than "stay with 2.2.12!"?
>


From adam at morrison-ind.com  Tue Sep 16 14:24:06 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Tue, 16 Sep 2008 14:24:06 -0400
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <1221562393.3692.31.camel@sumatra.ccuse.com>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
Message-ID: <1221589446.20544.18.camel@linux-nnci.site>

> an off-topic question, but maybe you can help.
> i've got a lot of iphones to deploy and funambol will only sync contacts
> (apple has not placed access to calender/notes/tasks in their api).

<http://freshmeat.net/projects/z-push/>

I've been meaning to look into it as an alternative to Funambol (what a
monster!).

I don't know if it supports real IMAP or not.

> iphone does support activesync to do wireless sync to an exchange
> server.
> is there a way to mimic exchange server in the linux environment where i
> can keep my cyrus/postfix/amavis install -- is there a linux app that
> speaks "exchange"?

-- 
          Consonance: an Open Source .NET OpenGroupware client.
 Contact:awilliam at whitemiceconsulting.com   http://freshmeat.net/projects/consonance/


From cyrus at fiddaman.net  Tue Sep 16 14:31:31 2008
From: cyrus at fiddaman.net (Andy Fiddaman)
Date: Tue, 16 Sep 2008 18:31:31 +0000 (GMT)
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <1221562393.3692.31.camel@sumatra.ccuse.com>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
Message-ID: <alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>


On Tue, 16 Sep 2008, lartc wrote:
;
; is there a way to mimic exchange server in the linux environment where i
; can keep my cyrus/postfix/amavis install -- is there a linux app that
; speaks "exchange"?

Z-Push (http://z-push.sourceforge.net/) does the job nicely. I use that
for my iPhone with Cyrus as the backend.

HTH.

Andy

From flathill at netspring.co.jp  Tue Sep 16 23:42:02 2008
From: flathill at netspring.co.jp (Seiichirou Hiraoka)
Date: Wed, 17 Sep 2008 12:42:02 +0900 (JST)
Subject: Can I use Intermediate SSL server certificate?
In-Reply-To: <20080912.110909.28800445.flathill@netspring.co.jp>
References: <20080912.110909.28800445.flathill@netspring.co.jp>
Message-ID: <20080917.124202.08325076.flathill@netspring.co.jp>

Hello,

I found the message how to use Intermediate SSL server
certificate and success to use.
The message  was found following e-mail archive.
(info-cyrus 41872)

  http://cyrusimap.web.cmu.edu/archive/

Thank you very much!

- flathill

From: Seiichirou Hiraoka <flathill at netspring.co.jp>
Subject: Can I use Intermediate SSL server certificate?
Date: Fri, 12 Sep 2008 11:09:09 +0900 (JST)

> Hello,
> 
> Now, I use SSL server certificate without
> intermediate certificate.
> 
> Nowadays, only the intermediate SSL server certificate
> will be published in Verisign.
> 
> Please teach me if there is a method of using the
> intermediate certificate with Cyrus.
> 
> Bests regards,
> 
> - flathill

From joydeep at infoservices.in  Wed Sep 17 02:17:04 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Wed, 17 Sep 2008 11:47:04 +0530
Subject: suggestion need to design an  email system.
In-Reply-To: <1221566164.3692.44.camel@sumatra.ccuse.com>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<1221563745.3692.39.camel@sumatra.ccuse.com>	<48CF9B25.60108@infoservices.in>
	<1221566164.3692.44.camel@sumatra.ccuse.com>
Message-ID: <48D0A0E0.1000204@infoservices.in>

lartc wrote:
> hi,
>
> well, you can edit the gosa config file to only show you the users and
> their e-mail, etc. you're not obligated to use the entire system ... 
>
> when install it for clients, i only leave a few pieces of functionality
> (so they don't blow their foot off).
>
> cheers
>
> charles
>   

Thanks, I'll definitely try it.


>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
>   


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From emlists at gmail.com  Wed Sep 17 03:30:48 2008
From: emlists at gmail.com (Adam D)
Date: Wed, 17 Sep 2008 00:30:48 -0700
Subject: Issues with user.sub files - subscription files hangs system.
In-Reply-To: <48CB26A3.6090603@gmail.com>
References: <48CB26A3.6090603@gmail.com>
Message-ID: <48D0B228.3090404@gmail.com>

Adam D wrote:
> I have noticed this error in the log:
> Sep 12 18:57:44 vts-post cyrus/imap[19629]: IOERROR: locking
> /var/lib/cyrus/domain/W/domain1/user/A/userbox.sub: Interrupted system call
>
> Soon afterwards I notice imapd runs at 99.8 % and I can not kill the
> process.  It looks like the file is locked and can't be written to?  I
> saw another file called userbox.sub.NEW but even that files can't be
> read.  When I attempt the terminal freezes.  I also noticed the system
> can't be rebooted as well.  I don't know what could be causing this. 
> Does anyone have any incite? 
>
> Example:
> -rw------- 1 cyrus mail  31K Sep 12 18:22 user.seen
> -rw------- 1 cyrus mail  14K May 24 10:21 user.sub
> -rw------- 1 cyrus mail 4.0K Sep 11 18:25 user.sub.NEW
>
> I can view user.sub but it has not been updated since May and the
> user.sub.NEW apears as an binary file or a DB
>
>
>   PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+ 
> COMMAND                                 
> 19484 cyrus     25   0  154m 4772 3776 R 99.8  0.8   7:51.32 imapd     
>
> -Adam

I am figuring this has to do with the user.sub file and still locked. 
Any time subscription is access imap creates a new file user.sub.NEW
instead of user.sub and becomes a run-a-way process. 

No matter what I do or know can change the subscription based files..
flat or skipless.  Right now the file  is a flat file and while
converting it to skiplist I get the same issue as above - imap process
or in this case cvt_cryusdb ll the processor resources and becomes a
run-a-way process.

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+ 
COMMAND                                
 8621 root      25   0 86848 2284 1848 R 96.1  0.4  81:51.64
cvt_cyrusdb         

My log shows this:
Sep 16 20:25:27 mail cyrus/cvt_cyrusdb[8545]: skiplist: invalid magic
header: /var/lib/cyrus/domain/domain1/user/user1.sub

Also when I try to read the "converted" user1.sub file using less I lose
any ability with the terminal.  I am so at a loss and have been really
digging around for days trying to figure this out..

We are using Ubuntu 8.04 on this particular amd 64 box running virtually
within xen.

Please help.
-Adam



From mueller at bkr-ac.de  Wed Sep 17 04:34:59 2008
From: mueller at bkr-ac.de (Jens)
Date: Wed, 17 Sep 2008 10:34:59 +0200
Subject: Issues with user.sub files - subscription files hangs system.
In-Reply-To: <48D0B228.3090404@gmail.com>
References: <48CB26A3.6090603@gmail.com> <48D0B228.3090404@gmail.com>
Message-ID: <48D0C133.9070808@bkr-ac.de>

Adam D schrieb:
> Adam D wrote:
>> I have noticed this error in the log:
>> Sep 12 18:57:44 vts-post cyrus/imap[19629]: IOERROR: locking
>> /var/lib/cyrus/domain/W/domain1/user/A/userbox.sub: Interrupted system call
>>
>> Soon afterwards I notice imapd runs at 99.8 % and I can not kill the
>> process.  It looks like the file is locked and can't be written to?  I
>> saw another file called userbox.sub.NEW but even that files can't be
>> read.  When I attempt the terminal freezes.  I also noticed the system
>> can't be rebooted as well.  I don't know what could be causing this. 
>> Does anyone have any incite? 
[...]
> We are using Ubuntu 8.04 on this particular amd 64 box running virtually
> within xen.

I had the same problem with Ubuntu 7.10 running in VMWare. I was not
able to fix it. My solution was a system-upgrade to 8.04. The problem
disappeared. I just hope it does not appear again. Some other users
discovered the same problem and were able to solve it with an upgrade, too.

Sorry not to help you,
Jens

-- 
"The only proof that intelligent life exists in the universe
 is that it hasn't tried to contact us yet."     -    Calvin

From joydeep at infoservices.in  Wed Sep 17 05:01:22 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Wed, 17 Sep 2008 14:31:22 +0530
Subject: can web-cyradm work with ldap ?
Message-ID: <48D0C762.6000403@infoservices.in>

Hello List,

The best tool to manage the cyrus is web-cyradm I think.
Is there any way to configure web-cyradm with openldap ?
Has any one done it by any chance ?
Kindly suggest.

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From casper at snigelpost.org  Wed Sep 17 05:57:39 2008
From: casper at snigelpost.org (Casper)
Date: Wed, 17 Sep 2008 11:57:39 +0200 (CEST)
Subject: STAGE. DIR
In-Reply-To: <48D0C762.6000403@infoservices.in>
References: <48D0C762.6000403@infoservices.in>
Message-ID: <2559.83.249.142.34.1221645459.squirrel@inkorgen.com>

Hi.

I wonder what the stage dir is...
My stagedir is 21GB, those 21GB could i use somewhere else.

mail2# du -sh /imap/stage./
 21G    /imap/stage./
mail2#

Can i delete everything in this directory?



/Casper





From huydd at cdit.com.vn  Wed Sep 17 08:06:43 2008
From: huydd at cdit.com.vn (Do Duc Huy)
Date: Wed, 17 Sep 2008 19:06:43 +0700
Subject: suggestion need to design an  email system.
In-Reply-To: <48D0A0E0.1000204@infoservices.in>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<1221563745.3692.39.camel@sumatra.ccuse.com>	<48CF9B25.60108@infoservices.in><1221566164.3692.44.camel@sumatra.ccuse.com>
	<48D0A0E0.1000204@infoservices.in>
Message-ID: <C5ED5D487FE4448E83B939E041F442AB@tththuydd>

Hi,
I am in a same situation with you about system components. I have used
postfix+cyrus+ldap for email system since 2001 and system performance is
still good now. But I have to face with two problems with this system. The
first one is GUI for user and administrator. Squirrelmail was helpful enough
for user but I have to develop my own administration page for admin
purposes. Thanks for the link about Gosa you have sent, I will check it
later.
My question is about my second problem. It 's about antispam and antivirus.
I have used amavis for spam and virus filter. This can block virus very well
but it have no effect in blocking spam mail, I think.
So is there any one know about other opensource spam filter products which
work fine with postfix+cyrus+openldap and helpful in antispam

Thanks in advance

----
Do Duc Huy
Centre for Development of Information Technology - CDiT
Viet Nam Posts & Telecommunications Group
Address: 2nd Floor, VCCI Building, 9 Dao Duy Anh str,Dongda dist,Hanoi 
Tel: (+84) 04 5 742 879
Fax: (+84) 04 5 742 857
Mobi: (+84) 0904 34 38 38 

-----Original Message-----
From: info-cyrus-bounces at lists.andrew.cmu.edu
[mailto:info-cyrus-bounces at lists.andrew.cmu.edu] On Behalf Of J. Bakshi
Sent: Wednesday, September 17, 2008 1:17 PM
To: lartc
Cc: Cyrus Mailing List
Subject: Re: suggestion need to design an email system.

lartc wrote:
> hi,
>
> well, you can edit the gosa config file to only show you the users and
> their e-mail, etc. you're not obligated to use the entire system ... 
>
> when install it for clients, i only leave a few pieces of functionality
> (so they don't blow their foot off).
>
> cheers
>
> charles
>   

Thanks, I'll definitely try it.


>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
>   


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

----
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


From jens.hoffrichter at gmail.com  Wed Sep 17 09:33:58 2008
From: jens.hoffrichter at gmail.com (Jens Hoffrichter)
Date: Wed, 17 Sep 2008 15:33:58 +0200
Subject: suggestion need to design an email system.
In-Reply-To: <1221562667.7022.5.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
Message-ID: <9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>

Hi all,

I know I will take some heat for this (as I know this is a cyrus
mailinglist), but I'm going to offer some points for dovecot. I'm all
for informed decisions, where one can weigh points against each other
and decide on that basis.

First of all, I have administrated both courier and cyrus imap in a
production environment (with cyrus scaling up way beyond 100k
mailboxes), and I have made recently some tests with dovecot (I
haven't seen it yet in production), which I found quite interesting.

I noticed that dovecot and cyrus don't differ that much in speed to
each other. Both seem to excel at certain points, while being weaker
at another. But overall the performance on a huge mailbox seemed to be
comparable. Dovecot seemed to be slightly better at searching in the
mailbox, esp. searching for common terms you have searched for before,
selecting of single mailboxes and downloading all headers of a
mailbox, while cyrus seemed to be slightly better in getting the
structure of a mailbox (the "(FLAGS INTERNALDATE RFC822.SIZE ENVELOPE
UID BODYSTRUCTURE)" fetch command, which seems to be commonly used by
mailclients.

What really intrigued me about dovecot was the ability to run on
standard mailbox formats, which may not be much of an issue when
running in a pure cyrus environment, but is a huge plus when migrating
from another server. Especially the "self-healing indexes" which were
built on first use of a mailbox, and not using a reconstruct. So
getting dovecot to run was very simple. And I like programs which take
a common format, and don't think they need to re-invent the wheel.

Another thing which really intrigued me was the inherent
cluster-ability of dovecot, which is a huge PITA to get to run on
cyrus (as I have just implemented it a couple of months ago). Yet I
only have read about it in the documentation, and not actually seen it
in action. But at least they thought about running on a clustered file
system........

And the last thing is SASL. Dovecot needs no SASL, it brings
authenticators for a variety of sources, and offers postfix and exim
auth mechs as well. This may be a very personal thing, but if I can
work around SASL, I'm very, very glad about that. SASL may offer
everything you may need in a century of running a mailserver, but
getting it to run is just painful, and debugging is non-existant (at
least the last time I tried to implement it, which is a couple of
years ago. Since then I worked around the issue whereever I could).

Cyrus has undisputed the broadest implementation of the IMAP protocol
in the open source world, especially regarding shared folders. If you
need that, there is no way around cyrus. It has a very broad user
base, and has proven itsself to be quite solid in terms of scalability
and stability. Dovecot has yet to prove that (at least to me).

If I personally had the chance, I would give dovecot a shot, at least
in a testing environment. But probably mostly out of curiosity, and
because "Its new" ;) But except for the missing support for shared
mail folders, I see no real reasons against dovecot, at least not for
giving it a try.

And please don't take this as a personal insult to all hardcore cyrus
evangelist. I tried to be just and unbiased, and after all, it is MY
PERSONAL OPINION. On this mailinglist, you don't need one more person
voting for cyrus, there are enough of those........ ;)

Jens

From hmh at debian.org  Wed Sep 17 09:56:07 2008
From: hmh at debian.org (Henrique de Moraes Holschuh)
Date: Wed, 17 Sep 2008 10:56:07 -0300
Subject: suggestion need to design an  email system.
In-Reply-To: <C5ED5D487FE4448E83B939E041F442AB@tththuydd>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<1221563745.3692.39.camel@sumatra.ccuse.com>
	<48D0A0E0.1000204@infoservices.in>
	<C5ED5D487FE4448E83B939E041F442AB@tththuydd>
Message-ID: <20080917135607.GB27058@khazad-dum.debian.net>

On Wed, 17 Sep 2008, Do Duc Huy wrote:
> My question is about my second problem. It 's about antispam and antivirus.
> I have used amavis for spam and virus filter. This can block virus very well
> but it have no effect in blocking spam mail, I think.

Get the newest version of amavisd-new, and read the entire documentation for
it.  You can plug it to DSPAM and SpamAssassin.

-- 
  "One disk to rule them all, One disk to find them. One disk to bring
  them all and in the darkness grind them. In the Land of Redmond
  where the shadows lie." -- The Silicon Valley Tarot
  Henrique Holschuh

From adam at morrison-ind.com  Wed Sep 17 10:49:27 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Wed, 17 Sep 2008 10:49:27 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
Message-ID: <1221662967.5313.28.camel@linux-nnci.site>

> I noticed that dovecot and cyrus don't differ that much in speed to
> each other. Both seem to excel at certain points, while being weaker
> at another. But overall the performance on a huge mailbox seemed to be
> comparable. Dovecot seemed to be slightly better at searching in the
> mailbox, esp.

Do you have SQUAT enabled on Cyrus?  Are you sure that the IMAP client
in question sends searches to the server (aka: not using Thunderbird)?

> What really intrigued me about dovecot was the ability to run on
> standard mailbox formats, which may not be much of an issue when
> running in a pure cyrus environment, but is a huge plus when migrating
> from another server. 

I don't see why it is an advantage for migration.  Tools like imapsync
don't care.

> Especially the "self-healing indexes" which were
> built on first use of a mailbox, and not using a reconstruct. So
> getting dovecot to run was very simple. And I like programs which take
> a common format, and don't think they need to re-invent the wheel.

I actually view this as a strong negative as it incentivises people to
muck about in the mailstore rather than using the tool-chain.   All
operations on a "real" server (IMO) should be performed via a tool and
not by hacking about beneath the service.

> And the last thing is SASL. Dovecot needs no SASL, it brings
> authenticators for a variety of sources, and offers postfix and exim
> auth mechs as well. This may be a very personal thing, but if I can
> work around SASL, I'm very, very glad about that. SASL may offer
> everything you may need in a century of running a mailserver, but
> getting it to run is just painful, and debugging is non-existant (at
> least the last time I tried to implement it, which is a couple of
> years ago. Since then I worked around the issue whereever I could).

Again, I just disagree.  Most SASL operations these days, "just work".
And when using something like GSSAPI SASL is a nicely known quantity.

Documentation of SASL is generally pretty bad, but hey, this is Open
Source.  In general *ALL* the documentation is crap. :)

> Cyrus has undisputed the broadest implementation of the IMAP protocol
> in the open source world, especially regarding shared folders. If you
> need that, there is no way around cyrus. It has a very broad user
> base, and has proven itsself to be quite solid in terms of scalability
> and stability. Dovecot has yet to prove that (at least to me).
> If I personally had the chance, I would give dovecot a shot, at least
> in a testing environment. But probably mostly out of curiosity, and
> because "Its new" ;) But except for the missing support for shared
> mail folders, I see no real reasons against dovecot, at least not for
> giving it a try.

Does Dovecot support:
 - Delayed expunge
 - Expiration (like ipurge)
 - Single-instance storage

Not that Cyrus couldn't do with some improvement.  The notifyd, which is
really interesting, is basically useless.  It would be very nice to have
a way to do push e-mail without polling mailboxes.   Neither, I believe,
offer any real reporting, via SNMP or any other mechanism so all
capacity planning involves crawling around the OS collecting various
statistics.  (I'm pretty sure Cyrus actually has some SNMP support, but
documentation is zero;  I also haven't looked in awhile).
 
> And please don't take this as a personal insult to all hardcore cyrus
> evangelist. I tried to be just and unbiased, and after all, it is MY
> PERSONAL OPINION. On this mailinglist, you don't need one more person
> voting for cyrus, there are enough of those........ ;)

Yep. :)


From simon.matter at invoca.ch  Wed Sep 17 11:11:33 2008
From: simon.matter at invoca.ch (Simon Matter)
Date: Wed, 17 Sep 2008 17:11:33 +0200 (CEST)
Subject: suggestion need to design an email system.
In-Reply-To: <9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
Message-ID: <a684d676b665ed730a864bfef45d9e8f.squirrel@webmail.bi.corp.invoca.ch>

> Another thing which really intrigued me was the inherent
> cluster-ability of dovecot, which is a huge PITA to get to run on
> cyrus (as I have just implemented it a couple of months ago). Yet I
> only have read about it in the documentation, and not actually seen it
> in action. But at least they thought about running on a clustered file
> system........

Cyrus works quite well on a cluster with clustered filesystem. Do you talk
about murder/replication or a 'simple' cluster?

Simon


From jens.hoffrichter at gmail.com  Wed Sep 17 11:40:24 2008
From: jens.hoffrichter at gmail.com (Jens Hoffrichter)
Date: Wed, 17 Sep 2008 17:40:24 +0200
Subject: suggestion need to design an email system.
In-Reply-To: <1221662967.5313.28.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
Message-ID: <9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>

Heya :)

2008/9/17 Adam Tauno Williams <adam at morrison-ind.com>:

>> I noticed that dovecot and cyrus don't differ that much in speed to
>> each other. Both seem to excel at certain points, while being weaker
>> at another. But overall the performance on a huge mailbox seemed to be
>> comparable. Dovecot seemed to be slightly better at searching in the
>> mailbox, esp.
> Do you have SQUAT enabled on Cyrus?  Are you sure that the IMAP client
> in question sends searches to the server (aka: not using Thunderbird)?
Nope, I hadn't enabled squat there. It was a plain Debian default
install for all the three mailservers. And I don't see this values as
the absolute truth, as they weren't done on a carefully engineered
test environment, but on a vmware I put together for that purpose. But
I noticed certain trends there, and I only will talk about them
instead of absolute numbers :)

And yes, I am certain that the search was sent to the server, as it
was a test script written on top of the python imap library, and I
measured times in there.

Again, I repeat, I don't take those numbers at a face value, but
rather wanted to get an overall impression, if it would be useful to
pursue dovecot instead of cyrus (and because a colleague of mine
emphasized always the point that cyrus is the fastest OSS IMAP server
out there, and I wanted to see that for myself ;) )

>> What really intrigued me about dovecot was the ability to run on
>> standard mailbox formats, which may not be much of an issue when
>> running in a pure cyrus environment, but is a huge plus when migrating
>> from another server.
> I don't see why it is an advantage for migration.  Tools like imapsync
> don't care.
Certainly it doesn't do much for a smaller system. But today I
discussed with the same colleague about something I added to a
migration process which added 1s per mailbox to the migration
process.......And that became a huge issue. ;)

I don't think that an imap sync is the fastest way of doing a migrate
of a complete server.

But that is totally unrelated to the point I was trying to make, it
just came to my mind when talking about migration.

I really liked the fact that I could just stop courier on the vmware,
start dovecot and use the same mailstore without any conversion. It
would have been the same for an uw-imapd, with just a simple change in
the config file, instead of a conversion for all of my mailboxes. I
see that as a plus, and don't see anything negative there.

>> Especially the "self-healing indexes" which were
>> built on first use of a mailbox, and not using a reconstruct. So
>> getting dovecot to run was very simple. And I like programs which take
>> a common format, and don't think they need to re-invent the wheel.
> I actually view this as a strong negative as it incentivises people to
> muck about in the mailstore rather than using the tool-chain.   All
> operations on a "real" server (IMO) should be performed via a tool and
> not by hacking about beneath the service.
Well, that is an issue about access rights management instead of imap
server things. If I allow my users to muck directly in their
mailstorage directories, I need to live with the consequences. For me,
everything done to a mailbox should be done through my imap server. So
on my servers, users don't have direct access to their mailbox (if
they have a unix user at all).

The point I was trying to make here: Why does cyrus need it's own
structure for the mailboxes, which is similar, but not wholly
compatible, to maildir. Maildir and cyrus both suffer from the same
disadvantages (huge needs in terms of inodes etc.), yet I see no
distinctive advantage for the cyrus mailbox format to maildir.
Contrary, I could restore a maildir mailbox including seen state
completely, even if my metadata crashes.

>> And the last thing is SASL. Dovecot needs no SASL, it brings
>> authenticators for a variety of sources, and offers postfix and exim
>> auth mechs as well. This may be a very personal thing, but if I can
>> work around SASL, I'm very, very glad about that. SASL may offer
>> everything you may need in a century of running a mailserver, but
>> getting it to run is just painful, and debugging is non-existant (at
>> least the last time I tried to implement it, which is a couple of
>> years ago. Since then I worked around the issue whereever I could).
> Again, I just disagree.  Most SASL operations these days, "just work".
> And when using something like GSSAPI SASL is a nicely known quantity.
>
> Documentation of SASL is generally pretty bad, but hey, this is Open
> Source.  In general *ALL* the documentation is crap. :)
Well, as I said, I have given up on SASL like 4 years ago. I tried to
implement a simple authentication against a postgres database for
postfix, and I fiddled around for 3 days without coming anywhere near
a success.

I ended up emulating the saslauthd protocol from an external program,
which accesses the database directly. That worked like a charm, and
was considerably less work.

Since then, I never bothered with SASL ago until a couple of weeks
ago, when I tried to figure out how a lmtpproxyd authenticated against
a cyrus backend, and again I was left in the rain, with no real hints
where either one really took its password from. We switched to
not-authenticated ltmp then....

> Does Dovecot support:
>  - Delayed expunge
>  - Expiration (like ipurge)
>  - Single-instance storage
I honestly don't know ;) I haven't yet looked into those things, but
from what I read up to now, I only read that shared folders are the
biggest advantage of cyrus. So I suspect something like that is
implemented, at least for maildir. But I really don't know.

And what do you mean about single-instance storage?

>> And please don't take this as a personal insult to all hardcore cyrus
>> evangelist. I tried to be just and unbiased, and after all, it is MY
>> PERSONAL OPINION. On this mailinglist, you don't need one more person
>> voting for cyrus, there are enough of those........ ;)
>
> Yep. :)
Phew, that was less heat than I feared I would take. I hope you don't
mind an objective discussion, and I certainly belief that this
discussion could be useful for people who need to decide between IMAP
servers.

I don't think that there is a solution which fits it all, and reading
about possibilities might broaden up your point of view - which is
always good, imo.

As I said, I have no experience yet with dovecot in a production
environment, and after I have tried it I might say that it is total
crap. But it looks quite promising up to now.

Jens

From jens.hoffrichter at gmail.com  Wed Sep 17 11:47:14 2008
From: jens.hoffrichter at gmail.com (Jens Hoffrichter)
Date: Wed, 17 Sep 2008 17:47:14 +0200
Subject: suggestion need to design an email system.
In-Reply-To: <a684d676b665ed730a864bfef45d9e8f.squirrel@webmail.bi.corp.invoca.ch>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<a684d676b665ed730a864bfef45d9e8f.squirrel@webmail.bi.corp.invoca.ch>
Message-ID: <9b48a1210809170847v5023e3d3k81940337fbe27d2@mail.gmail.com>

Hello,

2008/9/17 Simon Matter <simon.matter at invoca.ch>:
>> Another thing which really intrigued me was the inherent
>> cluster-ability of dovecot, which is a huge PITA to get to run on
>> cyrus (as I have just implemented it a couple of months ago). Yet I
>> only have read about it in the documentation, and not actually seen it
>> in action. But at least they thought about running on a clustered file
>> system........
> Cyrus works quite well on a cluster with clustered filesystem. Do you talk
> about murder/replication or a 'simple' cluster?
Sorry, I really didn't make myself clear here.

I'm not talking about an active/passive cluster, where one cyrus
instance is running and another server takes over when the main one
dies, but an active/active configuration, where several nodes access
the same meta databases and mailboxes which is residing on a SAN with
a clustered filesystem (in my case GFS).

And cyrus had some issues running in that configuration which took us
a week or two to figure out, which were related to the berkeley db
support compiled in. There are some things regarding mmap file io, GFS
and mutexes which doesn't really work. After I compiled cyrus without
bdb support, it now works like a charm, and we have now 5k mailboxes
on the 3 machine cluster, testing it now for a couple of weeks before
we migrate the rest of the mailboxes :)

Dovecot seemed to have thought and adresses those issues about
concurrent access, and it just seems to play more nicely in a
heterogenous environment than cyrus, which needs exclusive management
access to the mailstore. At least, if you follow best practices, and
everything else is a bit of a guessing game.....Been there, done that
;)

Jens

From emlists at gmail.com  Wed Sep 17 12:25:00 2008
From: emlists at gmail.com (Adam D)
Date: Wed, 17 Sep 2008 09:25:00 -0700
Subject: Issues with user.sub files - subscription files hangs system.
In-Reply-To: <48D0C133.9070808@bkr-ac.de>
References: <48CB26A3.6090603@gmail.com> <48D0B228.3090404@gmail.com>
	<48D0C133.9070808@bkr-ac.de>
Message-ID: <48D12F5C.8040006@gmail.com>

Jens wrote:
> Adam D schrieb:
>   
>> Adam D wrote:
>>     
>>> I have noticed this error in the log:
>>> Sep 12 18:57:44 vts-post cyrus/imap[19629]: IOERROR: locking
>>> /var/lib/cyrus/domain/W/domain1/user/A/userbox.sub: Interrupted system call
>>>
>>> Soon afterwards I notice imapd runs at 99.8 % and I can not kill the
>>> process.  It looks like the file is locked and can't be written to?  I
>>> saw another file called userbox.sub.NEW but even that files can't be
>>> read.  When I attempt the terminal freezes.  I also noticed the system
>>> can't be rebooted as well.  I don't know what could be causing this. 
>>> Does anyone have any incite? 
>>>       
> [...]
>   
>> We are using Ubuntu 8.04 on this particular amd 64 box running virtually
>> within xen.
>>     
>
> I had the same problem with Ubuntu 7.10 running in VMWare. I was not
> able to fix it. My solution was a system-upgrade to 8.04. The problem
> disappeared. I just hope it does not appear again. Some other users
> discovered the same problem and were able to solve it with an upgrade, too.
>
> Sorry not to help you,
> Jens
>
>   
I thought about that last night as well and we are having the same issue
with a system using Ubuntu 7.10.  I did noticed though 7.04, 7.10, 8.04
are all using 2.2.13 but different patches. 7.10 uses the 2.2.13-11
while 8.10 uses the 2.2.13-13.  I am thinking of trying 8.10 to see if
it works.. if not.. sadly I am wondering if we will have to move the
system over to a full Debian stable/testing?  I would not be happy to
build a Debian testing system to find out we have the same issue.  Would
this be a Ubuntu related issue with their patches?  Has anyone else have
had the same issue without using Ubuntu?

-Adam

From wes at umich.edu  Wed Sep 17 21:13:51 2008
From: wes at umich.edu (Wesley Craig)
Date: Wed, 17 Sep 2008 21:13:51 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
Message-ID: <619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>

On 17 Sep 2008, at 11:40, Jens Hoffrichter wrote:
> Why does cyrus need it's own
> structure for the mailboxes, which is similar, but not wholly
> compatible, to maildir. Maildir and cyrus both suffer from the same
> disadvantages (huge needs in terms of inodes etc.), yet I see no
> distinctive advantage for the cyrus mailbox format to maildir.

Performance.  I could go on & on, but that's the answer, basically.

:wes

From vbfox at ucdavis.edu  Wed Sep 17 23:50:01 2008
From: vbfox at ucdavis.edu (Vincent Fox)
Date: Wed, 17 Sep 2008 20:50:01 -0700
Subject: suggestion need to design an email system.
In-Reply-To: <619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>	<1221662967.5313.28.camel@linux-nnci.site>	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
Message-ID: <48D1CFE9.1000500@ucdavis.edu>

Wesley Craig wrote:
>>  Maildir and cyrus both suffer from the same
>> disadvantages (huge needs in terms of inodes etc.), 
With ZFS, inodes are among the many stone-age worries you leave behind.

;-)


From david.lang at digitalinsight.com  Thu Sep 18 00:12:04 2008
From: david.lang at digitalinsight.com (David Lang)
Date: Wed, 17 Sep 2008 21:12:04 -0700 (PDT)
Subject: suggestion need to design an email system.
In-Reply-To: <619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
References: <48CF8394.9050207@infoservices.in><1221562667.7022.5.camel@linux-nnci.site><9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com><1221662967.5313.28.camel@linux-nnci.site><9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
Message-ID: <alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>

On Wed, 17 Sep 2008, Wesley Craig wrote:

> On 17 Sep 2008, at 11:40, Jens Hoffrichter wrote:
>> Why does cyrus need it's own
>> structure for the mailboxes, which is similar, but not wholly
>> compatible, to maildir. Maildir and cyrus both suffer from the same
>> disadvantages (huge needs in terms of inodes etc.), yet I see no
>> distinctive advantage for the cyrus mailbox format to maildir.
>
> Performance.  I could go on & on, but that's the answer, basically.

actually, I suspect that Cyrus existed before Maildir and since Cyrus is a 
'black box' server there's no advantage to moving to maildir.

Also Cyrus has cache, index, and flags stored seperatly from the message itself, 
which means that when these things are changed the message file itself doesn't 
need to change.

doign a quick google check on maildir it also appears that maildir is not as 
standard as people think it is, it's defined almost entirely by the 
implementation (DJB started it, but never worked to turn it into a standard for 
others to use)

David Lang

From joydeep at infoservices.in  Thu Sep 18 00:54:10 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Thu, 18 Sep 2008 10:24:10 +0530
Subject: suggestion need to design an  email system.
In-Reply-To: <C5ED5D487FE4448E83B939E041F442AB@tththuydd>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<1221563745.3692.39.camel@sumatra.ccuse.com>	<48CF9B25.60108@infoservices.in><1221566164.3692.44.camel@sumatra.ccuse.com>
	<48D0A0E0.1000204@infoservices.in>
	<C5ED5D487FE4448E83B939E041F442AB@tththuydd>
Message-ID: <48D1DEF2.2030804@infoservices.in>

Do Duc Huy wrote:
> Hi,
> I am in a same situation with you about system components. I have used
> postfix+cyrus+ldap for email system since 2001 and system performance is
> still good now. But I have to face with two problems with this system. The
> first one is GUI for user and administrator. 
The GUI to administrate the cyrus+ldap is really a wanted since long.
Presently I am using egroupware groupware and it provides emailadmin
interface to put the cyrus  admin user and password. When I create a new
user, it also creates a mailbox for that user in the cyrus. But running
a groupware just to administrate the cyrus is more than enough. That's
why I am looking an interface to do the same. There is web-cyradm but I
have not found any doc which shows how to configure it to work with
Ldap. If you find any success with gosa or something else , please let
us know. we can't overlook the postfix+cyrus+ldap combination because of
its performance. ldap is first but difficult to design tool for ldap

> Squirrelmail was helpful enough
> for user but I have to develop my own administration page for admin
> purposes. Thanks for the link about Gosa you have sent, I will check it
> later.
> My question is about my second problem. It 's about antispam and antivirus.
> I have used amavis for spam and virus filter. This can block virus very well
> but it have no effect in blocking spam mail, I think.
> So is there any one know about other opensource spam filter products which
> work fine with postfix+cyrus+openldap and helpful in antispam
>   

Amavisd-new and spamassasin  are your friend.


> Thanks in advance
>
> ----
> Do Duc Huy
> Centre for Development of Information Technology - CDiT
> Viet Nam Posts & Telecommunications Group
> Address: 2nd Floor, VCCI Building, 9 Dao Duy Anh str,Dongda dist,Hanoi 
> Tel: (+84) 04 5 742 879
> Fax: (+84) 04 5 742 857
> Mobi: (+84) 0904 34 38 38 
>
> -----Original Message-----
> From: info-cyrus-bounces at lists.andrew.cmu.edu
> [mailto:info-cyrus-bounces at lists.andrew.cmu.edu] On Behalf Of J. Bakshi
> Sent: Wednesday, September 17, 2008 1:17 PM
> To: lartc
> Cc: Cyrus Mailing List
> Subject: Re: suggestion need to design an email system.
>
> lartc wrote:
>   
>> hi,
>>
>> well, you can edit the gosa config file to only show you the users and
>> their e-mail, etc. you're not obligated to use the entire system ... 
>>
>> when install it for clients, i only leave a few pieces of functionality
>> (so they don't blow their foot off).
>>
>> cheers
>>
>> charles
>>   
>>     
>
> Thanks, I'll definitely try it.
>
>
>   
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>>   
>>     
>
>
>   


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From damm at yazzy.org  Thu Sep 18 01:24:38 2008
From: damm at yazzy.org (Scott M. Likens)
Date: Wed, 17 Sep 2008 22:24:38 -0700
Subject: suggestion need to design an email system.
In-Reply-To: <48D1CFE9.1000500@ucdavis.edu>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>	<1221662967.5313.28.camel@linux-nnci.site>	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
	<48D1CFE9.1000500@ucdavis.edu>
Message-ID: <48D1E616.7080807@yazzy.org>

With ZFS your leaving a "ton" of stone-age worries behind.  You can go 
much beyond inodes in the perks of ZFS.

Vincent Fox wrote:
> Wesley Craig wrote:
>   
>>>  Maildir and cyrus both suffer from the same
>>> disadvantages (huge needs in terms of inodes etc.), 
>>>       
> With ZFS, inodes are among the many stone-age worries you leave behind.
>
> ;-)
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
>
> !DSPAM:48d1d451236501804284693!
>
>
>   


From damm at yazzy.org  Thu Sep 18 01:28:58 2008
From: damm at yazzy.org (Scott M. Likens)
Date: Wed, 17 Sep 2008 22:28:58 -0700
Subject: suggestion need to design an  email system.
In-Reply-To: <48D1DEF2.2030804@infoservices.in>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<1221563745.3692.39.camel@sumatra.ccuse.com>	<48CF9B25.60108@infoservices.in><1221566164.3692.44.camel@sumatra.ccuse.com>	<48D0A0E0.1000204@infoservices.in>	<C5ED5D487FE4448E83B939E041F442AB@tththuydd>
	<48D1DEF2.2030804@infoservices.in>
Message-ID: <48D1E71A.3020300@yazzy.org>

...

I debated writing a gui for Cyrus for administration, but I realized 
that people implement Cyrus in so many different ways.  Kerberos, LDAP, 
*SQL, various forms of PAM.  Then you add in virtual domains, and how 
you might want alias's and might not, and different MTA support... and I 
just caved.

Creating a basic way to support Cyrus is extremely easy in ruby, has the 
ability to create mailboxes easily, delete them, set permissions and set 
quotas.

That would be the basics, but once you create a web-ui to support the 
basics.  You could write it up in Ruby on Rails in a couple hours to 
cover the basics and get the job done.  But it's tying the 
authentication system and MTA into the app that would be the hassle.  :(

(now I write this i don't know why I did... but I did)


J. Bakshi wrote:
> Do Duc Huy wrote:
>   
>> Hi,
>> I am in a same situation with you about system components. I have used
>> postfix+cyrus+ldap for email system since 2001 and system performance is
>> still good now. But I have to face with two problems with this system. The
>> first one is GUI for user and administrator. 
>>     
> The GUI to administrate the cyrus+ldap is really a wanted since long.
> Presently I am using egroupware groupware and it provides emailadmin
> interface to put the cyrus  admin user and password. When I create a new
> user, it also creates a mailbox for that user in the cyrus. But running
> a groupware just to administrate the cyrus is more than enough. That's
> why I am looking an interface to do the same. There is web-cyradm but I
> have not found any doc which shows how to configure it to work with
> Ldap. If you find any success with gosa or something else , please let
> us know. we can't overlook the postfix+cyrus+ldap combination because of
> its performance. ldap is first but difficult to design tool for ldap
>
>   
>> Squirrelmail was helpful enough
>> for user but I have to develop my own administration page for admin
>> purposes. Thanks for the link about Gosa you have sent, I will check it
>> later.
>> My question is about my second problem. It 's about antispam and antivirus.
>> I have used amavis for spam and virus filter. This can block virus very well
>> but it have no effect in blocking spam mail, I think.
>> So is there any one know about other opensource spam filter products which
>> work fine with postfix+cyrus+openldap and helpful in antispam
>>   
>>     
>
> Amavisd-new and spamassasin  are your friend.
>
>
>   
>> Thanks in advance
>>
>> ----
>> Do Duc Huy
>> Centre for Development of Information Technology - CDiT
>> Viet Nam Posts & Telecommunications Group
>> Address: 2nd Floor, VCCI Building, 9 Dao Duy Anh str,Dongda dist,Hanoi 
>> Tel: (+84) 04 5 742 879
>> Fax: (+84) 04 5 742 857
>> Mobi: (+84) 0904 34 38 38 
>>
>> -----Original Message-----
>> From: info-cyrus-bounces at lists.andrew.cmu.edu
>> [mailto:info-cyrus-bounces at lists.andrew.cmu.edu] On Behalf Of J. Bakshi
>> Sent: Wednesday, September 17, 2008 1:17 PM
>> To: lartc
>> Cc: Cyrus Mailing List
>> Subject: Re: suggestion need to design an email system.
>>
>> lartc wrote:
>>   
>>     
>>> hi,
>>>
>>> well, you can edit the gosa config file to only show you the users and
>>> their e-mail, etc. you're not obligated to use the entire system ... 
>>>
>>> when install it for clients, i only leave a few pieces of functionality
>>> (so they don't blow their foot off).
>>>
>>> cheers
>>>
>>> charles
>>>   
>>>     
>>>       
>> Thanks, I'll definitely try it.
>>
>>
>>   
>>     
>>> ----
>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>>
>>>   
>>>     
>>>       
>>   
>>     
>
>
>   


From david.lang at digitalinsight.com  Thu Sep 18 02:00:07 2008
From: david.lang at digitalinsight.com (David Lang)
Date: Wed, 17 Sep 2008 23:00:07 -0700 (PDT)
Subject: suggestion need to design an email system.
In-Reply-To: <48D1E616.7080807@yazzy.org>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu>
	<48D1E616.7080807@yazzy.org>
Message-ID: <alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>

On Wed, 17 Sep 2008, Scott M. Likens wrote:

> With ZFS your leaving a "ton" of stone-age worries behind.  You can go
> much beyond inodes in the perks of ZFS.

and gaining some new worries along the way. while some are convinced that ZFS is 
the best thing ever others see it as trading a set of known problems for a set 
of unknown problems (plus it severly limits what OS you can run, which can bring 
it's own set of problems along)

David Lang

> Vincent Fox wrote:
>> Wesley Craig wrote:
>>
>>>>  Maildir and cyrus both suffer from the same
>>>> disadvantages (huge needs in terms of inodes etc.),
>>>>
>> With ZFS, inodes are among the many stone-age worries you leave behind.
>>
>> ;-)
>>
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>
>>
>> !DSPAM:48d1d451236501804284693!
>>
>>
>>
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>

From damm at yazzy.org  Thu Sep 18 02:33:48 2008
From: damm at yazzy.org (Scott M. Likens)
Date: Wed, 17 Sep 2008 23:33:48 -0700
Subject: suggestion need to design an email system.
In-Reply-To: <alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu>
	<48D1E616.7080807@yazzy.org>
	<alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
Message-ID: <48D1F64C.7060006@yazzy.org>

Hi David,

If you want ZFS you have several choices, OS X (Leopard), as there is a 
development version that supports RAID-Z and works quite well.  You 
can't boot off of it, but that will change in Snow Leopard.

Additionally you can use Opensolaris such as Nexenta, or you can use 
fuse to get ZFS into Linux. 

Truthfully I would rather use Nexenta to get ZFS which at least gives 
you a decent working system... Unlike a standard Solaris where you are 
forced to get either Sun One (Forte?) or an ancient version of gcc off 
of sunfreeware and start building.   :(

However I do look forward to the day when Sun dual licenses ZFS as GPL 
and sticks it in the Linux kernel and throws us all a wrench, for good 
or bad ZFS introduces some excellent overlooked ideas that it's about 
damned time someone introduced.

Scott

David Lang wrote:
> On Wed, 17 Sep 2008, Scott M. Likens wrote:
>
>> With ZFS your leaving a "ton" of stone-age worries behind.  You can go
>> much beyond inodes in the perks of ZFS.
>
> and gaining some new worries along the way. while some are convinced 
> that ZFS is the best thing ever others see it as trading a set of 
> known problems for a set of unknown problems (plus it severly limits 
> what OS you can run, which can bring it's own set of problems along)
>
> David Lang
>
>> Vincent Fox wrote:
>>> Wesley Craig wrote:
>>>
>>>>>  Maildir and cyrus both suffer from the same
>>>>> disadvantages (huge needs in terms of inodes etc.),
>>>>>
>>> With ZFS, inodes are among the many stone-age worries you leave behind.
>>>
>>> ;-)
>>>
>>> ----
>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>>
>>>
>>>
>>>
>>>
>>>
>>
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>


From david.lang at digitalinsight.com  Thu Sep 18 02:40:40 2008
From: david.lang at digitalinsight.com (David Lang)
Date: Wed, 17 Sep 2008 23:40:40 -0700 (PDT)
Subject: suggestion need to design an email system.
In-Reply-To: <48D1F64C.7060006@yazzy.org>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu>
	<48D1E616.7080807@yazzy.org>
	<alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
	<48D1F64C.7060006@yazzy.org>
Message-ID: <alpine.LNX.1.10.0809172336470.22787@qynat.qvtvafvgr.pbz>

On Wed, 17 Sep 2008, Scott M. Likens wrote:

> Hi David,
>
> If you want ZFS you have several choices, OS X (Leopard), as there is a
> development version that supports RAID-Z and works quite well.  You
> can't boot off of it, but that will change in Snow Leopard.
>
> Additionally you can use Opensolaris such as Nexenta, or you can use
> fuse to get ZFS into Linux.

fuse on linux is not a real option for most uses due to the performance hit.

so you have OS X and Solaris (with opensolaris varients), that's not a very wide 
supproted base for running servers.

> Truthfully I would rather use Nexenta to get ZFS which at least gives
> you a decent working system... Unlike a standard Solaris where you are
> forced to get either Sun One (Forte?) or an ancient version of gcc off
> of sunfreeware and start building.   :(

no comment

> However I do look forward to the day when Sun dual licenses ZFS as GPL
> and sticks it in the Linux kernel and throws us all a wrench, for good
> or bad ZFS introduces some excellent overlooked ideas that it's about
> damned time someone introduced.

I don't disagree that ZFS is a prod to get development on filesystems moving 
again or to say that they didn't introduce any good ideas, but I do disagree 
with people who seem to think that ZFS is perfect, and is so much better then 
any other filesystem that the availablity of ZFS should be the only 
consideration on what OS to run.

David Lang

> Scott
>
> David Lang wrote:
>> On Wed, 17 Sep 2008, Scott M. Likens wrote:
>>
>>> With ZFS your leaving a "ton" of stone-age worries behind.  You can go
>>> much beyond inodes in the perks of ZFS.
>>
>> and gaining some new worries along the way. while some are convinced
>> that ZFS is the best thing ever others see it as trading a set of
>> known problems for a set of unknown problems (plus it severly limits
>> what OS you can run, which can bring it's own set of problems along)
>>
>> David Lang
>>
>>> Vincent Fox wrote:
>>>> Wesley Craig wrote:
>>>>
>>>>>>  Maildir and cyrus both suffer from the same
>>>>>> disadvantages (huge needs in terms of inodes etc.),
>>>>>>
>>>> With ZFS, inodes are among the many stone-age worries you leave behind.
>>>>
>>>> ;-)
>>>>
>>>> ----
>>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>> ----
>>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>>
>
>

From reko.turja at liukuma.net  Thu Sep 18 05:03:27 2008
From: reko.turja at liukuma.net (Reko Turja)
Date: Thu, 18 Sep 2008 12:03:27 +0300
Subject: suggestion need to design an email system.
References: <48CF8394.9050207@infoservices.in><1221562667.7022.5.camel@linux-nnci.site><9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com><1221662967.5313.28.camel@linux-nnci.site><9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com><619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu><48D1E616.7080807@yazzy.org><alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz><48D1F64C.7060006@yazzy.org>
	<alpine.LNX.1.10.0809172336470.22787@qynat.qvtvafvgr.pbz>
Message-ID: <7002E1FF2F5B4A88B9A630B476977DBF@rivendell>

> so you have OS X and Solaris (with opensolaris varients), that's not 
> a very wide
> supproted base for running servers.

FreeBSD 7.x onwards has ZFS available natively. ZFS support in CURRENT 
seems to have most of the latest stuff from OpenSolaris incorporated 
and the FS seems to be pretty stable on 64 bit x86 (amd64) platform at 
least. So make that at least three known implementations. Linux/FSF 
isn't the whole opensource world ;)

-Reko 


From lartc at manchotnetworks.net  Thu Sep 18 05:14:23 2008
From: lartc at manchotnetworks.net (lartc)
Date: Thu, 18 Sep 2008 11:14:23 +0200
Subject: querying message flags -- finding list of unread message
Message-ID: <1221729263.3802.19.camel@sumatra.ccuse.com>

hi all,

is there a way to query a message store to find what message are unread
in a user's inbox?

many thanks 

charles


From list at joreybump.com  Thu Sep 18 06:05:49 2008
From: list at joreybump.com (Jorey Bump)
Date: Thu, 18 Sep 2008 06:05:49 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
References: <48CF8394.9050207@infoservices.in><1221562667.7022.5.camel@linux-nnci.site><9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com><1221662967.5313.28.camel@linux-nnci.site><9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
	<alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
Message-ID: <48D227FD.9080704@joreybump.com>

David Lang wrote, at 09/18/2008 12:12 AM:
> doign a quick google check on maildir it also appears that maildir is not as 
> standard as people think it is, it's defined almost entirely by the 
> implementation (DJB started it, but never worked to turn it into a standard for 
> others to use)

This was definitely a strike against the Maildir-based systems I
evaluated along with Cyrus a few years ago. None of them appeared to be
true drop-in replacements for each other, and the subtle differences
weren't transparent to the end user. In the end, performance and ease of
configuration for the end user are what tipped the scales in favor of
Cyrus (Dovecot was in beta at the time and still had some serious bugs).



From awilliam at whitemice.org  Thu Sep 18 06:20:12 2008
From: awilliam at whitemice.org (Adam Tauno Williams)
Date: Thu, 18 Sep 2008 06:20:12 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
	<alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
Message-ID: <1221733212.4274.5.camel@linux-nnci.site>

On Wed, 2008-09-17 at 21:12 -0700, David Lang wrote:
> On Wed, 17 Sep 2008, Wesley Craig wrote:
> > On 17 Sep 2008, at 11:40, Jens Hoffrichter wrote:
> >> Why does cyrus need it's own
> >> structure for the mailboxes, which is similar, but not wholly
> >> compatible, to maildir. Maildir and cyrus both suffer from the same
> >> disadvantages (huge needs in terms of inodes etc.), yet I see no
> >> distinctive advantage for the cyrus mailbox format to maildir.
> > Performance.  I could go on & on, but that's the answer, basically.
> actually, I suspect that Cyrus existed before Maildir and since Cyrus is a 
> 'black box' server there's no advantage to moving to maildir.
> Also Cyrus has cache, index, and flags stored seperatly from the message itself, 
> which means that when these things are changed the message file itself doesn't 
> need to change.

Yep,  which is why the sealed mailstore is a good idea: meta-data.  You
can keep reliable meta-data if third parties can go in and muck about.

> doign a quick google check on maildir it also appears that maildir is not as 
> standard as people think it is, it's defined almost entirely by the 
> implementation (DJB started it, but never worked to turn it into a standard for 
> others to use)



From david.lang at digitalinsight.com  Thu Sep 18 06:28:51 2008
From: david.lang at digitalinsight.com (David Lang)
Date: Thu, 18 Sep 2008 03:28:51 -0700 (PDT)
Subject: suggestion need to design an email system.
In-Reply-To: <1221733212.4274.5.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in><1221562667.7022.5.camel@linux-nnci.site><9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com><1221662967.5313.28.camel@linux-nnci.site><9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com><619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
	<1221733212.4274.5.camel@linux-nnci.site>
Message-ID: <alpine.LNX.1.10.0809180328140.22787@qynat.qvtvafvgr.pbz>

On Thu, 18 Sep 2008, Adam Tauno Williams wrote:

> On Wed, 2008-09-17 at 21:12 -0700, David Lang wrote:
>> On Wed, 17 Sep 2008, Wesley Craig wrote:
>>> On 17 Sep 2008, at 11:40, Jens Hoffrichter wrote:
>>>> Why does cyrus need it's own
>>>> structure for the mailboxes, which is similar, but not wholly
>>>> compatible, to maildir. Maildir and cyrus both suffer from the same
>>>> disadvantages (huge needs in terms of inodes etc.), yet I see no
>>>> distinctive advantage for the cyrus mailbox format to maildir.
>>> Performance.  I could go on & on, but that's the answer, basically.
>> actually, I suspect that Cyrus existed before Maildir and since Cyrus is a
>> 'black box' server there's no advantage to moving to maildir.
>> Also Cyrus has cache, index, and flags stored seperatly from the message itself,
>> which means that when these things are changed the message file itself doesn't
>> need to change.
>
> Yep,  which is why the sealed mailstore is a good idea: meta-data.  You
> can keep reliable meta-data if third parties can go in and muck about.

one of those "can" should be "can't" :-)

David Lang

>> doign a quick google check on maildir it also appears that maildir is not as
>> standard as people think it is, it's defined almost entirely by the
>> implementation (DJB started it, but never worked to turn it into a standard for
>> others to use)
>
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>

From adam at morrison-ind.com  Thu Sep 18 08:47:41 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Thu, 18 Sep 2008 08:47:41 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <alpine.LNX.1.10.0809180328140.22787@qynat.qvtvafvgr.pbz>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>
	<1221662967.5313.28.camel@linux-nnci.site>
	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>
	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu>
	<alpine.LNX.1.10.0809172104300.22787@qynat.qvtvafvgr.pbz>
	<1221733212.4274.5.camel@linux-nnci.site>
	<alpine.LNX.1.10.0809180328140.22787@qynat.qvtvafvgr.pbz>
Message-ID: <1221742062.4979.7.camel@linux-nnci.site>

On Thu, 2008-09-18 at 03:28 -0700, David Lang wrote:
> On Thu, 18 Sep 2008, Adam Tauno Williams wrote:
> > On Wed, 2008-09-17 at 21:12 -0700, David Lang wrote:
> >> On Wed, 17 Sep 2008, Wesley Craig wrote:
> >>> On 17 Sep 2008, at 11:40, Jens Hoffrichter wrote:
> >>>> Why does cyrus need it's own
> >>>> structure for the mailboxes, which is similar, but not wholly
> >>>> compatible, to maildir. Maildir and cyrus both suffer from the same
> >>>> disadvantages (huge needs in terms of inodes etc.), yet I see no
> >>>> distinctive advantage for the cyrus mailbox format to maildir.
> >>> Performance.  I could go on & on, but that's the answer, basically.
> >> actually, I suspect that Cyrus existed before Maildir and since Cyrus is a
> >> 'black box' server there's no advantage to moving to maildir.
> >> Also Cyrus has cache, index, and flags stored seperatly from the message itself,
> >> which means that when these things are changed the message file itself doesn't
> >> need to change.
> > Yep,  which is why the sealed mailstore is a good idea: meta-data.  You
> > can keep reliable meta-data if third parties can go in and muck about.
> one of those "can" should be "can't" :-)

Yep, I mean nope, I mean... :)

Should have been:
<quote>
?Yep,  which is why the sealed mailstore is a good idea: meta-data.  You
can't keep reliable meta-data if third parties can go in and muck about
</quote>

Anyway, this is the same reason one puts a web service in front of an
RDBMS (rather than clients connecting directly to the DB).  Three-tier
architectures just facilitate greater consistency and security than
two-tier systems [witness the constant security breaches in many LAMP
applications, not for the same technical reasons maybe, but at least on
one level it is conceptually the same kind of problem].  After a decade
of sys-admin work I've become rather a bigot about this kind of thing.

> >> doign a quick google check on maildir it also appears that maildir is not as
> >> standard as people think it is, it's defined almost entirely by the
> >> implementation (DJB started it, but never worked to turn it into a standard for
> >> others to use)


From adam at morrison-ind.com  Thu Sep 18 08:56:35 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Thu, 18 Sep 2008 08:56:35 -0400
Subject: suggestion need to design an  email system.
In-Reply-To: <48D1E71A.3020300@yazzy.org>
References: <48CF8394.9050207@infoservices.in>
	<1221562667.7022.5.camel@linux-nnci.site>
	<1221563745.3692.39.camel@sumatra.ccuse.com>
	<48CF9B25.60108@infoservices.in>
	<1221566164.3692.44.camel@sumatra.ccuse.com>
	<48D0A0E0.1000204@infoservices.in>
	<C5ED5D487FE4448E83B939E041F442AB@tththuydd>
	<48D1DEF2.2030804@infoservices.in>  <48D1E71A.3020300@yazzy.org>
Message-ID: <1221742595.4979.16.camel@linux-nnci.site>

On Wed, 2008-09-17 at 22:28 -0700, Scott M. Likens wrote:
> ...
> I debated writing a gui for Cyrus for administration, but I realized 
> that people implement Cyrus in so many different ways.  Kerberos, LDAP, 
> *SQL, various forms of PAM.  Then you add in virtual domains, and how 
> you might want alias's and might not, and different MTA support... and I 
> just caved.

Right, I've gone through the same thought process.  The only way to make
a *good* admin tool [IMHO] is to, to some extent, dictate how the system
is architected.  Since Open Source would generally reject that... no
good admin tools. :(   This is the primary advantage of M$ solutions:
they dictate generally how it will work, what components will be used,
and thus can provide [I must admit] rather beautiful admin interfaces
and capacity planning tools. 

> Creating a basic way to support Cyrus is extremely easy in ruby, has the 
> ability to create mailboxes easily, delete them, set permissions and set 
> quotas.

We've created one in PHP, and I've worked on one in .NET,  so I don't
think the platform really matters.  But each ends up welded to its
site's policies and configuration in a myriad of little ways.

> That would be the basics, but once you create a web-ui to support the 
> basics.  You could write it up in Ruby on Rails in a couple hours to 
> cover the basics and get the job done.  But it's tying the 
> authentication system and MTA into the app that would be the hassle.  :(
> (now I write this i don't know why I did... but I did)

Maybe it has improved but when I surveyed the available management
interfaces [years ago now] most of them were pretty scary in terms of
security [apache/wwwrun needed to be able to execute commands, no
support for "real" authorization (like Kerberos), etc...].  This stems I
think from the fact that configuration of most services can't be done
via an API but only by mucking about in files and restarting or at least
HUP'ing important processes.  It just doesn't lend itself to good
manageability.
-- 
          Consonance: an Open Source .NET OpenGroupware client.
 Contact:awilliam at whitemiceconsulting.com   http://freshmeat.net/projects/consonance/


From Hagedorn at uni-koeln.de  Thu Sep 18 10:00:04 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Thu, 18 Sep 2008 16:00:04 +0200
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
	<alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>
Message-ID: <1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>

--On 16. September 2008 18:31:31 +0000 Andy Fiddaman <cyrus at fiddaman.net> 
wrote:

> ; is there a way to mimic exchange server in the linux environment where i
> ; can keep my cyrus/postfix/amavis install -- is there a linux app that
> ; speaks "exchange"?
>
> Z-Push (http://z-push.sourceforge.net/) does the job nicely. I use that
> for my iPhone with Cyrus as the backend.

After I read that, I am now trying to get that to work. I don't have any 
ActiveSync-capable clients myself, but a colleague of mine has a Windows 
Mobile cell phone. He managed to configure the account, the login to our 
Cyrus server is successful, but nothing is synchronized. I've enabled 
debug.txt, but there's nothing enlightening to be found there.

What's more, without having gotten it to work, I fail to see what the 
advantage over a proper IMAP account is. I don't see how there could be an 
actual push component with such a setup. Maybe I'm missing something?
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080918/1ab0596f/attachment.bin 

From vbfox at ucdavis.edu  Thu Sep 18 10:11:02 2008
From: vbfox at ucdavis.edu (Vincent Fox)
Date: Thu, 18 Sep 2008 07:11:02 -0700
Subject: suggestion need to design an email system.
In-Reply-To: <alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>	<1221662967.5313.28.camel@linux-nnci.site>	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu>	<48D1E616.7080807@yazzy.org>
	<alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
Message-ID: <48D26176.3090708@ucdavis.edu>

David Lang wrote:
> and gaining some new worries along the way. while some are convinced that ZFS is 
> the best thing ever others see it as trading a set of known problems for a set 
> of unknown problems (plus it severly limits what OS you can run, which can bring 
> it's own set of problems along)
>
>   

All I know is this:

After running ZFS for the Cyrus mailstores for a year now I'd never go back.
If someone told me here's a bunch of white-box PC hardware we want you to
run OS-Y and filesystem J I'd say find another boy to run it or double 
my paycheck.
For trustworthy mail-storage there isn't anything comparable and you 
know how
nervous people get about mail outages.  I haven't had to look at an fsck 
prompt
in over a year, and that is sufficient reason for me.  Being able to run 
a scrub while
the system is live after replacing a disk, with no impact, just to be 
sure it's clean
is way into bonus points.

But we already run both Solaris & Linux so it wasn't an "unknown" for us.

YMMV



From daleg at elemental.org  Thu Sep 18 10:29:02 2008
From: daleg at elemental.org (Dale Ghent)
Date: Thu, 18 Sep 2008 10:29:02 -0400
Subject: suggestion need to design an email system.
In-Reply-To: <48D26176.3090708@ucdavis.edu>
References: <48CF8394.9050207@infoservices.in>	<1221562667.7022.5.camel@linux-nnci.site>	<9b48a1210809170633h1ac29e14ub1a58ae7b9bcfd84@mail.gmail.com>	<1221662967.5313.28.camel@linux-nnci.site>	<9b48a1210809170840g1b8e9beeh568929c1243fb144@mail.gmail.com>	<619AB02B-18FE-4519-9E0E-BD1EE89D0720@umich.edu><48D1CFE9.1000500@ucdavis.edu>	<48D1E616.7080807@yazzy.org>
	<alpine.LNX.1.10.0809172258380.22787@qynat.qvtvafvgr.pbz>
	<48D26176.3090708@ucdavis.edu>
Message-ID: <60DB412D-1014-45C3-9836-67F93E500A53@elemental.org>

On Sep 18, 2008, at 10:11 AM, Vincent Fox wrote:

> All I know is this:
>
> After running ZFS for the Cyrus mailstores for a year now I'd never  
> go back.

Same here, for over year now... four opteron servers to handle 25,000  
accounts. All of those servers are Solaris 10 and cyrus lives and  
works on ZFS.

/dale

From lartc at manchotnetworks.net  Thu Sep 18 10:35:03 2008
From: lartc at manchotnetworks.net (lartc)
Date: Thu, 18 Sep 2008 16:35:03 +0200
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
	<alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>
	<1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
Message-ID: <1221748503.3802.42.camel@sumatra.ccuse.com>

On Thu, 2008-09-18 at 16:00 +0200, Sebastian Hagedorn wrote:
> --On 16. September 2008 18:31:31 +0000 Andy Fiddaman <cyrus at fiddaman.net> 
> wrote:
> 
> > ; is there a way to mimic exchange server in the linux environment where i
> > ; can keep my cyrus/postfix/amavis install -- is there a linux app that
> > ; speaks "exchange"?
> >
> > Z-Push (http://z-push.sourceforge.net/) does the job nicely. I use that
> > for my iPhone with Cyrus as the backend.
> 
> After I read that, I am now trying to get that to work. I don't have any 
> ActiveSync-capable clients myself, but a colleague of mine has a Windows 
> Mobile cell phone. He managed to configure the account, the login to our 
> Cyrus server is successful, but nothing is synchronized. I've enabled 
> debug.txt, but there's nothing enlightening to be found there.
> 
> What's more, without having gotten it to work, I fail to see what the 
> advantage over a proper IMAP account is. I don't see how there could be an 
> actual push component with such a setup. Maybe I'm missing something?
> -- 
>      .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
> Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
> .:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
>                    .:.:.:.Skype: shagedorn.:.:.:.

hi sebastian,

essentially what's happening here is that apple's sdk has no api
connections to calender/tasks/notes/etc -- only contacts. so without
jailbreaking the iphone, the only way to sync without wires is MobileME
or exchange. my users a hyper paranoid, so MobileME isn't possible, and
installing m$ exchange is also not a solution. only other way is to
jailbreak the iphone and install the latest/uncertified funambol
connector and then you can sync wirelessly.

i was wondering if anyone had come up with an exchange proxy of sorts,
allowing us to specify cyrus for mail, funambol or ldap for
contacts/calenders/etc. this way we could use the native certified
exchange connector in the phone to sync.

cheers

charles
-- 
"simplified chinese" is not nearly as easy as they would
have you believe ... a superlative oxymoron --anonymous


From hdembkowski at alcatel-lucent.com  Thu Sep 18 11:00:39 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Thu, 18 Sep 2008 17:00:39 +0200
Subject: assert
Message-ID: <B576524D0905194499F90736CAA2758A01DD2DBE@DEEXC1U03.de.lucent.com>

Hi,

When I run tool hammer_skiplist to test new version of
cyrusdb_skiplist.c I got

root at ms02.borsuk# ./hammer_skiplist -C /etc/imapd_p.conf -n
/home/tsc/dhenryk/hammer.out
fatal error: Internal error: assertion failed: cyrusdb_skiplist.c: 739:
db->current_txn == NULL

In code I see

    724 static int lock_or_refresh(struct db *db, struct txn **tidptr)
    725 {
    726     int r;
    727
    728     assert(db != NULL && tidptr != NULL);
    729
    730     if (*tidptr) {
    731         /* check that the DB agrees that we're in this
transaction */
    732         assert(db->current_txn == *tidptr);
    733
    734         /* just update the active transaction */
    735         update_lock(db, *tidptr);
    736
    737     } else {
    738         /* check that the DB isn't in a transaction */
    739         assert(db->current_txn == NULL);
    740
    741         /* grab a r/w lock */
    742         if ((r = write_lock(db, NULL)) < 0) {
    743             return r;
    744         }
    745
    746         /* start the transaction */
    747         if (r = newtxn(db, tidptr)) {
    748             return r;
    749         }
    750     }
    751
    752     return 0;
    753 }



Is it OK. that I get such error?


Kind Regards,
Henryk

From lartc at manchotnetworks.net  Thu Sep 18 11:04:19 2008
From: lartc at manchotnetworks.net (lartc)
Date: Thu, 18 Sep 2008 17:04:19 +0200
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
	<alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>
	<1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
Message-ID: <1221750259.3802.47.camel@sumatra.ccuse.com>

On Thu, 2008-09-18 at 16:00 +0200, Sebastian Hagedorn wrote:
> --On 16. September 2008 18:31:31 +0000 Andy Fiddaman <cyrus at fiddaman.net> 
> wrote:
> 
> > ; is there a way to mimic exchange server in the linux environment where i
> > ; can keep my cyrus/postfix/amavis install -- is there a linux app that
> > ; speaks "exchange"?
> >
> > Z-Push (http://z-push.sourceforge.net/) does the job nicely. I use that
> > for my iPhone with Cyrus as the backend.
> 
> After I read that, I am now trying to get that to work. I don't have any 
> ActiveSync-capable clients myself, but a colleague of mine has a Windows 
> Mobile cell phone. He managed to configure the account, the login to our 
> Cyrus server is successful, but nothing is synchronized. I've enabled 
> debug.txt, but there's nothing enlightening to be found there.
> 
> What's more, without having gotten it to work, I fail to see what the 
> advantage over a proper IMAP account is. I don't see how there could be an 
> actual push component with such a setup. Maybe I'm missing something?
> -- 
>      .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
> Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
> .:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
>                    .:.:.:.Skype: shagedorn.:.:.:.

Hi Again,

I need more coffee and a bigger brain. This looks EXACTLY like what I
need -- downloading now ....

THANKS

Charles


From Hagedorn at uni-koeln.de  Thu Sep 18 11:18:58 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Thu, 18 Sep 2008 17:18:58 +0200
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <1221748503.3802.42.camel@sumatra.ccuse.com>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>	
	<alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>	
	<1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
	<1221748503.3802.42.camel@sumatra.ccuse.com>
Message-ID: <91CF3D28A9C652BA0290AC23@tyrion.rrz.uni-koeln.de>

--On 18. September 2008 16:35:03 +0200 lartc <lartc at manchotnetworks.net> 
wrote:

> essentially what's happening here is that apple's sdk has no api
> connections to calender/tasks/notes/etc -- only contacts.

I get that ...

> so without
> jailbreaking the iphone, the only way to sync without wires is MobileME
> or exchange.

Not quite, unless I'm mistaken. If all you're interested in is mail, you 
could just as well configure an IMAP account for your Cyrus server, 
couldn't you? I thought the only advantage to ActiveSync for mail was push. 
Am I wrong? Is there more to it?
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080918/c805cc5f/attachment-0001.bin 

From lartc at manchotnetworks.net  Thu Sep 18 12:21:35 2008
From: lartc at manchotnetworks.net (lartc)
Date: Thu, 18 Sep 2008 18:21:35 +0200
Subject: [OT] m$ activesync with cyrus backend
In-Reply-To: <91CF3D28A9C652BA0290AC23@tyrion.rrz.uni-koeln.de>
References: <1221562393.3692.31.camel@sumatra.ccuse.com>
	<alpine.GSO.2.00.0809161830170.26833@gbavp.pvgehf-vg.arg>
	<1B7A179FDEBC9A6335590C27@tyrion.rrz.uni-koeln.de>
	<1221748503.3802.42.camel@sumatra.ccuse.com>
	<91CF3D28A9C652BA0290AC23@tyrion.rrz.uni-koeln.de>
Message-ID: <1221754895.3802.58.camel@sumatra.ccuse.com>

On Thu, 2008-09-18 at 17:18 +0200, Sebastian Hagedorn wrote:
> --On 18. September 2008 16:35:03 +0200 lartc <lartc at manchotnetworks.net> 
> wrote:
> 
> > essentially what's happening here is that apple's sdk has no api
> > connections to calender/tasks/notes/etc -- only contacts.
> 
> I get that ...
> 
> > so without
> > jailbreaking the iphone, the only way to sync without wires is MobileME
> > or exchange.
> 
> Not quite, unless I'm mistaken. If all you're interested in is mail, you 
> could just as well configure an IMAP account for your Cyrus server, 
> couldn't you? I thought the only advantage to ActiveSync for mail was push. 
> Am I wrong? Is there more to it?
> -- 
>      .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
> Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
> .:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
>                    .:.:.:.Skype: shagedorn.:.:.:.

hi sebastien,

yes ... i am using imap on the iphone to cyrus without any issues --
it's syncing contacts/calender/tasks/etc where i'm stuck

i've downloaded and played with z-push -- the missing piece is to be
able to sync pc outlook data up to the z-push instance, and then sync a
mobile. looks like the only way to do that is to buy the zafara
product ... then your outlook syncs to zafara and iphone as well.

i'm trying to find a freeware solution to sync everything -- i've got
the funambol outlook plugin running on a PC, so the
contacts/calendars/etc all get syncd up perfectly. it's the iphone (with
the official funambol plugin) that only syncs contacts and not the rest.

looks like i'm going to have to break out of jail to get the full
funambol.app to work.

charles


From dwhite at olp.net  Thu Sep 18 15:30:27 2008
From: dwhite at olp.net (Dan White)
Date: Thu, 18 Sep 2008 14:30:27 -0500
Subject: querying message flags -- finding list of unread message
In-Reply-To: <1221729263.3802.19.camel@sumatra.ccuse.com>
References: <1221729263.3802.19.camel@sumatra.ccuse.com>
Message-ID: <48D2AC53.9040205@olp.net>

lartc wrote:
> hi all,
>
> is there a way to query a message store to find what message are unread
> in a user's inbox?
>
>   

You can use IMAP search to find that out (e.g. with imtest). Remember 
that by default, seen state is not shared between users, so you'll need 
to authorize as the owner of the mailbox to see their seen state. 
Assuming you want to view seen state for user abrown, you could do:

imtest -m GSSAPI imap.example.com -u abrown
...
Authenticated.
c select user/abrown
* FLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk)
* OK [PERMANENTFLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk 
\*)] 
* 6 EXISTS
* 0 RECENT
* OK [UNSEEN 1] 
* OK [UIDVALIDITY 1188505352] 
* OK [UIDNEXT 614] 
* OK [NOMODSEQ] Sorry, modsequences have not been enabled on this mailbox
* OK [URLMECH INTERNAL]
c OK [READ-WRITE] Completed
c search seen
* SEARCH 3 5
c OK Completed (2 msgs in 0.000 secs)
c search not seen
* SEARCH 1 2 4 6
c OK Completed (4 msgs in 0.000 secs)
c fetch 1,2,4,6 (FLAGS BODY[HEADER.FIELDS (DATE FROM)])
* 1 FETCH (FLAGS (\Seen NonJunk) BODY[HEADER.FIELDS (DATE FROM)] {116}
Date: Mon, 19 May 2008 05:01:08 -0400 (EDT)
From: <cut>

)
* 2 FETCH (FLAGS (\Seen) BODY[HEADER.FIELDS (DATE FROM)] {88}
From: <cut>
Date: Mon, 19 May 2008 03:15:16 -0700

)
* 4 FETCH (FLAGS (\Seen NonJunk) BODY[HEADER.FIELDS (DATE FROM)] {132}
Date: Mon, 19 May 2008 11:04:09 -0400 (EDT)
From: <cut>

)
* 6 FETCH (FLAGS (\Seen NonJunk) BODY[HEADER.FIELDS (DATE FROM)] {116}
From: <cut>
Date: Tue, 20 May 2008 11:30:40 -0500

)
c OK Completed (0.000 sec)

Or you could do the same with an IMAP client of course.

- Dan

From wes at umich.edu  Thu Sep 18 20:34:08 2008
From: wes at umich.edu (Wesley Craig)
Date: Thu, 18 Sep 2008 20:34:08 -0400
Subject: patch to force cyrus to reload its configuration in a more
	rigorous way
In-Reply-To: <71fe4e760804060828r6338b94ep79e3d4d66f5f38d5@mail.gmail.com>
References: <71fe4e760804011007l21c93cf6i92dd028606464d36@mail.gmail.com>
	<33418.192.168.10.25.1207125018.squirrel@webmail.bi.corp.invoca.ch>
	<71fe4e760804020557q3c70d620x12f43a3d0ab03274@mail.gmail.com>
	<71fe4e760804060828r6338b94ep79e3d4d66f5f38d5@mail.gmail.com>
Message-ID: <39D9BEFB-E53A-470E-9358-86A0ADF4E79C@umich.edu>

On 06 Apr 2008, at 11:28, Alain Spineux wrote:
> I opened a new bug on bugzilla.
>
> https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=2987

I think you mean:

	https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3053

I've reviewed the patch.  Please address my comments to get it  
committed.  Thanks for the contribution!

:wes

From wes at umich.edu  Thu Sep 18 21:13:19 2008
From: wes at umich.edu (Wesley Craig)
Date: Thu, 18 Sep 2008 21:13:19 -0400
Subject: Several problems with mupdate master.
In-Reply-To: <200808131222.49149.carles@unlimitedmail.org>
References: <200808131222.49149.carles@unlimitedmail.org>
Message-ID: <0971940F-3810-4976-B19B-ADBDCF03F3A6@umich.edu>

On 13 Aug 2008, at 06:22, UnlimitedMail.net - Carles Xavier Munyoz  
Bald? wrote:
> (1) One of the problems I have is that the mupdate master process  
> generates
> too many logs lines like these:
> [...]
> Worker thread finished, for a total of 5 (5 spare)
> New worker thread started, for a total of 6
> Worker thread finished, for a total of 5 (5 spare)
> New worker thread started, for a total of 6
> Worker thread finished, for a total of 5 (5 spare)
> New worker thread started, for a total of 6
> [...]

That's a bug in how new threads are created.  More or less, it always  
creates two.  I have a fix, but it's for 2.3.12, not 2.2.12.

> master[5709]: process 22275 exited, signaled to death by 6

signal 6 is SIGABRT, which is what happens when abort() is called,  
i.e., like an assert() failed.  Have you tried 2.2.13?  At least  
that's the latest in the 2.2.x line.

:wes

From wes at umich.edu  Thu Sep 18 21:17:26 2008
From: wes at umich.edu (Wesley Craig)
Date: Thu, 18 Sep 2008 21:17:26 -0400
Subject: upgraded to v2.3.12p2
In-Reply-To: <Pine.GSO.4.33.0808051359240.7672-100000@hatteras.acsu.buffalo.edu>
References: <Pine.GSO.4.33.0808051359240.7672-100000@hatteras.acsu.buffalo.edu>
Message-ID: <3D520435-E3CB-4E89-92DB-76712E5B3DA1@umich.edu>

On 05 Aug 2008, at 14:24, James M McNutt wrote:
> not sure why we get "Unknown code imap 54"

Your compile is referring to com_err from some other package, which  
is apparently not compatible with cyrus-imapd.  Probably better if  
you just used the one that comes with cyrus-imapd.

:wes

From lartc at manchotnetworks.net  Fri Sep 19 01:06:33 2008
From: lartc at manchotnetworks.net (lartc)
Date: Fri, 19 Sep 2008 07:06:33 +0200
Subject: Sorry, modsequences have not been enabled on this mailbox
Message-ID: <1221800793.24753.2.camel@sumatra.ccuse.com>

hi all,

i've groked around but cannot seem to find out what this means ...

how do i enable this -- cyradm has no option, and i didn't see anything
in imapd.conf or cyrus.conf ...

cheers

charles


From brong at fastmail.fm  Fri Sep 19 01:52:50 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Fri, 19 Sep 2008 15:52:50 +1000
Subject: assert
In-Reply-To: <B576524D0905194499F90736CAA2758A01DD2DBE@DEEXC1U03.de.lucent.com>
References: <B576524D0905194499F90736CAA2758A01DD2DBE@DEEXC1U03.de.lucent.com>
Message-ID: <20080919055250.GA27685@brong.net>

On Thu, Sep 18, 2008 at 05:00:39PM +0200, DEMBKOWSKI, Henryk (Henryk) wrote:
> Hi,
> 
> When I run tool hammer_skiplist to test new version of
> cyrusdb_skiplist.c I got
> 
> root at ms02.borsuk# ./hammer_skiplist -C /etc/imapd_p.conf -n
> /home/tsc/dhenryk/hammer.out
> fatal error: Internal error: assertion failed: cyrusdb_skiplist.c: 739:
> db->current_txn == NULL

        if (rop >= 999) {
          if (!r) r = DB_OLD->store(db, key, klen, value, vlen, tp);
          /* forget to commit */
        }

This would cause the bug you're seeing.  Basically it's an invalid usage
of the API deliberately to cause this crash.

It only happens once per 1000 cycles through the loop!

Bron.

From lartc at manchotnetworks.net  Fri Sep 19 03:16:47 2008
From: lartc at manchotnetworks.net (lartc)
Date: Fri, 19 Sep 2008 09:16:47 +0200
Subject: Sorry, modsequences have not been enabled on this mailbox
In-Reply-To: <1221800793.24753.2.camel@sumatra.ccuse.com>
References: <1221800793.24753.2.camel@sumatra.ccuse.com>
Message-ID: <1221808607.25127.5.camel@sumatra.ccuse.com>

hello again,

so i have read the ietf draft on modsequences, and it's exactly what i
need to accurately sync two imap boxes with mbsync.

flag/metadata changes to seen state are not propagated correctly from
the source to destination.

how can i enable it?

thanks

charles



From hdembkowski at alcatel-lucent.com  Fri Sep 19 03:54:24 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Fri, 19 Sep 2008 09:54:24 +0200
Subject: assert
In-Reply-To: <20080919055250.GA27685@brong.net>
References: <B576524D0905194499F90736CAA2758A01DD2DBE@DEEXC1U03.de.lucent.com>
	<20080919055250.GA27685@brong.net>
Message-ID: <B576524D0905194499F90736CAA2758A01DD2ECE@DEEXC1U03.de.lucent.com>

Bron,

Thank you very much for info.

Henryk 



-----Original Message-----
From: Bron Gondwana [mailto:brong at fastmail.fm] 
Sent: Friday, September 19, 2008 7:53 AM
To: DEMBKOWSKI, Henryk (Henryk)
Cc: cyrus-devel at lists.andrew.cmu.edu; info-cyrus at lists.andrew.cmu.edu
Subject: Re: assert

On Thu, Sep 18, 2008 at 05:00:39PM +0200, DEMBKOWSKI, Henryk (Henryk)
wrote:
> Hi,
> 
> When I run tool hammer_skiplist to test new version of 
> cyrusdb_skiplist.c I got
> 
> root at ms02.borsuk# ./hammer_skiplist -C /etc/imapd_p.conf -n 
> /home/tsc/dhenryk/hammer.out fatal error: Internal error: assertion 
> failed: cyrusdb_skiplist.c: 739:
> db->current_txn == NULL

        if (rop >= 999) {
          if (!r) r = DB_OLD->store(db, key, klen, value, vlen, tp);
          /* forget to commit */
        }

This would cause the bug you're seeing.  Basically it's an invalid usage
of the API deliberately to cause this crash.

It only happens once per 1000 cycles through the loop!

Bron.

From carles at unlimitedmail.org  Fri Sep 19 05:05:26 2008
From: carles at unlimitedmail.org (Carles Xavier Munyoz =?utf-8?q?Bald=C3=B3?=)
Date: Fri, 19 Sep 2008 11:05:26 +0200
Subject: Folder names with ' character in its name.
Message-ID: <200809191105.26755.carles@unlimitedmail.org>

Hello,
We have recently migrated a mail server based on Courier to a new e-mail 
platform with Cyrus.

For the mailboxes content migration we used the imapsync tool.
We have seen that some foldes with names like this:
I'm here

That is, folders with the ' character in it's name folder, where not migrated 
because Cyrus reports such names as invalid.
How can we solve it?
Is it possible to use the ' character in Cyrus folders names?

Thank you very much for your time and help.
---
SOLTECSIS SOLUCIONES TECNOLOGICAS
Carles Xavier Munyoz Bald?
cmunyoz at soltecsis.com
www.soltecsis.com
---

---
La informaci?n contenida en este e-mail es confidencial, 
siendo para uso exclusivo del destinatario arriba mencionado.
Le informamos que est? totalmente prohibida cualquier 
utilizaci?n, divulgaci?n, distribuci?n y/o reproducci?n de 
esta comunicaci?n sin autorizaci?n expresa en virtud de la 
legislaci?n vigente. Si ha recibido este mensaje por error, 
le rogamos nos lo notifique inmediatamente por la misma v?a 
y proceda a su eliminaci?n.
---

From mcnutt at buffalo.edu  Fri Sep 19 08:55:07 2008
From: mcnutt at buffalo.edu (James M McNutt)
Date: Fri, 19 Sep 2008 08:55:07 -0400 (EDT)
Subject: upgraded to v2.3.12p2
In-Reply-To: <3D520435-E3CB-4E89-92DB-76712E5B3DA1@umich.edu>
Message-ID: <Pine.GSO.4.33.0809190854190.1938-100000@hatteras.acsu.buffalo.edu>

how do you tell it to only use the com_err from cyrus-imapd?

-jim

On Thu, 18 Sep 2008, Wesley Craig wrote:

> On 05 Aug 2008, at 14:24, James M McNutt wrote:
> > not sure why we get "Unknown code imap 54"
>
> Your compile is referring to com_err from some other package, which
> is apparently not compatible with cyrus-imapd.  Probably better if
> you just used the one that comes with cyrus-imapd.
>
> :wes
>


From sofkam at rpi.edu  Fri Sep 19 12:02:28 2008
From: sofkam at rpi.edu (Michael D. Sofka)
Date: Fri, 19 Sep 2008 12:02:28 -0400
Subject: Rate limiting IMAP connections
Message-ID: <200809191202.28415.sofkam@rpi.edu>

How can I rate limit IMAP connections?  There are a few, just a few, users who 
insist they need to see email instantly using clients that connect, check 
email, disconnect----multiple times per minute.

I recall reading somewhere of a way to do this in PAM, which would be ideal 
since it would require minimal server reconfiguration.  But, now I cannot 
find the source and in this case my good friend google has not come through.

Suggestions?

Mike
-- 
Michael D. Sofka               sofkam at rpi.edu
C&MT Sr. Systems Programmer,   Email, TeX, Epistemology
Rensselaer Polytechnic Institute, Troy, NY.  http://www.rpi.edu/~sofkam/

From dbucherml at hsolutions.ch  Fri Sep 19 13:08:20 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Fri, 19 Sep 2008 19:08:20 +0200
Subject: Very annoying IMAP problem (cyrus + Outlook)
In-Reply-To: <48C9648E.5040404@hsolutions.ch>
References: <48AE83E1.3050103@hsolutions.ch>	<alpine.LSU.1.10.0808221200020.30627@hermes-1.csi.cam.ac.uk>	<48AEC613.1000405@hsolutions.ch>
	<48BC3991.80008@hsolutions.ch>	<B973790E-4445-4FF5-8CB9-A7512E6E6334@umich.edu>
	<48C9648E.5040404@hsolutions.ch>
Message-ID: <48D3DC84.5040509@hsolutions.ch>

At the end, we solved the problem by simply doing in Outlook something 
like "Deleted messages marked as being deleted" and no more problem !!!

Denis

Denis BUCHER a ?crit :
> Strange but it doesn't appear in the transaction logs.
> 
> Anyway, we think we solved the problem by deleting messages marked as 
> being deleted ! ("Expunge" AFAIK ?)
> 
> I'll keep you posted in case of new information/discoveries/solutions
> 
> Denis
> 
> Wesley Craig a ?crit :
>> On 01 Sep 2008, at 14:50, Denis BUCHER wrote:
>>> What should I do next to solve my problem ?
>> There are actually a couple of places cyrus might give the fatal error 
>> "word too long".  The prot routines should be recording the interactions 
>> before passing the data up to the imap layer where the parsing error 
>> occurs.  Are there any long lines in your telemetry?  The bad line 
>> should directly proceed "* BYE Fatal error: word too long" in the 
>> telemetry (if I'm reading imapd's fatal() routine correctly).
>>
>> AFAIK, there's nothing to be done other than adjusting the MAXWORD 
>> and/or MAXQUOTED limits.  That means upgrading or recompiling the old 
>> version that you're on.
>>
>> :wes
>>
>>> Denis BUCHER a ?crit :
>>>> David Carter a ?crit :
>>>>> On Fri, 22 Aug 2008, Denis BUCHER wrote:
>>>>>> As far as I understand, the cause of the problem is : * "Outlook is
>>>>>> sending either a token or quoted string that is longer than 8K bytes."
>>>>> Your problem is a mailbox which contains several thousand messages.
>>>>> Possibly several thousand messages which Outlook hasn't seen 
>>>>> previously.
>>>>>
>>>>> Outlook tries to construct a single IMAP command of the form:
>>>>>
>>>>>  UID FETCH uid,uid,uid,... <some set of fields>
>>>>>
>>>>> where the list of UIDs is larger than 8 KBytes in size.
>>>> Ok that's what I have :
>>>>
>>>> a) Logs are present
>>>> # ls -l /var/lib/imap/log/dbucher
>>>> total 2508
>>>> -rw------- 1 cyrus mail 355147 Aug 22 14:43 20235
>>>> -rw------- 1 cyrus mail   5327 Aug 22 14:43 25058
>>>> -rw------- 1 cyrus mail  10654 Aug 22 14:54 25415
>>>> -rw------- 1 cyrus mail 355241 Aug 22 15:24 25416
>>>> -rw------- 1 cyrus mail 355537 Aug 22 15:03 25417
>>>> -rw------- 1 cyrus mail 355147 Aug 22 14:48 25576
>>>> -rw------- 1 cyrus mail   5327 Aug 22 14:59 26381
>>>> -rw------- 1 cyrus mail   5327 Aug 22 15:04 26763
>>>> -rw------- 1 cyrus mail 355443 Aug 22 15:15 26765
>>>> -rw------- 1 cyrus mail   5327 Aug 22 15:09 27095
>>>> -rw------- 1 cyrus mail   5327 Aug 22 15:14 27752
>>>> -rw------- 1 cyrus mail 360146 Aug 22 15:19 28135
>>>> -rw------- 1 cyrus mail   5327 Aug 22 15:24 28463
>>>> -rw------- 1 cyrus mail   5327 Aug 22 15:29 29125
>>>> -rw------- 1 cyrus mail 355147 Aug 22 15:29 29127
>>>>
>>>> b) That's the UID FETCH :
>>>> # grep "UID FETCH" *
>>>> 20235:<1219408982<jbf7 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 20235:<1219408982<eke2 UID FETCH 1:7135 (UID FLAGS)
>>>> 25416:<1219411440<kb1u UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 25416:<1219411440<qv47 UID FETCH 1:7135 (UID FLAGS)
>>>> 25417:<1219409521<1ozq UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 25417:<1219409521<h7ki UID FETCH 1:7135 (UID FLAGS)
>>>> 25576:<1219409287<ukf6 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 25576:<1219409287<9vks UID FETCH 1:7135 (UID FLAGS)
>>>> 26765:<1219410214<y8b2 UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 26765:<1219410214<b685 UID FETCH 1:7135 (UID FLAGS)
>>>> 28135:<1219411131<7bfi UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 28135:<1219411131<dkkx UID FETCH 1:7135 (UID FLAGS)
>>>> 29127:<1219411745<4g4y UID FETCH 7136:* (UID FLAGS RFC822.SIZE
>>>> BODY.PEEK[HEADER] INTERNALDATE)
>>>> 29127:<1219411745<cos6 UID FETCH 1:7135 (UID FLAGS)
>>>>
>>>> c) Most sessions in the logs seem to finish correctly :
>>>> ...
>>>> <1219411787<DONE
>>>> ZZZZ LOGOUT
>>>>> 1219411787>5mk6 OK Completed
>>>> * BYE LOGOUT received
>>>> ZZZZ OK Completed
>>>>
>>>> d) But not all :
>>>> ==> 30887 <==
>>>>> 1219413279>91rc OK Completed
>>>> <1219413279<6leo IDLE
>>>>> 1219413279>+ idling
>>>> <1219413343<DONE
>>>>> 1219413343>6leo OK Completed
>>>> <1219413343<351h UID STORE 7136 +FLAGS (\Deleted \Seen)
>>>>> 1219413343>* 7136 FETCH (FLAGS (\Deleted \Seen) UID 7136)
>>>> 351h OK Completed
>>>> <1219413343<dpau IDLE
>>>>> 1219413343>+ idling
>>>> [end of file]
>>>>
>>>> e) And there are many "Fatal error: word too long" but not with same
>>>> number...
>>>> Aug 22 14:43:03 atlantic imaps[25050]: Fatal error: word too long
>>>> Aug 22 14:48:08 atlantic imaps[25063]: Fatal error: word too long
>>>> Aug 22 14:53:24 atlantic imaps[17518]: Fatal error: word too long
>>>> Aug 22 14:58:28 atlantic imaps[26379]: Fatal error: word too long
>>>> Aug 22 15:03:34 atlantic imaps[26776]: Fatal error: word too long
>>>> Aug 22 15:08:40 atlantic imaps[27118]: Fatal error: word too long
>>>> Aug 22 15:13:45 atlantic imaps[27749]: Fatal error: word too long
>>>> Aug 22 15:18:51 atlantic imaps[27174]: Fatal error: word too long
>>>> Aug 22 15:24:01 atlantic imaps[28464]: Fatal error: word too long
>>>> Aug 22 15:29:06 atlantic imaps[29123]: Fatal error: word too long
>>>>
>>>> Normally the watched account having had "Fatal error", I should find a
>>>> fatal error in the transactions logs ? Or is nothing written in case of
>>>> a Fatal error ? (Which I hope not ;-)
> 
> 
> Denis Bucher
> 


Denis Bucher

-- 

Denis Bucher   Horus Digital Solutions s?rl  Each problem has a solution
___________________________________________________________________________
    T?l. +41-22-8000625     Fax: +41-22-8000622      www.hsolutions.ch

From dbucherml at hsolutions.ch  Fri Sep 19 14:10:19 2008
From: dbucherml at hsolutions.ch (Denis BUCHER)
Date: Fri, 19 Sep 2008 20:10:19 +0200
Subject: lmtpunix: DBERROR db4: Logging region out of memory; you may
	need to increase its size
In-Reply-To: <48C96116.6070703@hsolutions.ch>
References: <48C96083.2090504@hsolutions.ch> <48C96116.6070703@hsolutions.ch>
Message-ID: <48D3EB0B.7040405@hsolutions.ch>

Hello,

I got no answer on this subject, does someone has a suggestions, or 
maybe should I give more details ?

Denis

>> I know this problem has been answered on different lists, but I don't 
>> understand what to do to correct it ?
>>
>> lmtpunix[16846]: DBERROR db4: Logging region out of memory; you may need 
>> to increase its size
>>
>> If anyone could tell me exactly which commands or config to use it would 
>> be great !
> 
> These are the complete logs :
> 
> Sep 11 20:05:35 host lmtpunix[16846]: DBERROR db4: Logging region out of 
> memory; you may need to increase its size
> 
> Sep 11 20:05:35 host lmtpunix[16846]: DBERROR: opening 
> /var/lib/imap/deliver.db: Cannot allocate memory
> 
> Sep 11 20:05:35 host lmtpunix[16846]: DBERROR: opening 
> /var/lib/imap/deliver.db: cyrusdb error
> 
> Sep 11 20:05:35 host lmtpunix[16846]: FATAL: lmtpd: unable to init 
> duplicate delivery database
> 
> Denis

From adam at morrison-ind.com  Fri Sep 19 15:05:37 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Fri, 19 Sep 2008 15:05:37 -0400
Subject: lmtpunix: DBERROR db4: Logging region out of memory; you may
	need to increase its size
In-Reply-To: <48D3EB0B.7040405@hsolutions.ch>
References: <48C96083.2090504@hsolutions.ch>
	<48C96116.6070703@hsolutions.ch>  <48D3EB0B.7040405@hsolutions.ch>
Message-ID: <1221851137.6382.8.camel@linux-nnci.site>

> I got no answer on this subject, does someone has a suggestions, or 
> maybe should I give more details ?

Possibly create a DB_CONFIG file in the db directory and restart Cyrus?
I ***ASSUME*** that Cyrus will honor the settings in the DB_CONFIG file.
(?)

<http://www.oracle.com/technology/documentation/berkeley-db/db/ref/env/db_config.html>

This is a common issue with somewhat older versions of OpenLDAP when
mixed with admins who refuse to read the documentation.  But I've never
encountered it with Cyrus.

> >> I know this problem has been answered on different lists, but I don't 
> >> understand what to do to correct it ?
> >>
> >> lmtpunix[16846]: DBERROR db4: Logging region out of memory; you may need 
> >> to increase its size



From michael.menge at zdv.uni-tuebingen.de  Fri Sep 19 15:52:03 2008
From: michael.menge at zdv.uni-tuebingen.de (Michael Menge)
Date: Fri, 19 Sep 2008 21:52:03 +0200
Subject: Folder names with ' character in its name.
In-Reply-To: <200809191105.26755.carles@unlimitedmail.org>
References: <200809191105.26755.carles@unlimitedmail.org>
Message-ID: <20080919215203.kt92f5pgbo4koo0o@webmail.uni-tuebingen.de>

Quoting Carles Xavier Munyoz Bald? <carles at unlimitedmail.org>:

> Hello,
> We have recently migrated a mail server based on Courier to a new e-mail
> platform with Cyrus.
>
> For the mailboxes content migration we used the imapsync tool.
> We have seen that some foldes with names like this:
> I'm here
>
> That is, folders with the ' character in it's name folder, where not migrated
> because Cyrus reports such names as invalid.
> How can we solve it?

One way is to remove/replace the ' in the foldername

> Is it possible to use the ' character in Cyrus folders names?


The ' is not in the set of allowed characters, which is defined as
GOODCHARS in imap/mboxname.c

But I don't know if adding it to GOODCHARS will bring other problems.

Regards

         Michael Menge

--------------------------------------------------------------------------------
M.Menge                                 Tel.: (49) 7071/29-70316
Universitaet Tuebingen                  Fax.: (49) 7071/29-5912
Zentrum fuer Datenverarbeitung          mail:  
michael.menge at zdv.uni-tuebingen.de
Waechterstrasse 76
72074 Tuebingen


From brong at fastmail.fm  Fri Sep 19 20:15:34 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Sat, 20 Sep 2008 10:15:34 +1000
Subject: lmtpunix: DBERROR db4: Logging region out of memory; you may
	need to increase its size
In-Reply-To: <1221851137.6382.8.camel@linux-nnci.site>
References: <48C96083.2090504@hsolutions.ch> <48C96116.6070703@hsolutions.ch>
	<48D3EB0B.7040405@hsolutions.ch>
	<1221851137.6382.8.camel@linux-nnci.site>
Message-ID: <20080920001534.GA31186@brong.net>

On Fri, Sep 19, 2008 at 03:05:37PM -0400, Adam Tauno Williams wrote:
> > I got no answer on this subject, does someone has a suggestions, or 
> > maybe should I give more details ?
> 
> Possibly create a DB_CONFIG file in the db directory and restart Cyrus?
> I ***ASSUME*** that Cyrus will honor the settings in the DB_CONFIG file.
> (?)
> 
> <http://www.oracle.com/technology/documentation/berkeley-db/db/ref/env/db_config.html>
> 
> This is a common issue with somewhat older versions of OpenLDAP when
> mixed with admins who refuse to read the documentation.  But I've never
> encountered it with Cyrus.

This is the what we put in DB_CONFIG at FastMail:

$ cat $cyrushome/db/DB_CONFIG
set_cachesize 0 2097152 1
set_lg_regionmax 2097152
set_lg_bsize 2097152
set_lg_max 4194304
set_tx_max 200
set_tas_spins 1
$

(off the top of my head, I don't have a clue how sane those values are -
we don't use berkeley for much, and I didn't write the config file!)

Bron.

From wes at umich.edu  Fri Sep 19 22:41:19 2008
From: wes at umich.edu (Wesley Craig)
Date: Fri, 19 Sep 2008 22:41:19 -0400
Subject: upgraded to v2.3.12p2
In-Reply-To: <Pine.GSO.4.33.0809190854190.1938-100000@hatteras.acsu.buffalo.edu>
References: <Pine.GSO.4.33.0809190854190.1938-100000@hatteras.acsu.buffalo.edu>
Message-ID: <1A2FC31A-A99E-4457-AC1F-37AC2315CB59@umich.edu>

On 19 Sep 2008, at 08:55, James M McNutt wrote:
> how do you tell it to only use the com_err from cyrus-imapd?

Try: ./configure --whatever-else-you-might-say --with-com_err=yes

From emlists at gmail.com  Sun Sep 21 09:16:06 2008
From: emlists at gmail.com (Adam D)
Date: Sun, 21 Sep 2008 06:16:06 -0700
Subject: Issues with user.sub files - subscription files hangs system.
In-Reply-To: <48D12F5C.8040006@gmail.com>
References: <48CB26A3.6090603@gmail.com>
	<48D0B228.3090404@gmail.com>	<48D0C133.9070808@bkr-ac.de>
	<48D12F5C.8040006@gmail.com>
Message-ID: <48D64916.4000706@gmail.com>

Adam D wrote:
> Jens wrote:
>   
>> Adam D schrieb:
>>   
>>     
>>> Adam D wrote:
>>>     
>>>       
>>>> I have noticed this error in the log:
>>>> Sep 12 18:57:44 vts-post cyrus/imap[19629]: IOERROR: locking
>>>> /var/lib/cyrus/domain/W/domain1/user/A/userbox.sub: Interrupted system call
>>>>
>>>> Soon afterwards I notice imapd runs at 99.8 % and I can not kill the
>>>> process.  It looks like the file is locked and can't be written to?  I
>>>> saw another file called userbox.sub.NEW but even that files can't be
>>>> read.  When I attempt the terminal freezes.  I also noticed the system
>>>> can't be rebooted as well.  I don't know what could be causing this. 
>>>> Does anyone have any incite? 
>>>>       
>>>>         
>> [...]
>>   
>>     
>>> We are using Ubuntu 8.04 on this particular amd 64 box running virtually
>>> within xen.
>>>     
>>>       
>> I had the same problem with Ubuntu 7.10 running in VMWare. I was not
>> able to fix it. My solution was a system-upgrade to 8.04. The problem
>> disappeared. I just hope it does not appear again. Some other users
>> discovered the same problem and were able to solve it with an upgrade, too.
>>
>> Sorry not to help you,
>> Jens
>>
>>   
>>     
> I thought about that last night as well and we are having the same issue
> with a system using Ubuntu 7.10.  I did noticed though 7.04, 7.10, 8.04
> are all using 2.2.13 but different patches. 7.10 uses the 2.2.13-11
> while 8.10 uses the 2.2.13-13.  I am thinking of trying 8.10 to see if
> it works.. if not.. sadly I am wondering if we will have to move the
> system over to a full Debian stable/testing?  I would not be happy to
> build a Debian testing system to find out we have the same issue.  Would
> this be a Ubuntu related issue with their patches?  Has anyone else have
> had the same issue without using Ubuntu?
>
> -Adam
> --

OK.  I have tried everything I know.  I have converted the user.sub file
from flat file to skiplist and it still gives me the same issue.  I have
also created a new test install of Debian stable with just the same
setup but using 2.2.13-10 and everything is the same.  When I am using
cyradm in the command line even loged in to the user accout and
subscribe to a folder I just created, I again get:

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+ 
COMMAND                                
 3489 cyrus     25   0 81212 3968 3116 R 99.9  1.3   4:39.88
imapd                               

I have converted everything over to skiplist even quota to make sure and
as far as I am sure it is not related to that.  My
/usr/lib/cyrus/cyrus-db-types.active reads:

ANNOTATION skiplist
DBENGINE BerkeleyDB4.2
DUPLICATE skiplist
MBOX skiplist
PTS berkeley
QUOTA quotalegacy
SEEN skiplist
SUBS skiplist
TLS skiplist


My cyrus.conf file reads as:
START {
        # do not delete this entry!
        recover         cmd="/usr/sbin/ctl_cyrusdb -r"
 
        # this is only necessary if idlemethod is set to "idled" in
imapd.conf
        #idled          cmd="idled"

        # this is useful on backend nodes of a Murder cluster
        # it causes the backend to syncronize its mailbox list with
        # the mupdate master upon startup
        #mupdatepush   cmd="/usr/sbin/ctl_mboxlist -m"

        # this is recommended if using duplicate delivery suppression
        delprune        cmd="/usr/sbin/cyr_expire -E 3"
        # this is recommended if caching TLS sessions
        tlsprune        cmd="/usr/sbin/tls_prune"
}
SERVICES {
        # --- Normal cyrus spool, or Murder backends ---
        # add or remove based on preferences
        imap            cmd="imapd -U 30" listen="imap" prefork=0
maxchild=100
        imaps           cmd="imapd -s -U 30" listen="imaps" prefork=0
maxchild=100
        #pop3           cmd="pop3d -U 30" listen="pop3" prefork=0
maxchild=50
        #pop3s          cmd="pop3d -s -U 30" listen="pop3s" prefork=0
maxchild=50
        #nntp           cmd="nntpd -U 30" listen="nntp" prefork=0
maxchild=100
        #nntps          cmd="nntpd -s -U 30" listen="nntps" prefork=0
maxchild=100

        # At least one form of LMTP is required for delivery
        # (you must keep the Unix socket name in sync with imap.conf)
        #lmtp           cmd="lmtpd" listen="localhost:lmtp" prefork=0
maxchild=20
        lmtpunix        cmd="lmtpd" listen="/var/run/cyrus/socket/lmtp"
prefork=0 maxchild=20
        # ----------------------------------------------

        # useful if you need to give users remote access to sieve
        # by default, we limit this to localhost in Debian
        sieve           cmd="timsieved" listen="localhost:sieve"
prefork=0 maxchild=100
        # this one is needed for the notification services
        notify          cmd="notifyd"
listen="/var/run/cyrus/socket/notify" proto="udp" prefork=1

}

EVENTS {
        # this is required
        checkpoint      cmd="/usr/sbin/ctl_cyrusdb -c" period=30

        # this is only necessary if using duplicate delivery suppression
        delprune        cmd="/usr/sbin/cyr_expire -E 3" at=0401

        # this is only necessary if caching TLS sessions
        tlsprune        cmd="/usr/sbin/tls_prune" at=0401
       
        # indexing of mailboxs for server side fulltext searches

        # reindex changed mailboxes (fulltext) approximately every other
hour
        squatter_1      cmd="/usr/bin/nice -n 19 /usr/sbin/squatter -s"
period=120

        # reindex all mailboxes (fulltext) daily
        squatter_a      cmd="/usr/sbin/squatter" at=0517
}


My imap.conf reads:
configdirectory: /var/lib/cyrus
defaultpartition: default
partition-default: /var/spool/cyrus/mail
partition-news: /var/spool/cyrus/news
newsspool: /var/spool/news
altnamespace: no
unixhierarchysep: yes
lmtp_downcase_rcpt: yes
admins: cyrus
imap_admins: cyrus
sieve_admins: cyrus
allowanonymouslogin: no
autocreatequota: 0
umask: 077
sieveusehomedir: false
sievedir: /var/spool/sieve
allowplaintext: yes
allowapop: no
loginrealms: @domain1.tld @domain2.tld
virtdomains: userid
defaultdomain: domain1.tld
sasl_pwcheck_method: saslauthd
sasl_auto_transition: no
tls_ca_path: /etc/ssl/certs
tls_session_timeout: 1440
lmtpsocket: /var/run/cyrus/socket/lmtp
idlemethod: poll
idlesocket: /var/run/cyrus/socket/idle
notifysocket: /var/run/cyrus/socket/notify
syslog_prefix: cyrus
# Extras
allowusermoves: 1
defaultacl: anyone lrs
userprefix: user
servername:  domain1.tld

# Hashing (mailbox storing)
fulldirhash: true

createonpost: yes
autocreateinboxfolders:  "Drafts|Sent|Templates|Trash|Junk Mail"
autosubscribeinboxfolders: "Drafts|Sent|Templates|Trash|Junk Mail"

singleinstancestore:  1
allowallsubscribe:    1


# Sieve
anysievefolder:  yes
autosievefolders: Drafts|Sent|Templates|JunkMail
##autocreate_sieve_script: /var/spool/sieve/default-scripts
##autocreate_sieve_compiledscript: 
##generate_compiled_sieve_script:  true
sieve_extensions: fileinto, reject, vacation, imapflags, notify,
include, envelope, body, relational,
 regex, subaddress, copy
sieve_maxscriptsize: 75
sieve_maxscripts: 100


# File formats
annotation_db:        skiplist
duplicate_db:         skiplist
# mboxkey_db:           skiplist
# ptscache_db           skiplist
mboxlist_db:          skiplist
seenstate_db:         skiplist
tlscache_db:          skiplist
subscription_db:      skiplist

# DB tuning
#berkeley_cachesize: 10240
#berkeley_locks_max: 5000
#berkeley_txns_max: 1000

#softfail if over quota
lmtp_over_quota_perm_failure: 0


quotawarn: 90
duplicatesuppression: 1


I am totally at a lose and have exhausted everything I know and have
read, researched.  I even bought the book of IMAP which is a very good
read by the way.

Thanks in advanced.

-Adam

From jvoorhees1 at gmail.com  Mon Sep 22 19:28:21 2008
From: jvoorhees1 at gmail.com (Jason Voorhees)
Date: Mon, 22 Sep 2008 18:28:21 -0500
Subject: suggestion need to design an  email system.
In-Reply-To: <48CF8394.9050207@infoservices.in>
References: <48CF8394.9050207@infoservices.in>
Message-ID: <48D82A15.6040401@gmail.com>

Hi:

Some months ago I was using Courier+Postfix+OpenLDAP+Phamm 
(http://www.phamm.org).
I'm not developer but I understood a little of phamm's code to realize 
that it would not be difficult to use it with Cyrus.

I'm planning to use Phamm again but this time with Cyrus. First I need 
to know how to execute cyrus tasks without cyradm (creating mailboxes, 
setting/changing quota, remove mailboxes, etc). I was thinking about 
cyradm + expect but it's just an idea by now.

Bytes!

J. Bakshi escribi?:
> Dear list,
> 
> I have a running email system which I made in 2006 based on
> postfix+cyrus+openldap. The authentication is based on openldap.
> I have done some reading through net and find a new mail server dovecot.
> I have to create another email system for multidomain based hosting
> server where both scalability as well as performance should be in prime
> consideration. I need your kind suggestion for this. shall I use dovecot
> or cyrus can fit my requirement ? another important questing ; Is there
> any webinterface which can manage the mail system based on LDAP ?
> There are many with MySql but any application which can work with
> postfix+cyrus+openldap ?
> 
> thanks
> 
> 

From frank.richter at hrz.tu-chemnitz.de  Tue Sep 23 05:48:06 2008
From: frank.richter at hrz.tu-chemnitz.de (Frank Richter)
Date: Tue, 23 Sep 2008 11:48:06 +0200 (MEST)
Subject: Sieve: UTF-7 changes in 2.3.12p2?
Message-ID: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de>

Hi,
we recently upgraded to cyrus-imapd-2.3.12p2 (Simon's RPM 2.3.12p2-2).

We've detected a problem with Sieve fileinto for folder names containing 
umlauts. The Sieve script is generated by Horde's Ingo module:
  # Delivery to subfolder t?ster (t-umlaut o-ster):
  if header :comparator "i;ascii-casemap" :contains "Subject" "ZZZ"  {
     fileinto "INBOX.t&APY-ster";
  }

Delivering with lmtp shows this:
Sep 23 11:16:40 augustus lmtp[23801]: autosievefolder: autosieve_subfolder() was called for user fri, folder user.fri.t&-APY-ster
Sep 23 11:16:40 augustus lmtp[23801]: sieve runtime error for fri id <alpine.LRH.2.00.0809231116290.14980 at angerer.hrz.tu-chemnitz.de>: Fileinto: Mailbox does not exist
Sep 23 11:16:40 augustus lmtp[23801]: duplicate_check: <alpine.LRH.2.00.0809231116290.14980 at angerer.hrz.tu-chemnitz.de> user.fri 0
Sep 23 11:16:40 augustus lmtp[23801]: duplicate_check: <alpine.LRH.2.00.0809231116290.14980 at angerer.hrz.tu-chemnitz.de> user.fri 0
Sep 23 11:16:40 augustus lmtp[23801]: Delivered: <alpine.LRH.2.00.0809231116290.14980 at angerer.hrz.tu-chemnitz.de> to mailbox: user.fri

The mail is delivered to the INBOX (user.fri)
The delivery is tried to user.fri.t&-APY-ster, NOT user.fri.t&APY-ster

Any hints where the error occurs?

Kind Regards,
Frank
-- 
E-Mail: Frank.Richter at hrz.tu-chemnitz.de  http://www.tu-chemnitz.de/~fri/
Work:   Computing Services,  Chemnitz University of Technology,  Germany

From adam at morrison-ind.com  Tue Sep 23 07:53:00 2008
From: adam at morrison-ind.com (Adam Tauno Williams)
Date: Tue, 23 Sep 2008 07:53:00 -0400
Subject: suggestion need to design an  email system.
In-Reply-To: <48D82A15.6040401@gmail.com>
References: <48CF8394.9050207@infoservices.in>  <48D82A15.6040401@gmail.com>
Message-ID: <1222170780.4804.13.camel@linux-nnci.site>

> I'm planning to use Phamm again but this time with Cyrus. First I need 
> to know how to execute cyrus tasks without cyradm (creating mailboxes, 
> setting/changing quota, remove mailboxes, etc).

All of these tasks, AFAIK, can be performed via IMAP.  So I'd image they
are performed the same way for all IMAP servers.

>  I was thinking about  cyradm + expect but it's just an idea by now.

Since you use PHP why not use PHP's Cyrus & IMAP support.
<http://us2.php.net/cyrus>
<http://us2.php.net/manual/en/book.imap.php>

Although it might be better to see if there is a PEAR/PECL module that
wraps/bundles the functionality.

<http://pear.php.net/package/Net_IMAP>
<http://www.wynia.org/wordpress/2007/02/04/alternate-imap-solution-for-php-pear-net_imap/>

My experience with PHP's "native" IMAP support is that it is quite flaky
and has dreadful [to none] error handling.  But it is PHP after all. :)


> Bytes!
> 
> J. Bakshi escribi?:
> > Dear list,
> > 
> > I have a running email system which I made in 2006 based on
> > postfix+cyrus+openldap. The authentication is based on openldap.
> > I have done some reading through net and find a new mail server dovecot.
> > I have to create another email system for multidomain based hosting
> > server where both scalability as well as performance should be in prime
> > consideration. I need your kind suggestion for this. shall I use dovecot
> > or cyrus can fit my requirement ? another important questing ; Is there
> > any webinterface which can manage the mail system based on LDAP ?
> > There are many with MySql but any application which can work with
> > postfix+cyrus+openldap ?
> > 
> > thanks
> > 
> > 
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


From joydeep at infoservices.in  Tue Sep 23 08:53:05 2008
From: joydeep at infoservices.in (J. Bakshi)
Date: Tue, 23 Sep 2008 18:23:05 +0530
Subject: suggestion need to design an  email system.
In-Reply-To: <1222170780.4804.13.camel@linux-nnci.site>
References: <48CF8394.9050207@infoservices.in> <48D82A15.6040401@gmail.com>
	<1222170780.4804.13.camel@linux-nnci.site>
Message-ID: <48D8E6B1.8040302@infoservices.in>

Adam Tauno Williams wrote:

Hello Adam,

Thanks for your hint
I'll definitely try those tool
have a nice time


>> I'm planning to use Phamm again but this time with Cyrus. First I need 
>> to know how to execute cyrus tasks without cyradm (creating mailboxes, 
>> setting/changing quota, remove mailboxes, etc).
>>     
>
> All of these tasks, AFAIK, can be performed via IMAP.  So I'd image they
> are performed the same way for all IMAP servers.
>
>   
>>  I was thinking about  cyradm + expect but it's just an idea by now.
>>     
>
> Since you use PHP why not use PHP's Cyrus & IMAP support.
> <http://us2.php.net/cyrus>
> <http://us2.php.net/manual/en/book.imap.php>
>
> Although it might be better to see if there is a PEAR/PECL module that
> wraps/bundles the functionality.
>
> <http://pear.php.net/package/Net_IMAP>
> <http://www.wynia.org/wordpress/2007/02/04/alternate-imap-solution-for-php-pear-net_imap/>
>
> My experience with PHP's "native" IMAP support is that it is quite flaky
> and has dreadful [to none] error handling.  But it is PHP after all. :)
>
>
>   
>> Bytes!
>>
>> J. Bakshi escribi?:
>>     
>>> Dear list,
>>>
>>> I have a running email system which I made in 2006 based on
>>> postfix+cyrus+openldap. The authentication is based on openldap.
>>> I have done some reading through net and find a new mail server dovecot.
>>> I have to create another email system for multidomain based hosting
>>> server where both scalability as well as performance should be in prime
>>> consideration. I need your kind suggestion for this. shall I use dovecot
>>> or cyrus can fit my requirement ? another important questing ; Is there
>>> any webinterface which can manage the mail system based on LDAP ?
>>> There are many with MySql but any application which can work with
>>> postfix+cyrus+openldap ?
>>>
>>> thanks
>>>
>>>
>>>       
>> ----
>> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
>> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
>> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>>     
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Joydeep Bakshi, Linux System Admin
Kolkatainfoservices Pvt Ltd,
23A Royd Street, Kolkata 700016, India
Work Phone 91 033 40014784
http://infoservices.in/
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


From hdembkowski at alcatel-lucent.com  Tue Sep 23 09:58:03 2008
From: hdembkowski at alcatel-lucent.com (DEMBKOWSKI, Henryk (Henryk))
Date: Tue, 23 Sep 2008 15:58:03 +0200
Subject: I can't remove message
Message-ID: <B576524D0905194499F90736CAA2758A01E133CE@DEEXC1U03.de.lucent.com>

Hi,

We have mailbox with one new message. Subscriber is not able to 
remove this message. We checked that cyrus (IMAP) doesn't allow 
to store any flags for message. I mean, subscriber can't save this
message. It is still marked as new.

I am wondering what can be wrong? Which of files can be corrupted:

-rw-------  2 cyrus mail 46667 Sep 23 15:07 211.

-rw-------  1 cyrus mail  1332 Sep 23 15:43 cyrus.cache
-rw-------  1 cyrus mail   289 Sep 23 15:08 cyrus.header
-rw-------  1 cyrus mail   176 Sep 23 15:43 cyrus.index

I thought that maybe reconstruct can help but it doesn't.
After reconstruct we still can't delete message. 


Kind Regards,
Henryk



From hans.moser at ofd-sth.niedersachsen.de  Tue Sep 23 11:08:43 2008
From: hans.moser at ofd-sth.niedersachsen.de (Moser)
Date: Tue, 23 Sep 2008 17:08:43 +0200
Subject: suggestion need to design an  email system.
In-Reply-To: <20080923023555.56BCD102B@exts098>
References: <48CF8394.9050207@infoservices.in>
	<20080923023555.56BCD102B@exts098>
Message-ID: <48D9067B.60007@ofd-sth.niedersachsen.de>

Jason Voorhees schrieb:

> I'm planning to use Phamm again but this time with Cyrus. First I need 
> to know how to execute cyrus tasks without cyradm (creating mailboxes, 
> setting/changing quota, remove mailboxes, etc). I was thinking about 
> cyradm + expect but it's just an idea by now.
Because cyradm is PERL (take a look in cyradm; "exec perl 
-MCyrus::IMAP") you could easily use the modul Cyrus::IMAP in small 
script that fulfill your needs, like a cyrus-mk-mbx.pl i.e. There is 
even a modul named IMAP::Admin.


Marc

From morgan at orst.edu  Tue Sep 23 15:48:37 2008
From: morgan at orst.edu (Andrew Morgan)
Date: Tue, 23 Sep 2008 12:48:37 -0700 (PDT)
Subject: STAGE. DIR
In-Reply-To: <2559.83.249.142.34.1221645459.squirrel@inkorgen.com>
References: <48D0C762.6000403@infoservices.in>
	<2559.83.249.142.34.1221645459.squirrel@inkorgen.com>
Message-ID: <alpine.DEB.1.10.0809231246560.24752@shell.onid.oregonstate.edu>

On Wed, 17 Sep 2008, Casper wrote:

> Hi.
>
> I wonder what the stage dir is...
> My stagedir is 21GB, those 21GB could i use somewhere else.
>
> mail2# du -sh /imap/stage./
> 21G    /imap/stage./
> mail2#
>
> Can i delete everything in this directory?

That is where incoming messages handled by lmtpd are stored after they are 
received from the network (or unix socket if using 'deliver') and before 
they are put in the destination mailbox(es).

If that directory is filling up, then I would suspect you are having 
trouble delivering mail to a particular mailbox/user.  If they are old or 
useless, then you can safely delete the files in that directory while 
cyrus is stopped.

 	Andy

From morgan at orst.edu  Tue Sep 23 15:49:08 2008
From: morgan at orst.edu (Andrew Morgan)
Date: Tue, 23 Sep 2008 12:49:08 -0700 (PDT)
Subject: suggestion need to design an  email system.
In-Reply-To: <48D82A15.6040401@gmail.com>
References: <48CF8394.9050207@infoservices.in> <48D82A15.6040401@gmail.com>
Message-ID: <alpine.DEB.1.10.0809231248400.24752@shell.onid.oregonstate.edu>

On Mon, 22 Sep 2008, Jason Voorhees wrote:

> Hi:
>
> Some months ago I was using Courier+Postfix+OpenLDAP+Phamm
> (http://www.phamm.org).
> I'm not developer but I understood a little of phamm's code to realize
> that it would not be difficult to use it with Cyrus.
>
> I'm planning to use Phamm again but this time with Cyrus. First I need
> to know how to execute cyrus tasks without cyradm (creating mailboxes,
> setting/changing quota, remove mailboxes, etc). I was thinking about
> cyradm + expect but it's just an idea by now.

You might want to check out my perl scripts for managing Cyrus as a 
starting point:

   http://oregonstate.edu/~morgan/cyrus/public/

 	Andy

From robm at fastmail.fm  Tue Sep 23 18:22:24 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Wed, 24 Sep 2008 08:22:24 +1000
Subject: Sieve: UTF-7 changes in 2.3.12p2?
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de>
Message-ID: <292EE824A0A448669AA0F90326A372C8@robmhp>


> The mail is delivered to the INBOX (user.fri)
> The delivery is tried to user.fri.t&-APY-ster, NOT user.fri.t&APY-ster
>
> Any hints where the error occurs?

Yes.

Sieve scripts are in utf-8. You now have to use the true utf-8 name of the 
folder in your sieve script, and it's automatically converted to the 
modified utf-7 folder name internally.

This change is noted in the changelog for 2.3.11

---
The Sieve compiler now translates UTF-8 mailbox names used in fileinto to 
modified UTF-7 so that messages will be successfully inserted into the 
mailbox.
---

The old way of using the modified utf-7 form in the sieve script was really 
wrong and hacky.

Rob

PS. It would be nice if http://cyrusimap.web.cmu.edu/imapd/changes.html was 
kept up to date or removed... it's very old.



From jan at horde.org  Wed Sep 24 18:32:33 2008
From: jan at horde.org (Jan Schneider)
Date: Thu, 25 Sep 2008 00:32:33 +0200
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <292EE824A0A448669AA0F90326A372C8@robmhp>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de>
	<292EE824A0A448669AA0F90326A372C8@robmhp>
Message-ID: <20080925003233.379741r4xhija1a8@neo.wg.de>

Zitat von Rob Mueller <robm at fastmail.fm>:

>
>> The mail is delivered to the INBOX (user.fri)
>> The delivery is tried to user.fri.t&-APY-ster, NOT user.fri.t&APY-ster
>>
>> Any hints where the error occurs?
>
> Yes.
>
> Sieve scripts are in utf-8. You now have to use the true utf-8 name of the
> folder in your sieve script, and it's automatically converted to the
> modified utf-7 folder name internally.
>
> This change is noted in the changelog for 2.3.11
>
> ---
> The Sieve compiler now translates UTF-8 mailbox names used in fileinto to
> modified UTF-7 so that messages will be successfully inserted into the
> mailbox.
> ---
>
> The old way of using the modified utf-7 form in the sieve script was really
> wrong and hacky.
>
> Rob
>
> PS. It would be nice if http://cyrusimap.web.cmu.edu/imapd/changes.html was
> kept up to date or removed... it's very old.

Is this a bad joke or am I missing something? Sieve scripts of most  
non-English-speakers are intentionally broken due to a BC breaking  
change in a bugfix release version?

Jan.

-- 
Do you need professional PHP or Horde consulting?
http://horde.org/consulting/


From robm at fastmail.fm  Wed Sep 24 23:14:15 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Thu, 25 Sep 2008 13:14:15 +1000
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <20080925003233.379741r4xhija1a8@neo.wg.de>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de><292EE824A0A448669AA0F90326A372C8@robmhp>
	<20080925003233.379741r4xhija1a8@neo.wg.de>
Message-ID: <01BB3F2F000B4138AB3C5CEF10F43052@Atticus>


> Is this a bad joke or am I missing something? Sieve scripts of most
> non-English-speakers are intentionally broken due to a BC breaking
> change in a bugfix release version?

I'm afraid you're not missing anything. It bit us as well :(

Fortunately for us, there weren't that many people with non-english folder 
names with filter rules, but for other people, this could be a pretty nasty 
change.

The change is actually the correct "fix", but dropping it in without any 
large "warning" in the changelog or release announcement is pretty rough.

Fixing all the existing sieve scripts shouldn't be too hard though. A perl 
1-liner could almost do it...

perl -pi -e 'use Encode; use Encode::IMAPUTF7; 
s/\bfileinto\s+"([^"]*)"/$f=$1;from_to($f,"IMAP-UTF-7","utf-8");$f;/ge;' 
/path/to/sievescripts/*

You'll need to recompile the script as well. Completely untested, but should 
get you on the way.

Rob


From frank.richter at hrz.tu-chemnitz.de  Thu Sep 25 00:45:34 2008
From: frank.richter at hrz.tu-chemnitz.de (Frank Richter)
Date: Thu, 25 Sep 2008 06:45:34 +0200 (MEST)
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <01BB3F2F000B4138AB3C5CEF10F43052@Atticus>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de><292EE824A0A448669AA0F90326A372C8@robmhp>
	<20080925003233.379741r4xhija1a8@neo.wg.de>
	<01BB3F2F000B4138AB3C5CEF10F43052@Atticus>
Message-ID: <alpine.LRH.2.00.0809250643100.6758@tor.hrz.tu-chemnitz.de>

>> Is this a bad joke or am I missing something? Sieve scripts of most
>> non-English-speakers are intentionally broken due to a BC breaking
>> change in a bugfix release version?
>
> I'm afraid you're not missing anything. It bit us as well :(
>
> Fortunately for us, there weren't that many people with non-english folder
> names with filter rules, but for other people, this could be a pretty nasty
> change.
>
> The change is actually the correct "fix", but dropping it in without any
> large "warning" in the changelog or release announcement is pretty rough.
>
> Fixing all the existing sieve scripts shouldn't be too hard though. A perl
> 1-liner could almost do it...

But it needs to fix the tool generating the sieve scripts, too.
Like Hordes's filter module. Jan, could you give a quick hint where to 
look for this?

Frank
-- 
E-Mail: Frank.Richter at hrz.tu-chemnitz.de  http://www.tu-chemnitz.de/~fri/
Work:   Computing Services,  Chemnitz University of Technology,  Germany

From lartc at manchotnetworks.net  Thu Sep 25 02:10:36 2008
From: lartc at manchotnetworks.net (lartc)
Date: Thu, 25 Sep 2008 08:10:36 +0200
Subject: server side archiving & grooming of mail stores
Message-ID: <1222323036.3900.2.camel@sumatra.ccuse.com>

hi all,

i'm looking for direction on how to move messages of a certain age from
one mailbox to an archive mailbox.

are there server side utilities to do this?

many thanks

charles


From jan at horde.org  Thu Sep 25 06:21:33 2008
From: jan at horde.org (Jan Schneider)
Date: Thu, 25 Sep 2008 12:21:33 +0200
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <alpine.LRH.2.00.0809250643100.6758@tor.hrz.tu-chemnitz.de>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de><292EE824A0A448669AA0F90326A372C8@robmhp>
	<20080925003233.379741r4xhija1a8@neo.wg.de>
	<01BB3F2F000B4138AB3C5CEF10F43052@Atticus>
	<alpine.LRH.2.00.0809250643100.6758@tor.hrz.tu-chemnitz.de>
Message-ID: <20080925122133.120013shbc1zc0to@neo.wg.de>

Zitat von Frank Richter <frank.richter at hrz.tu-chemnitz.de>:

>>> Is this a bad joke or am I missing something? Sieve scripts of most
>>> non-English-speakers are intentionally broken due to a BC breaking
>>> change in a bugfix release version?
>>
>> I'm afraid you're not missing anything. It bit us as well :(
>>
>> Fortunately for us, there weren't that many people with non-english folder
>> names with filter rules, but for other people, this could be a pretty nasty
>> change.
>>
>> The change is actually the correct "fix", but dropping it in without any
>> large "warning" in the changelog or release announcement is pretty rough.
>>
>> Fixing all the existing sieve scripts shouldn't be too hard though. A perl
>> 1-liner could almost do it...
>
> But it needs to fix the tool generating the sieve scripts, too.

Not only that, but clients and the server have to be updated  
synchronously. While this might be easy for webmail clients, it's an  
impossible tasks if users are using desktop clients to manage their  
sieve scripts.

Maybe this only a theoretical problem. Is there any desktop client out  
there that *generates* Sieve scripts, i.e. not simply download and  
upload complete scripts like KMail?

> Like Hordes's filter module. Jan, could you give a quick hint where  
> to look for this?

Not out of my head, but we probably need to add a configuration  
setting in Ingo to switch between the old and new behavior. Please add  
a request on http://bugs.horde.org.

Jan.

-- 
Do you need professional PHP or Horde consulting?
http://horde.org/consulting/


From paul at vandervlis.nl  Thu Sep 25 06:29:46 2008
From: paul at vandervlis.nl (Paul van der Vlis)
Date: Thu, 25 Sep 2008 12:29:46 +0200
Subject: Logging IP numbers for POP3 and IMAP
Message-ID: <48DB681A.9040406@vandervlis.nl>

Hello,

Is it possible to log the IP-numbers from people who access a server
using POP3 or IMAP?

Or is there maybe a way to block people who do a trying too many passwords?

With regards,
Paul van der Vlis.




-- 
http://www.vandervlis.nl/


From Hagedorn at uni-koeln.de  Thu Sep 25 06:36:28 2008
From: Hagedorn at uni-koeln.de (Sebastian Hagedorn)
Date: Thu, 25 Sep 2008 12:36:28 +0200
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <20080925122133.120013shbc1zc0to@neo.wg.de>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de>
	<292EE824A0A448669AA0F90326A372C8@robmhp>
	<20080925003233.379741r4xhija1a8@neo.wg.de>
	<01BB3F2F000B4138AB3C5CEF10F43052@Atticus>
	<alpine.LRH.2.00.0809250643100.6758@tor.hrz.tu-chemnitz.de>
	<20080925122133.120013shbc1zc0to@neo.wg.de>
Message-ID: <F513D4533C2F39873EC6AC43@tyrion.rrz.uni-koeln.de>

--On 25. September 2008 12:21:33 +0200 Jan Schneider <jan at horde.org> wrote:

> Maybe this only a theoretical problem. Is there any desktop client out
> there that *generates* Sieve scripts, i.e. not simply download and
> upload complete scripts like KMail?

Yes, Mulberry does that. But it's write-only, i.e. it can't list or edit 
scripts that are on the server, so IMHO it's not very useful. I suppose 
we'll need to patch our Smartsieve installation before we upgrade to 2.3.12 
...
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Geb?ude 52), Zimmer 18.:.
Zentrum f?r angewandte Informatik - Universit?tsweiter Service RRZK
.:.Universit?t zu K?ln / Cologne University - ? +49-221-478-5587.:.
                   .:.:.:.Skype: shagedorn.:.:.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080925/a34b3c94/attachment.bin 

From schattenkeil at googlemail.com  Thu Sep 25 10:03:12 2008
From: schattenkeil at googlemail.com (=?ISO-8859-1?Q?Bj=F6rn_Keil?=)
Date: Thu, 25 Sep 2008 16:03:12 +0200
Subject: Different mailbox and login names
Message-ID: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>

Hello,

I am pretty new to Cyrus and got some problems with it.
I am trying to set up a Cyrus IMAP Server on a Debian Linux (Etch) System.
The system is running an Exim 4 Mailserver.

The problem is that I need the usernames that the users give when they log
in to be different from the names of their mailboxes.  For example if the
user "bjoern" logs in, his INBOX shall be user.keil.

The only thing that I found that may help in that direction was an article
in the SASL documentation about the difference between authorization ID and
authentication ID. However, I didn't find anything in the IMAP server
documentation how to use that differentiation - and so - by default - it
seems to be the same.

As authentication mechanism I use the sasldb auxprop plugin, with a database
under /etc/sasldb, as it was preinstalled and seemed to be the simplest and
best way for the scale I intend (an IMAP server for 10 users or so).

bjoern at kant:~$ sudo aptitude show libsasl2 | grep Version
Version: 2.1.22.dfsg1-8

bjoern at kant:/etc$ sudo aptitude show cyrus-imapd-2.2 | grep Version
Version: 2.2.13-10
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080925/280b4034/attachment-0001.html 

From peo at intersonic.se  Thu Sep 25 10:04:49 2008
From: peo at intersonic.se (Per olof Ljungmark)
Date: Thu, 25 Sep 2008 16:04:49 +0200
Subject: cyr_expire signaled to death by 11
Message-ID: <48DB9A81.8080008@intersonic.se>

No idea why, comments anyone? A limitation of some sort when expunging a
lot of messages?

cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
cyr_expire[96599]: expunged 4907 out of 109443 messages from 143 mailboxes
master[833]: process 96599 exited, signaled to death by 11

--per

From farislinux at yahoo.com  Thu Sep 25 10:20:00 2008
From: farislinux at yahoo.com (faris)
Date: Thu, 25 Sep 2008 07:20:00 -0700 (PDT)
Subject: Loadtesting Imap
Message-ID: <972950.78066.qm@web33203.mail.mud.yahoo.com>

Dear All,
?
Please tell me which is the best way to benchmark/loadtest 200K useraccounts to see the maximum performance ?

Regards,
Faris
?


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080925/3875a09b/attachment.html 

From wes at umich.edu  Thu Sep 25 10:34:30 2008
From: wes at umich.edu (Wesley Craig)
Date: Thu, 25 Sep 2008 10:34:30 -0400
Subject: cyr_expire signaled to death by 11
In-Reply-To: <48DB9A81.8080008@intersonic.se>
References: <48DB9A81.8080008@intersonic.se>
Message-ID: <43FE941E-E210-4000-9C74-451C0004142C@umich.edu>

On 25 Sep 2008, at 10:04, Per olof Ljungmark wrote:
> No idea why, comments anyone? A limitation of some sort when  
> expunging a
> lot of messages?
>
> cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
> cyr_expire[96599]: expunged 4907 out of 109443 messages from 143  
> mailboxes
> master[833]: process 96599 exited, signaled to death by 11

It would be great to see a traceback.

:wes

From dpc22 at cam.ac.uk  Thu Sep 25 11:07:27 2008
From: dpc22 at cam.ac.uk (David Carter)
Date: Thu, 25 Sep 2008 16:07:27 +0100 (BST)
Subject: cyr_expire signaled to death by 11
In-Reply-To: <48DB9A81.8080008@intersonic.se>
References: <48DB9A81.8080008@intersonic.se>
Message-ID: <alpine.LSU.2.00.0809251510320.25271@hermes-1.csi.cam.ac.uk>

On Thu, 25 Sep 2008, Per olof Ljungmark wrote:

> No idea why, comments anyone? A limitation of some sort when expunging a
> lot of messages?
>
> cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
> cyr_expire[96599]: expunged 4907 out of 109443 messages from 143 mailboxes
> master[833]: process 96599 exited, signaled to death by 11

Probably a corrupt cyrus.cache file (at least that's the cause when I see 
these). Try reconstruct on the mailbox.

-- 
David Carter                             Email: David.Carter at ucs.cam.ac.uk
University Computing Service,            Phone: (01223) 334502
New Museums Site, Pembroke Street,       Fax:   (01223) 334679
Cambridge UK. CB2 3QH.

From dom.lalot at gmail.com  Thu Sep 25 12:07:43 2008
From: dom.lalot at gmail.com (Dominique LALOT)
Date: Thu, 25 Sep 2008 18:07:43 +0200
Subject: cyr_expire signaled to death by 11
In-Reply-To: <48DB9A81.8080008@intersonic.se>
References: <48DB9A81.8080008@intersonic.se>
Message-ID: <48DBB74F.3060203@gmail.com>

Per olof Ljungmark a ?crit :
> No idea why, comments anyone? A limitation of some sort when expunging a
> lot of messages?
>
> cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
> cyr_expire[96599]: expunged 4907 out of 109443 messages from 143 mailboxes
> master[833]: process 96599 exited, signaled to death by 11
>
> --per
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>   
I got many of that messages after an unexpected shutdown  of our SAN.
Just reconstruct your mailboxes
Most of the time you can find them in the log and you can reconstruct 
them via my perl script

#!/usr/bin/perl
open (FIC,"</var/log/imapd.log") or die "Ouverture imapd.log impossible $!";
# Sep 18 15:34:43 smtp imap[13895]: DBERROR: opening 
/var/lib/imap/user/l/l^e.seen: cyrusdb error
while (<FIC>){
   if (/DBERROR: opening (\S+): cyrusdb error/) {$HBadSeen{$1}=1;}
   elsif (/smtp (imap|pop3|pop3s|imaps)\[(\d+)\]: open: user (\S+) /){
      $Hpid{$2}=$3;
   }
   elsif (/process (\d+) exited, signaled/){
      #print "mbox ".$Hpid{$1}." damaged\n";
      $name=$Hpid{$1};
      $badbox{$name}=1;
   }
}
foreach (sort keys %badbox){
   print "reconstruct: $_\n";
   `su - cyrus -c "reconstruct -rf user/$_"`;
   `su - cyrus -c "quota -f user/$_"`;
}
foreach (keys %HBadSeen){
   print "Correction seen: $_\n";
   `/bin/rm $_`;
}

Dom

From dom.lalot at gmail.com  Thu Sep 25 12:15:09 2008
From: dom.lalot at gmail.com (Dominique LALOT)
Date: Thu, 25 Sep 2008 18:15:09 +0200
Subject: Cyrus Imap Benchmark
In-Reply-To: <556741.10875.qm@web33201.mail.mud.yahoo.com>
References: <556741.10875.qm@web33201.mail.mud.yahoo.com>
Message-ID: <48DBB90D.7040701@gmail.com>

faris a ?crit :
> Dear Bron,
>  
> If i upgrade cyrus-imap to a newer version, will it effect the current 
> mailboxes ?
>  
> When we partition drives, we make (3 drives) raid5 array with ext3 
> partitions. we can expand RAM but how can we
>  
> Also u said to split meta for more effeciency.. how can we do split it?
>  
> Thanks,
>  
> Faris
>
>
And don't forget to check for fragmentation. It comes very quickly on 
ext3 even with 50% free on a 500G spool
On a rather old spool, we were around 60%
> ------------------------------------------------------------------------
>
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080925/ddf1b2ab/attachment.html 

From jlar310 at gmail.com  Thu Sep 25 13:02:34 2008
From: jlar310 at gmail.com (Jeff)
Date: Thu, 25 Sep 2008 12:02:34 -0500
Subject: Different mailbox and login names
In-Reply-To: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>
References: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>
Message-ID: <d1f9b6f00809251002k31e75bdei98ce549949f406ad@mail.gmail.com>

On Thu, Sep 25, 2008 at 9:03 AM, Bj?rn Keil <schattenkeil at googlemail.com> wrote:
> Hello,
>
> I am pretty new to Cyrus and got some problems with it.
> I am trying to set up a Cyrus IMAP Server on a Debian Linux (Etch) System.
> The system is running an Exim 4 Mailserver.
>
> The problem is that I need the usernames that the users give when they log
> in to be different from the names of their mailboxes.  For example if the
> user "bjoern" logs in, his INBOX shall be user.keil.
>
> The only thing that I found that may help in that direction was an article
> in the SASL documentation about the difference between authorization ID and
> authentication ID. However, I didn't find anything in the IMAP server
> documentation how to use that differentiation - and so - by default - it
> seems to be the same.
>
> As authentication mechanism I use the sasldb auxprop plugin, with a database
> under /etc/sasldb, as it was preinstalled and seemed to be the simplest and
> best way for the scale I intend (an IMAP server for 10 users or so).

Even if you could do that, what is the justification? I think it would
lead to great confusion for admins. Isn't this something that would be
better handled at the MTA level with aliases?

-- 
Jeff

From TSchlabach at gmx.net  Thu Sep 25 13:22:02 2008
From: TSchlabach at gmx.net (Torsten Schlabach)
Date: Thu, 25 Sep 2008 19:22:02 +0200
Subject: Different mailbox and login names
In-Reply-To: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>
References: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>
Message-ID: <20080925172202.202300@gmx.net>

Hi Bj?rn!

You will need to look for a canon_user plugin. That's the *only* solution possible.

Regards,
Torsten

-------- Original-Nachricht --------
> Datum: Thu, 25 Sep 2008 16:03:12 +0200
> Von: "Bj?rn Keil" <schattenkeil at googlemail.com>
> An: info-cyrus at lists.andrew.cmu.edu
> Betreff: Different mailbox and login names

> Hello,
> 
> I am pretty new to Cyrus and got some problems with it.
> I am trying to set up a Cyrus IMAP Server on a Debian Linux (Etch) System.
> The system is running an Exim 4 Mailserver.
> 
> The problem is that I need the usernames that the users give when they log
> in to be different from the names of their mailboxes.  For example if the
> user "bjoern" logs in, his INBOX shall be user.keil.
> 
> The only thing that I found that may help in that direction was an article
> in the SASL documentation about the difference between authorization ID
> and
> authentication ID. However, I didn't find anything in the IMAP server
> documentation how to use that differentiation - and so - by default - it
> seems to be the same.
> 
> As authentication mechanism I use the sasldb auxprop plugin, with a
> database
> under /etc/sasldb, as it was preinstalled and seemed to be the simplest
> and
> best way for the scale I intend (an IMAP server for 10 users or so).
> 
> bjoern at kant:~$ sudo aptitude show libsasl2 | grep Version
> Version: 2.1.22.dfsg1-8
> 
> bjoern at kant:/etc$ sudo aptitude show cyrus-imapd-2.2 | grep Version
> Version: 2.2.13-10

From brong at fastmail.fm  Thu Sep 25 18:02:39 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Fri, 26 Sep 2008 08:02:39 +1000
Subject: cyr_expire signaled to death by 11
In-Reply-To: <43FE941E-E210-4000-9C74-451C0004142C@umich.edu>
References: <48DB9A81.8080008@intersonic.se>
	<43FE941E-E210-4000-9C74-451C0004142C@umich.edu>
Message-ID: <20080925220239.GA12557@brong.net>

On Thu, Sep 25, 2008 at 10:34:30AM -0400, Wesley Craig wrote:
> On 25 Sep 2008, at 10:04, Per olof Ljungmark wrote:
> > No idea why, comments anyone? A limitation of some sort when  
> > expunging a
> > lot of messages?
> >
> > cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
> > cyr_expire[96599]: expunged 4907 out of 109443 messages from 143  
> > mailboxes
> > master[833]: process 96599 exited, signaled to death by 11
> 
> It would be great to see a traceback.

Also your imapd.conf.  In particular: is delayed delete enabled?  It
looks like cyr_expire has finished expunging messages, and is either
cleaning up delayed delete mailboxes, or purging the deliver.db.  The
traceback will tell for sure.

Bron.

From robm at fastmail.fm  Thu Sep 25 21:15:31 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Fri, 26 Sep 2008 11:15:31 +1000
Subject: Sieve: UTF-7 changes in 2.3.12p2?
In-Reply-To: <20080925122133.120013shbc1zc0to@neo.wg.de>
References: <alpine.LRH.2.00.0809231139220.14980@angerer.hrz.tu-chemnitz.de><292EE824A0A448669AA0F90326A372C8@robmhp><20080925003233.379741r4xhija1a8@neo.wg.de><01BB3F2F000B4138AB3C5CEF10F43052@Atticus><alpine.LRH.2.00.0809250643100.6758@tor.hrz.tu-chemnitz.de>
	<20080925122133.120013shbc1zc0to@neo.wg.de>
Message-ID: <9BA1B6B28B934EF3BEA2B80534CAD3BE@Atticus>


> Not out of my head, but we probably need to add a configuration
> setting in Ingo to switch between the old and new behavior. Please add  a 
> request on http://bugs.horde.org.

Might be worth trying to make it an imapd.conf option for cyrus as well to 
choose between the old or new behaviour to make upgrades for users easier. I 
think a patch should be fairly easy if you look into it. Unfortunately i 
don't have the time right now...

Rob


From peo at intersonic.se  Fri Sep 26 02:41:31 2008
From: peo at intersonic.se (Per olof Ljungmark)
Date: Fri, 26 Sep 2008 08:41:31 +0200
Subject: cyr_expire signaled to death by 11
In-Reply-To: <20080925220239.GA12557@brong.net>
References: <48DB9A81.8080008@intersonic.se>
	<43FE941E-E210-4000-9C74-451C0004142C@umich.edu>
	<20080925220239.GA12557@brong.net>
Message-ID: <48DC841B.5010007@intersonic.se>

Bron Gondwana wrote:
> On Thu, Sep 25, 2008 at 10:34:30AM -0400, Wesley Craig wrote:
>> On 25 Sep 2008, at 10:04, Per olof Ljungmark wrote:
>>> No idea why, comments anyone? A limitation of some sort when  
>>> expunging a
>>> lot of messages?
>>>
>>> cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
>>> cyr_expire[96599]: expunged 4907 out of 109443 messages from 143  
>>> mailboxes
>>> master[833]: process 96599 exited, signaled to death by 11
>> It would be great to see a traceback.
> 
> Also your imapd.conf.  In particular: is delayed delete enabled?  It
> looks like cyr_expire has finished expunging messages, and is either
> cleaning up delayed delete mailboxes, or purging the deliver.db.  The
> traceback will tell for sure.

I am sorry but no traces available this time. Will make preparations so
if it happens again there will be one.

And yes, delayed delete is enabled.

imapd.conf

servername: ourserver
configdirectory: /var/imap
defaultdomain: defaultdomain.tld
virtdomains: off
altnamespace: on
unixhierarchysep: 1
singleinstancestore: 0
reject8bit: no
quotawarn: 95
quotawarnkb: 20000
lmtp_over_quota_perm_failure: 1
lmtp_strict_quota: 0
lmtp_downcase_rcpt: yes
timeout: 60
imapidlepoll: 60

# Delayed expunge, see also cyrus.conf
expunge_mode: delayed
delete_mode: delayed
deletedprefix: DELETED

poptimeout: 15
popminpoll: 0

# We are using LDAP:
username_tolower: on

### Sync section ####
sync_authname: <authname>
sync_host: <IP>
sync_password: a password
sync_repeat_interval: 5
sync_log: 1
sync_machineid: 1
sync_shutdown_file: /var/imap/shutdown-sync
sync_batch_size: 1000
guid_mode: sha1
### End sync directives ###

partition-default: /var/spool/imap

admins: <admins>
autocreatequota: 500000
createonpost: on
autocreateinboxfolders: Sent|Trash|Drafts|Templates
autosubscribeinboxfolders: Sent|Trash

sieveusehomedir: false
sievedir: /var/imap/sieve
sieve_maxscriptsize: 64
sieve_maxscripts: 8
sieve_tls_cert_file: disabled
sieve_tls_key_file: disabled

sendmail: /usr/sbin/sendmail
postmaster: postmaster

duplicatesuppression: 0

# Note: Cyrus does *NOT* have BDB support compiled in!
annotation_db: skiplist
mboxlist_db: skiplist
seenstate_db: skiplist
subscription_db: flat
tlscache_db: skiplist
ptscache_db: skiplist
duplicate_db: skiplist
statatuscache_db: skiplist
statuscache: 1

sasl_mech_list: plain
sasl_pwcheck_method: saslauthd
sasl_ldap_servers: localhost
saslauthd_path: /var/state/saslauthd/mux
sasl_log_level: 10

allowplaintext: 1
allowplainwithouttls: yes
allowanonymouslogin:  no

tls_require_cert: 0
tls_cert_file: certfile
tls_key_file: keyfile
tls_ca_file: cafile

notifysocket: /var/imap/socket/notify

# EOF

From hans.moser at ofd-sth.niedersachsen.de  Fri Sep 26 04:11:37 2008
From: hans.moser at ofd-sth.niedersachsen.de (Marc Patermann)
Date: Fri, 26 Sep 2008 10:11:37 +0200
Subject: Logging IP numbers for POP3 and IMAP
In-Reply-To: <20080925130045.DF244102B@exts098>
References: <20080925130045.DF244102B@exts098>
Message-ID: <48DC9939.6030200@ofd-sth.niedersachsen.de>

Paul van der Vlis schrieb:

> Is it possible to log the IP-numbers from people who access a server
> using POP3 or IMAP?
Isn't that what IMAPd does anyway?

Sep 26 10:08:26 local6:notice imap[2551820]: login: hostname.domain 
[inter.net.add.ress] username plain+TLS User logged in



Marc

From schattenkeil at googlemail.com  Fri Sep 26 05:07:46 2008
From: schattenkeil at googlemail.com (=?ISO-8859-1?Q?Bj=F6rn_Keil?=)
Date: Fri, 26 Sep 2008 11:07:46 +0200
Subject: Different mailbox and login names
In-Reply-To: <d1f9b6f00809251002k31e75bdei98ce549949f406ad@mail.gmail.com>
References: <9da2d740809250703h6c7adaacu18a0ce1753727a00@mail.gmail.com>
	<d1f9b6f00809251002k31e75bdei98ce549949f406ad@mail.gmail.com>
Message-ID: <9da2d740809260207ia15cb85rcc6412fad5e967b3@mail.gmail.com>

Ah... yes...
I changed the /etc/aliases file to redirect to the boxes I wanted, added a
new router to the exim confiugration to accept local mail for those
addresses and created mailboxes in cyrus for those users (and still reject
mail for unknown users).

Sometimes the solution is just too obvious.

2008/9/25 Jeff <jlar310 at gmail.com>

> On Thu, Sep 25, 2008 at 9:03 AM, Bj?rn Keil <schattenkeil at googlemail.com>
> wrote:
> > Hello,
> >
> > I am pretty new to Cyrus and got some problems with it.
> > I am trying to set up a Cyrus IMAP Server on a Debian Linux (Etch)
> System.
> > The system is running an Exim 4 Mailserver.
> >
> > The problem is that I need the usernames that the users give when they
> log
> > in to be different from the names of their mailboxes.  For example if the
> > user "bjoern" logs in, his INBOX shall be user.keil.
> >
> > The only thing that I found that may help in that direction was an
> article
> > in the SASL documentation about the difference between authorization ID
> and
> > authentication ID. However, I didn't find anything in the IMAP server
> > documentation how to use that differentiation - and so - by default - it
> > seems to be the same.
> >
> > As authentication mechanism I use the sasldb auxprop plugin, with a
> database
> > under /etc/sasldb, as it was preinstalled and seemed to be the simplest
> and
> > best way for the scale I intend (an IMAP server for 10 users or so).
>
> Even if you could do that, what is the justification? I think it would
> lead to great confusion for admins. Isn't this something that would be
> better handled at the MTA level with aliases?
>
> --
> Jeff
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080926/99fc9522/attachment.html 

From casper at snigelpost.org  Fri Sep 26 07:07:13 2008
From: casper at snigelpost.org (Casper)
Date: Fri, 26 Sep 2008 13:07:13 +0200 (CEST)
Subject: cyr_expire signaled to death by 11
In-Reply-To: <48DC841B.5010007@intersonic.se>
References: <48DB9A81.8080008@intersonic.se>
	<43FE941E-E210-4000-9C74-451C0004142C@umich.edu>
	<20080925220239.GA12557@brong.net> <48DC841B.5010007@intersonic.se>
Message-ID: <28192.83.249.131.121.1222427233.squirrel@inkorgen.com>

Hi!


I think it looks like you have some broken mailboxes, try to find what
mailbox, recontruct the mailbox(es) and the cyr_expirew would work without
errors! No more broken pipes.



> Bron Gondwana wrote:
>> On Thu, Sep 25, 2008 at 10:34:30AM -0400, Wesley Craig wrote:
>>> On 25 Sep 2008, at 10:04, Per olof Ljungmark wrote:
>>>> No idea why, comments anyone? A limitation of some sort when
>>>> expunging a
>>>> lot of messages?
>>>>
>>>> cyr_expire [96599]: Expunged 3005 messages from user.myuser.Trash
>>>> cyr_expire[96599]: expunged 4907 out of 109443 messages from 143
>>>> mailboxes
>>>> master[833]: process 96599 exited, signaled to death by 11
>>> It would be great to see a traceback.
>>
>> Also your imapd.conf.  In particular: is delayed delete enabled?  It
>> looks like cyr_expire has finished expunging messages, and is either
>> cleaning up delayed delete mailboxes, or purging the deliver.db.  The
>> traceback will tell for sure.
>
> I am sorry but no traces available this time. Will make preparations so
> if it happens again there will be one.
>
> And yes, delayed delete is enabled.
>
> imapd.conf
>
> servername: ourserver
> configdirectory: /var/imap
> defaultdomain: defaultdomain.tld
> virtdomains: off
> altnamespace: on
> unixhierarchysep: 1
> singleinstancestore: 0
> reject8bit: no
> quotawarn: 95
> quotawarnkb: 20000
> lmtp_over_quota_perm_failure: 1
> lmtp_strict_quota: 0
> lmtp_downcase_rcpt: yes
> timeout: 60
> imapidlepoll: 60
>
> # Delayed expunge, see also cyrus.conf
> expunge_mode: delayed
> delete_mode: delayed
> deletedprefix: DELETED
>
> poptimeout: 15
> popminpoll: 0
>
> # We are using LDAP:
> username_tolower: on
>
> ### Sync section ####
> sync_authname: <authname>
> sync_host: <IP>
> sync_password: a password
> sync_repeat_interval: 5
> sync_log: 1
> sync_machineid: 1
> sync_shutdown_file: /var/imap/shutdown-sync
> sync_batch_size: 1000
> guid_mode: sha1
> ### End sync directives ###
>
> partition-default: /var/spool/imap
>
> admins: <admins>
> autocreatequota: 500000
> createonpost: on
> autocreateinboxfolders: Sent|Trash|Drafts|Templates
> autosubscribeinboxfolders: Sent|Trash
>
> sieveusehomedir: false
> sievedir: /var/imap/sieve
> sieve_maxscriptsize: 64
> sieve_maxscripts: 8
> sieve_tls_cert_file: disabled
> sieve_tls_key_file: disabled
>
> sendmail: /usr/sbin/sendmail
> postmaster: postmaster
>
> duplicatesuppression: 0
>
> # Note: Cyrus does *NOT* have BDB support compiled in!
> annotation_db: skiplist
> mboxlist_db: skiplist
> seenstate_db: skiplist
> subscription_db: flat
> tlscache_db: skiplist
> ptscache_db: skiplist
> duplicate_db: skiplist
> statatuscache_db: skiplist
> statuscache: 1
>
> sasl_mech_list: plain
> sasl_pwcheck_method: saslauthd
> sasl_ldap_servers: localhost
> saslauthd_path: /var/state/saslauthd/mux
> sasl_log_level: 10
>
> allowplaintext: 1
> allowplainwithouttls: yes
> allowanonymouslogin:  no
>
> tls_require_cert: 0
> tls_cert_file: certfile
> tls_key_file: keyfile
> tls_ca_file: cafile
>
> notifysocket: /var/imap/socket/notify
>
> # EOF
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
>
>
>
>



From mills at cc.umanitoba.ca  Fri Sep 26 09:44:35 2008
From: mills at cc.umanitoba.ca (Gary Mills)
Date: Fri, 26 Sep 2008 08:44:35 -0500
Subject: Pause while selecting INBOX
Message-ID: <20080926134435.GA18147@cc.umanitoba.ca>

We have a moderately sized Cyrus installation with 2 TB of storage
and a few thousand simultaneous IMAP sessions.  When one of the
backup processes is running during the day, there's a noticable
slowdown in IMAP client performance.  When I start my `mutt' mail
reader, it pauses for several seconds at `Selecting INBOX'.  That
behavior disappears when the backup finishes.

Where's the first place to look for this problem?  I/O statistics
show a higher read bandwidth while the backup is running, but writes
still dominate.  The backup would typically read all of the files in
a single Cyrus partition.

-- 
-Gary Mills-    -Unix Support-    -U of M Academic Computing and Networking-

From rob at nofocus.org  Fri Sep 26 12:19:25 2008
From: rob at nofocus.org (Rob Banz)
Date: Fri, 26 Sep 2008 09:19:25 -0700
Subject: Pause while selecting INBOX
In-Reply-To: <20080926134435.GA18147@cc.umanitoba.ca>
References: <20080926134435.GA18147@cc.umanitoba.ca>
Message-ID: <DBF0530C-DE99-4AC8-9EA5-8D2840DD4548@nofocus.org>


On Sep 26, 2008, at 06:44, Gary Mills wrote:

> We have a moderately sized Cyrus installation with 2 TB of storage
> and a few thousand simultaneous IMAP sessions.  When one of the
> backup processes is running during the day, there's a noticable
> slowdown in IMAP client performance.  When I start my `mutt' mail
> reader, it pauses for several seconds at `Selecting INBOX'.  That
> behavior disappears when the backup finishes.
>
> Where's the first place to look for this problem?  I/O statistics
> show a higher read bandwidth while the backup is running, but writes
> still dominate.  The backup would typically read all of the files in
> a single Cyrus partition.

As always, the answer is probably complicated.

What's your storage backend look like? Some sort of RAID with cache?  
The backup is very probably blowing out your cache while running,  
which can manifest itself in ways that will make it look like the  
performance profile of your storage has taken on a different  
personality. Especially with respect to writes, since you might  
usually be blessed with an abundance of write-back cache that's now  
fighting with all the reads for the backup. Do you have your cyrus  
partitions mounted with noatime? Your backups could be causing fs  
write operations that you really don't want.

-rob

From wes at umich.edu  Fri Sep 26 13:37:30 2008
From: wes at umich.edu (Wesley Craig)
Date: Fri, 26 Sep 2008 13:37:30 -0400
Subject: Pause while selecting INBOX
In-Reply-To: <20080926134435.GA18147@cc.umanitoba.ca>
References: <20080926134435.GA18147@cc.umanitoba.ca>
Message-ID: <9BA2D740-EABA-4F69-B278-BFB7679F5848@umich.edu>

I'd probably use imtest to connect, get the PID of the server process  
that I'm connected to, and then attach to that process with ktrace  
(or whatever) with timestamps enabled.  Then I'd select the mailbox  
-- this is assuming that mutt is only issuing a select when it says  
"Selecting INBOX".  Obviously it could be doing any number of  
things.  You can get positive confirmation of which command is taking  
a long time by enabling telemetry, of course.

That will tell you what kind of operation is blocking, FWIW.  What  
you do thereafter really depends on what you find.

:wes

On 26 Sep 2008, at 09:44, Gary Mills wrote:
> We have a moderately sized Cyrus installation with 2 TB of storage
> and a few thousand simultaneous IMAP sessions.  When one of the
> backup processes is running during the day, there's a noticable
> slowdown in IMAP client performance.  When I start my `mutt' mail
> reader, it pauses for several seconds at `Selecting INBOX'.  That
> behavior disappears when the backup finishes.
>
> Where's the first place to look for this problem?  I/O statistics
> show a higher read bandwidth while the backup is running, but writes
> still dominate.  The backup would typically read all of the files in
> a single Cyrus partition.

From stovenator at gmail.com  Fri Sep 26 14:14:22 2008
From: stovenator at gmail.com (Mark Stover)
Date: Fri, 26 Sep 2008 13:14:22 -0500
Subject: IMAP Date-Time format for Append
Message-ID: <48c67cb80809261114p59012e6ci72e0b6b674fdc93@mail.gmail.com>

Hello,

We are running Cyrus IMAP 2.3.7 from the Centos RPM cyrus-imapd-2.3.7-2.el5
. We are doing some testing with a client that is sending an APPEND command
with the format:

APPEND "user.testuser.Folder" () "Thu, 13 Mar 2008 08:13:13 GMT" {358}

The response from the Cyrus IMAP server is:

BAD Invalid date-time in Append command

We're pretty sure this is related to the timezone being represented as a
short name, as opposed to in numeric format (+0400, etc.). The IMAP spec is
vague on whether or not this format should be accepted. I believe that this
has to do with the way the function from the C Library converts the string,
but am not sure.

Is this a function of this RPM version? Is the client out of spec with the
RFC? Could recompiling this from source with a different C Library fix this?

Any thoughts would be appreciated.

Thanks,
Mark
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080926/606a2396/attachment.html 

From robm at fastmail.fm  Fri Sep 26 23:40:47 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Sat, 27 Sep 2008 13:40:47 +1000
Subject: IMAP Date-Time format for Append
References: <48c67cb80809261114p59012e6ci72e0b6b674fdc93@mail.gmail.com>
Message-ID: <C903AAA0002848998334C6C6973714F7@robmhp>


  We're pretty sure this is related to the timezone being represented as a short name, as opposed to in numeric format (+0400, etc.). The IMAP spec is vague on whether or not this format should be accepted. I believe that this has to do with the way the function from the C Library converts the string, but am not sure. 
The spec isn't vague at all:

http://www.faqs.org/rfcs/rfc3501.html
append          = "APPEND" SP mailbox [SP flag-list] [SP date-time] SP
                  literal
date-time       = DQUOTE date-day-fixed "-" date-month "-" date-year
                  SP time SP zone DQUOTE
zone            = ("+" / "-") 4DIGIT
                    ; Signed four-digit value of hhmm representing
                    ; hours and minutes east of Greenwich (that is,
                    ; the amount that the given time differs from
                    ; Universal Time).  Subtracting the timezone
                    ; from the given time will give the UT form.
                    ; The Universal Time zone is "+0000".
 Seems pretty clear that what the client is doing is broken. Having said that, the parsing code is in cyrus, so changing the C library won't help. You'll need to dig into the cyrus source.Rob
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080927/4c023bf5/attachment.html 

From robm at fastmail.fm  Fri Sep 26 23:46:39 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Sat, 27 Sep 2008 13:46:39 +1000
Subject: Pause while selecting INBOX
References: <20080926134435.GA18147@cc.umanitoba.ca>
Message-ID: <079B6132B99347959A6E285DB47AF957@robmhp>


> We have a moderately sized Cyrus installation with 2 TB of storage
> and a few thousand simultaneous IMAP sessions.  When one of the
> backup processes is running during the day, there's a noticable
> slowdown in IMAP client performance.  When I start my `mutt' mail
> reader, it pauses for several seconds at `Selecting INBOX'.  That
> behavior disappears when the backup finishes.
>
> Where's the first place to look for this problem?  I/O statistics
> show a higher read bandwidth while the backup is running, but writes
> still dominate.  The backup would typically read all of the files in
> a single Cyrus partition.

Some more information about your setup would be helpful.

1. What OS? 32 or 64bit?
2. How much RAM do you have? How much is used by cache?
3. What sort of drive system is the data stored on?
4. Do you have split data/meta data?
5. What filesystem are you using?
6. What mount options to you have on your volumnes?
7. What IO scheduler are you using?
8. What version of cyrus are you using?
9. Do you have the cyrus status cache enabled?

Some things to try if you haven't:

1. Make sure you have noatime (and nodiratime if applicable) set on your FS
2. If on linux, use the deadline IO scheduler
3. If you can, split your data and meta data onto separate volumes (probably 
a lot of work)
4. Install more RAM and use a 64-bit OS. x64_64 linux can cache many, many 
more inodes and dentries in memory than x86 linux.
5. Upgrade to the latest cyrus and enable the status cache

Rob


From brong at fastmail.fm  Sat Sep 27 19:42:27 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Sun, 28 Sep 2008 09:42:27 +1000
Subject: Pause while selecting INBOX
In-Reply-To: <079B6132B99347959A6E285DB47AF957@robmhp>
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<079B6132B99347959A6E285DB47AF957@robmhp>
Message-ID: <1222558947.13579.1276319021@webmail.messagingengine.com>


On Sat, 27 Sep 2008 13:46:39 +1000, "Rob Mueller" <robm at fastmail.fm> said:
> Some things to try if you haven't:
> 
> 1. Make sure you have noatime (and nodiratime if applicable) set on your
> FS
> 2. If on linux, use the deadline IO scheduler
> 3. If you can, split your data and meta data onto separate volumes
> (probably 
> a lot of work)
> 4. Install more RAM and use a 64-bit OS. x64_64 linux can cache many,
> many 
> more inodes and dentries in memory than x86 linux.
> 5. Upgrade to the latest cyrus and enable the status cache

6. Don't fetch every single file from your cyrus server every backup run.

One nice property of cyrus's on-disk format is that all the data files
are immutable once created: b/user/brong/798. is always going to be the
same file, no matter what happens to the mailbox.  Only the cyrus.*
files and new data file actually need to be fetched.

(our system also stats the cyrus.* files, and uses some other funky tricks
to ensure consistent backups with minimum IO) 
-- 
  Bron Gondwana
  brong at fastmail.fm


From mills at cc.umanitoba.ca  Sat Sep 27 20:32:42 2008
From: mills at cc.umanitoba.ca (Gary Mills)
Date: Sat, 27 Sep 2008 19:32:42 -0500
Subject: Pause while selecting INBOX
In-Reply-To: <DBF0530C-DE99-4AC8-9EA5-8D2840DD4548@nofocus.org>
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<DBF0530C-DE99-4AC8-9EA5-8D2840DD4548@nofocus.org>
Message-ID: <20080928003242.GB1960@cc.umanitoba.ca>

On Fri, Sep 26, 2008 at 09:19:25AM -0700, Rob Banz wrote:
> 
> On Sep 26, 2008, at 06:44, Gary Mills wrote:
> 
> >We have a moderately sized Cyrus installation with 2 TB of storage
> >and a few thousand simultaneous IMAP sessions.  When one of the
> >backup processes is running during the day, there's a noticable
> >slowdown in IMAP client performance.  When I start my `mutt' mail
> >reader, it pauses for several seconds at `Selecting INBOX'.  That
> >behavior disappears when the backup finishes.
> 
> As always, the answer is probably complicated.

Of course.  I just wanted to know what the usual suspects might be.

> What's your storage backend look like? Some sort of RAID with cache?  
> The backup is very probably blowing out your cache while running,  
> which can manifest itself in ways that will make it look like the  
> performance profile of your storage has taken on a different  
> personality. Especially with respect to writes, since you might  
> usually be blessed with an abundance of write-back cache that's now  
> fighting with all the reads for the backup. Do you have your cyrus  
> partitions mounted with noatime? Your backups could be causing fs  
> write operations that you really don't want.

Our storage backend is four Iscsi LUNs from our Netapp filer.  It will
indeed be RAID with cache.  Yes, the backup certainly would run the
cache, and that may well be the problem.  There will also be a large
memory cache on the IMAP server.  That could be upset as well.  I'll
see if I can find some cache statistics for both places.

`noatime' is also certainly a good idea.  I haven't yet tried it.

-- 
-Gary Mills-    -Unix Support-    -U of M Academic Computing and Networking-

From mills at cc.umanitoba.ca  Sat Sep 27 20:35:04 2008
From: mills at cc.umanitoba.ca (Gary Mills)
Date: Sat, 27 Sep 2008 19:35:04 -0500
Subject: Pause while selecting INBOX
In-Reply-To: <9BA2D740-EABA-4F69-B278-BFB7679F5848@umich.edu>
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<9BA2D740-EABA-4F69-B278-BFB7679F5848@umich.edu>
Message-ID: <20080928003504.GC1960@cc.umanitoba.ca>

On Fri, Sep 26, 2008 at 01:37:30PM -0400, Wesley Craig wrote:
> I'd probably use imtest to connect, get the PID of the server process  
> that I'm connected to, and then attach to that process with ktrace  
> (or whatever) with timestamps enabled.  Then I'd select the mailbox  
> -- this is assuming that mutt is only issuing a select when it says  
> "Selecting INBOX".  Obviously it could be doing any number of  
> things.  You can get positive confirmation of which command is taking  
> a long time by enabling telemetry, of course.

Thanks for the suggestions.  I believe I'll start with the telemetry,
to get an idea what mutt is doing when it pauses.

-- 
-Gary Mills-    -Unix Support-    -U of M Academic Computing and Networking-

From mills at cc.umanitoba.ca  Sat Sep 27 20:39:43 2008
From: mills at cc.umanitoba.ca (Gary Mills)
Date: Sat, 27 Sep 2008 19:39:43 -0500
Subject: Pause while selecting INBOX
In-Reply-To: <079B6132B99347959A6E285DB47AF957@robmhp>
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<079B6132B99347959A6E285DB47AF957@robmhp>
Message-ID: <20080928003943.GD1960@cc.umanitoba.ca>

On Sat, Sep 27, 2008 at 01:46:39PM +1000, Rob Mueller wrote:
> 
> >
> >Where's the first place to look for this problem?  I/O statistics
> >show a higher read bandwidth while the backup is running, but writes
> >still dominate.  The backup would typically read all of the files in
> >a single Cyrus partition.
> 
> Some more information about your setup would be helpful.

I deliberately omitted that information, hoping that somebody would
know what happens on the server side when mutt says `selecting INBOX'.
I don't want to redesign the server at this stage, at least not until
I've isolated the problem.

> 1. Make sure you have noatime (and nodiratime if applicable) set on your FS
> 2. If on linux, use the deadline IO scheduler
> 3. If you can, split your data and meta data onto separate volumes 
> (probably a lot of work)
> 4. Install more RAM and use a 64-bit OS. x64_64 linux can cache many, many 
> more inodes and dentries in memory than x86 linux.
> 5. Upgrade to the latest cyrus and enable the status cache

Those are all good suggestions.  I'll investigate some of them.

-- 
-Gary Mills-    -Unix Support-    -U of M Academic Computing and Networking-

From mills at cc.umanitoba.ca  Sat Sep 27 20:50:00 2008
From: mills at cc.umanitoba.ca (Gary Mills)
Date: Sat, 27 Sep 2008 19:50:00 -0500
Subject: Pause while selecting INBOX
In-Reply-To: <1222558947.13579.1276319021@webmail.messagingengine.com>
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<079B6132B99347959A6E285DB47AF957@robmhp>
	<1222558947.13579.1276319021@webmail.messagingengine.com>
Message-ID: <20080928005000.GE1960@cc.umanitoba.ca>

On Sun, Sep 28, 2008 at 09:42:27AM +1000, Bron Gondwana wrote:
> 
> On Sat, 27 Sep 2008 13:46:39 +1000, "Rob Mueller" <robm at fastmail.fm> said:
> > Some things to try if you haven't:
> 
> 6. Don't fetch every single file from your cyrus server every backup run.
> 
> One nice property of cyrus's on-disk format is that all the data files
> are immutable once created: b/user/brong/798. is always going to be the
> same file, no matter what happens to the mailbox.  Only the cyrus.*
> files and new data file actually need to be fetched.
> 
> (our system also stats the cyrus.* files, and uses some other funky tricks
> to ensure consistent backups with minimum IO) 

Most of our restores are done from ZFS snapshots.  We keep two weeks
of them.  That's worked out extremely well.  We use Networker with
tapes for longer-term backups.  It's that that seems to cause the
problem.

Certainly our Networker backup system has no knowledge of the structure
and properties of the Cyrus IMAP spool.  It would just read every file
for a full backup, or look at timestamps for an incremental backup.
I don't know if much can be changed in the way it operates.  However,
we may be able to change the way it takes backups if contention is
really the problem.  I'm not convinced that it is just now.

-- 
-Gary Mills-    -Unix Support-    -U of M Academic Computing and Networking-

From robm at fastmail.fm  Sun Sep 28 03:28:43 2008
From: robm at fastmail.fm (Rob Mueller)
Date: Sun, 28 Sep 2008 17:28:43 +1000
Subject: Pause while selecting INBOX
References: <20080926134435.GA18147@cc.umanitoba.ca>
	<9BA2D740-EABA-4F69-B278-BFB7679F5848@umich.edu>
Message-ID: <FADADBAA606F499983F1EDB6F92FABDF@robmhp>


> I'd probably use imtest to connect, get the PID of the server process
> that I'm connected to, and then attach to that process with ktrace
> (or whatever) with timestamps enabled.  Then I'd select the mailbox
> -- this is assuming that mutt is only issuing a select when it says
> "Selecting INBOX".  Obviously it could be doing any number of
> things.  You can get positive confirmation of which command is taking
> a long time by enabling telemetry, of course.

Using ktrace/strace may not actually be that helpful. cyrus read accesses 
most files via mmaped memory. The problem is that opening a file + mmaping 
it might be quick, but then when the process does a memory access to the 
mmapped region, the whole process is "put to sleep" waiting on the 
underlying page fault to finish doing the IO. That doesn't show up in 
strace/ktrace because it's just a memory access, not a system call.

In general, tracing where IO bottlenecks are occuring can be quite tricky.

Rob


From mark.cave-ayland at siriusit.co.uk  Mon Sep 29 07:37:12 2008
From: mark.cave-ayland at siriusit.co.uk (Mark Cave-Ayland)
Date: Mon, 29 Sep 2008 12:37:12 +0100
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
Message-ID: <48E0BDE8.7000505@siriusit.co.uk>

Hi there,

I'm experiencing a problem with Cyrus 2.3.8 interacting with an Outlook 
client and was hoping this would be the right place to get some advice.

What happens is that periodically (maybe around once a month?) we have 
one particular user who contacts us complaining that they are unable 
access their mailbox. Generally we always find the same thing: there is 
an imapd process accessing his seen DB which is running at 100% CPU. 
Once this process is killed then things go back to normal and the user 
can log in.

The latest report we had of this problem happening again was this 
morning, and fortunately I was in a position to attack it with gdb and a 
file of debug symbols. This showed that the process in question was 
getting stuck in a loop in index_expungeuidlist(). I've uploaded the 
transcript of my gdb session to 
http://pastebin.siriusit.co.uk/cyrus-imapd-gdb.txt for people who are 
familiar with cyrus internals.

The short story appears to be that newseenuids (new) points to an empty 
string ('\0') and so the code gets stuck because of the following at 
line 532 of imap/index.c in index_checkseen():

oldseen = (*old == ':');

Since *old is an empty string, oldseen will always be 0, and so the 
while() loop never exits. Unfortunately this is the first time I've ever 
looked at cyrus internals, so am not really sure what the seen list 
should look like normally.

The confusing thing is that we have been using these packages for 
several clients and this is the *only* particular server and the *only* 
user on this server experiencing this problem. The one thing we have 
noticed is that this particular user has a larger mailbox compared to 
the other users (~1GB) but then it doesn't seem so large as if it would 
cause any problems.

Finally, one more thing to add is that we have already gone through the 
steps of rebuilding the seen DB skiplist using the skiplist.py script 
several times when this has happened in the past, and it has made no 
difference.


Many thanks,

Mark.

-- 
Mark Cave-Ayland
Sirius Corporation - The Open Source Experts
http://www.siriusit.co.uk
T: +44 870 608 0063

From brong at fastmail.fm  Mon Sep 29 08:41:31 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Mon, 29 Sep 2008 22:41:31 +1000
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <48E0BDE8.7000505@siriusit.co.uk>
References: <48E0BDE8.7000505@siriusit.co.uk>
Message-ID: <20080929124131.GB7691@brong.net>

On Mon, Sep 29, 2008 at 12:37:12PM +0100, Mark Cave-Ayland wrote:
> Hi there,
> 
> I'm experiencing a problem with Cyrus 2.3.8 interacting with an Outlook 
> client and was hoping this would be the right place to get some advice.
> 
> What happens is that periodically (maybe around once a month?) we have 
> one particular user who contacts us complaining that they are unable 
> access their mailbox. Generally we always find the same thing: there is 
> an imapd process accessing his seen DB which is running at 100% CPU. 
> Once this process is killed then things go back to normal and the user 
> can log in.
> 
> The latest report we had of this problem happening again was this 
> morning, and fortunately I was in a position to attack it with gdb and a 
> file of debug symbols. This showed that the process in question was 
> getting stuck in a loop in index_expungeuidlist(). I've uploaded the 
> transcript of my gdb session to 
> http://pastebin.siriusit.co.uk/cyrus-imapd-gdb.txt for people who are 
> familiar with cyrus internals.
> 
> The short story appears to be that newseenuids (new) points to an empty 
> string ('\0') and so the code gets stuck because of the following at 
> line 532 of imap/index.c in index_checkseen():
> 
> oldseen = (*old == ':');

oldseen = 0;
 
> Since *old is an empty string, oldseen will always be 0, and so the 
> while() loop never exits. Unfortunately this is the first time I've ever 
> looked at cyrus internals, so am not really sure what the seen list 
> should look like normally.

No, BUT.

while (oldnext <= uid) {
  ...
  if (!*old) oldnext = mailbox->last_uid+1;
}

if your mailbox is corrupted such that last_uid is less than
an actual uid in the mailbox, then you will get an infinite
loop here.

> The confusing thing is that we have been using these packages for 
> several clients and this is the *only* particular server and the *only* 
> user on this server experiencing this problem. The one thing we have 
> noticed is that this particular user has a larger mailbox compared to 
> the other users (~1GB) but then it doesn't seem so large as if it would 
> cause any problems.

Yeah, it's a corrupted mailbox.
 
> Finally, one more thing to add is that we have already gone through the 
> steps of rebuilding the seen DB skiplist using the skiplist.py script 
> several times when this has happened in the past, and it has made no 
> difference.

No, it won't.  You need to fix the mailbox or patch the code to not be
put into an infinite loop by a bogus index file.

The attached patch might do the trick for you.  I just slapped it
together on spec.  It compiles, that's about all I can offer about
it :)

Bron ( and no, I can't spell.  Tough ;) )
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cyrus-inifiniteloop-2.3.12.diff
Type: text/x-diff
Size: 911 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080929/f1fa6cd4/attachment.bin 

From Duncan.Gibb at SiriusIT.co.uk  Mon Sep 29 09:41:29 2008
From: Duncan.Gibb at SiriusIT.co.uk (Duncan Gibb)
Date: Mon, 29 Sep 2008 14:41:29 +0100
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <48E0CF07.2090205@siriusit.co.uk>
References: <48E0CF07.2090205@siriusit.co.uk>
Message-ID: <48E0DB09.2050808@SiriusIT.co.uk>

> From: Bron Gondwana <brong at fastmail.fm>
> Date: Mon, 29 Sep 2008 22:41:31 +1000

BG> if your mailbox is corrupted such that last_uid is less than
BG> an actual uid in the mailbox, then you will get an infinite
BG> loop here.

BG> it's a corrupted mailbox [..] a bogus index file.

Thanks for your suggestion.  Armed with that detail we tracked it down
to a broken index file for one of the user's subfolders, in which a
number of records had been overwritten with ASCII junk that looks like
mailbox contents.

/How/ that happened remains an open question, but a quick reconstruct
has hopefully prevented the busy-loop problem recurring in this case.

I might put your patch in the next round of packages we build...


Cheers


Duncan

-- 
Duncan Gibb, Technical Director
Sirius Corporation plc - The Open Source Experts
http://www.siriusit.co.uk/
Tel: +44 870 608 0063 || +44 7977 441 515

From mark.cave-ayland at siriusit.co.uk  Mon Sep 29 09:47:04 2008
From: mark.cave-ayland at siriusit.co.uk (Mark Cave-Ayland)
Date: Mon, 29 Sep 2008 14:47:04 +0100
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <20080929124131.GB7691@brong.net>
References: <48E0BDE8.7000505@siriusit.co.uk> <20080929124131.GB7691@brong.net>
Message-ID: <48E0DC58.5070007@siriusit.co.uk>

Bron Gondwana wrote:

> No, it won't.  You need to fix the mailbox or patch the code to not be
> put into an infinite loop by a bogus index file.
> 
> The attached patch might do the trick for you.  I just slapped it
> together on spec.  It compiles, that's about all I can offer about
> it :)

Hi Bron,

Thanks for taking the time to respond, it is greatly appreciated. My 
colleague Duncan has taken a look at this (see separate email) and found 
  a corrupted index file which have now been rebuilt. Fingers crossed 
that the problem is now resolved (I guess we'll find out in a month or 
so) ;)


Many thanks,

Mark.

-- 
Mark Cave-Ayland
Sirius Corporation - The Open Source Experts
http://www.siriusit.co.uk
T: +44 870 608 0063

From brong at fastmail.fm  Tue Sep 30 00:14:15 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Tue, 30 Sep 2008 14:14:15 +1000
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <48E0DC58.5070007@siriusit.co.uk>
References: <48E0BDE8.7000505@siriusit.co.uk> <20080929124131.GB7691@brong.net>
	<48E0DC58.5070007@siriusit.co.uk>
Message-ID: <1222748055.17857.1276669799@webmail.messagingengine.com>


On Mon, 29 Sep 2008 14:47:04 +0100, "Mark Cave-Ayland" <mark.cave-ayland at siriusit.co.uk> said:
> Bron Gondwana wrote:
> 
> > No, it won't.  You need to fix the mailbox or patch the code to not be
> > put into an infinite loop by a bogus index file.
> > 
> > The attached patch might do the trick for you.  I just slapped it
> > together on spec.  It compiles, that's about all I can offer about
> > it :)
> 
> Hi Bron,
> 
> Thanks for taking the time to respond, it is greatly appreciated. My 
> colleague Duncan has taken a look at this (see separate email) and found 
>   a corrupted index file which have now been rebuilt. Fingers crossed 
> that the problem is now resolved (I guess we'll find out in a month or 
> so) ;)

No problem, I've spent a while digging around inside the index code,
so I have pretty good idea of where the hairy bits are.  I started
work a while back on CRC32 checksums for individual index records.
Unfortunately, due to the direct memory access pattern used, it would
either be a massive CPU hit (re-calculate the CRC32 for every field
access) or a memory hit to parse the record into an object each time.

Actually, the memory hit isn't that bad (you're generally looking at
one record at a time), but there are a LOT of bits of code that access
the index records directly.

So I went the easy route of just not crashing.  I'm tempted to rework
that patch with a syslog call so you can know which mailbox needs a
reconstruct and then push it upstream.

Bron.
-- 
  Bron Gondwana
  brong at fastmail.fm


From Duncan.Gibb at SiriusIT.co.uk  Tue Sep 30 04:39:27 2008
From: Duncan.Gibb at SiriusIT.co.uk (Duncan Gibb)
Date: Tue, 30 Sep 2008 09:39:27 +0100
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <1222748055.17857.1276669799@webmail.messagingengine.com>
References: <48E0BDE8.7000505@siriusit.co.uk>
	<20080929124131.GB7691@brong.net>	<48E0DC58.5070007@siriusit.co.uk>
	<1222748055.17857.1276669799@webmail.messagingengine.com>
Message-ID: <48E1E5BF.9030701@SiriusIT.co.uk>

Bron Gondwana wrote:

BG> I'm tempted to rework that patch with a syslog call so
BG> you can know which mailbox needs a reconstruct and then
BG> push it upstream.

I had the same thought.  You're ahead of me ;-)


Cheers


Duncan

-- 
Duncan Gibb, Technical Director
Sirius Corporation plc - The Open Source Experts
http://www.siriusit.co.uk/
Tel: +44 870 608 0063 || +44 7977 441 515

From mathieu.kretchner at sophia.inria.fr  Tue Sep 30 04:58:37 2008
From: mathieu.kretchner at sophia.inria.fr (Mathieu Kretchner)
Date: Tue, 30 Sep 2008 10:58:37 +0200
Subject: Loadtesting Imap
In-Reply-To: <972950.78066.qm@web33203.mail.mud.yahoo.com>
References: <972950.78066.qm@web33203.mail.mud.yahoo.com>
Message-ID: <48E1EA3D.3080304@sophia.inria.fr>

imaptest ?

http://www.imapwiki.org/ImapTest

faris a ?crit :
> Dear All,
>  
> Please tell me which is the best way to benchmark/loadtest 200K
> useraccounts to see the maximum performance ?
> Regards,
> Faris
>  
> 
> 
> 
> ------------------------------------------------------------------------
> 
> ----
> Cyrus Home Page: http://cyrusimap.web.cmu.edu/
> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
-------------- next part --------------
A non-text attachment was scrubbed...
Name: mathieu_kretchner.vcf
Type: text/x-vcard
Size: 258 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080930/7644ab45/attachment.vcf 

From brong at fastmail.fm  Tue Sep 30 07:59:37 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Tue, 30 Sep 2008 21:59:37 +1000
Subject: Cyrus 2.3.8 imapd process periodically sticks at 100% CPU
In-Reply-To: <48E0BDE8.7000505@siriusit.co.uk>
References: <48E0BDE8.7000505@siriusit.co.uk>
Message-ID: <20080930115937.GA16859@brong.net>

On Mon, Sep 29, 2008 at 12:37:12PM +0100, Mark Cave-Ayland wrote:
> What happens is that periodically (maybe around once a month?) we have 
> one particular user who contacts us complaining that they are unable 
> access their mailbox. Generally we always find the same thing: there is 
> an imapd process accessing his seen DB which is running at 100% CPU. 
> Once this process is killed then things go back to normal and the user 
> can log in.

The following patch fixes your issue and has the syslog line added as
well.

https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3088

Ken, Wes - I think this is a candidate for 2.3.13 since we haven't
released yet.  It's trivial, and infinite loops are bad!

Regards,

Bron ( also attaching the patch with this email )
-------------- next part --------------
A non-text attachment was scrubbed...
Name: cyrus-inifiniteloop-2.3.12.diff
Type: text/x-diff
Size: 1380 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20080930/b71c7630/attachment.bin 

From simon.matter at invoca.ch  Tue Sep 30 09:04:08 2008
From: simon.matter at invoca.ch (Simon Matter)
Date: Tue, 30 Sep 2008 15:04:08 +0200 (CEST)
Subject: New cyrus-imapd rpms with multi-instance support
Message-ID: <ccf47e8f7e6584bae10fa2c271b6504c.squirrel@webmail.bi.corp.invoca.ch>

I've got a number of requests and patches recently to add multi-instance
support to the Invoca cyrus-imapd rpms. What those implementations didn't
address are the rpm specific aspects of multi-instance handling, like
restarting instances on package update and whatever else.
I ended up with my own implementation which tries to integrate well with
the rpm mechanisms while maintaining compatibility with older releases.
There are two new commands in the distribution, 'add_instance' and
'del_instance', requiring only the instance name as parameter. Instance
name '' is the main instance. To add an instance '2' do

/usr/lib/cyrus-imapd/add_instance 2

edit /etc/imapd2.conf and /etc/cyrus2.conf to fit your needs and start with

service cyrus-imapd2 start

To delete instance '2', do

/usr/lib/cyrus-imapd/del_instance 2

Note: The script will just do what you said - without asking you anything!
      Use with care!

The source rpm is as always here
http://www.invoca.ch/pub/packages/cyrus-imapd/

Since the new feature required a lot of changes I'm very interested to get
feedback on how it works. That's the reason for announcing it here (I
usually don't do that for rpm specific things).

Simon


From nic at onlight.com  Tue Sep 30 09:31:17 2008
From: nic at onlight.com (Nic Bernstein)
Date: Tue, 30 Sep 2008 08:31:17 -0500
Subject: Problems with frontend to backend authentication in murder 2.3.12
Message-ID: <48E22A25.5000009@onlight.com>

Greetings list,
I would like to start out by thanking all of the developers for a truly 
great bundle of software.  I have been using Cyrus IMAP for over a 
decade and think it one of the best packages of software around.

I have recently had occasion to put together a murder, and thought to 
start out with a simple "standard" configuration with a mupdate master, 
"postman," a backend, "mail.wi" and a frontend, "imap.wi."  The problem 
I am having is one which I see frequently mentioned on the list, but the 
solution has evaded me; frontend authentication. 

Here are the details:
    * LDAP authentication via saslauthd
    * Linux (Fedora 6 and 8) with Invoca (2.3.12p2-1) rpms

There is no problem with mailboxes.db propagation from backend to master 
to frontend -- that is fine.  The problems come when trying to access 
mailboxes using the frontend.  Here are configuration files (trimmed):

backend "mail.wi" imapd.conf:
---------------------------------------------------
admins: cyrus cyradmin
sasl_pwcheck_method: saslauthd
sasl_mech_list: PLAIN PLAIN+TLS
servername: mail.wi
mupdate_admins: murder
mupdate_server: postman
mupdate_username: becyradmin
mupdate_authname: becyradmin
mupdate_password: password
mupdate_config: standard
allowusermoves: true
proxyservers: murder
proxy_authname: murder
proxy_password: password
tls_cert_file: /etc/pki/cyrus-imapd/mail.wi.crt
tls_key_file: /etc/pki/cyrus-imapd/mail.wi.key
tls_ca_file: /etc/pki/cyrus-imapd/ca.crt
-----------------------------------------------------

Here is the frontend "imap.wi" imapd.conf:
-----------------------------------------------------
admins: cyrus cyradmin
sasl_pwcheck_method: saslauthd
sasl_mech_list: PLAIN PLAIN+TLS
servername: imap.wi.occinc.com
mupdate_server: postman
mupdate_username: fecyradmin
mupdate_authname: fecyradmin
mupdate_password: password
mupdate_config: standard
allowusermoves: true
proxy_authname: murder
mail_wi_password: password
mail_wi_mechs: PLAIN+TLS
imap_tls_cert_file: /etc/pki/cyrus-imapd/imap.wi.pem
imap_tls_key_file: /etc/pki/cyrus-imapd/imap.wi.pem
tls_ca_file: /etc/pki/cyrus-imapd/imap.wi.pem
-----------------------------------------------------

I am able to authenticate from imap.wi to mail.wi via imtest with 
START_TLS, thusly:

-----------------------------------------------------
# imtest -t "" -m PLAIN -u onlight -a murder mail.wi
S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ STARTTLS AUTH=PLAIN SASL-IR] mail.wi Cyrus 
IMAP Murder v2.3.12p2-Invoca-RPM-2.3.12p2-1 server ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
STARTTLS AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS 
NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY 
SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
C: S01 STARTTLS
S: S01 OK Begin TLS negotiation now
verify error:num=19:self signed certificate in certificate chain
TLS connection established: TLSv1 with cipher DHE-RSA-AES256-SHA 
(256/256 bits)
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE 
UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT 
SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
Please enter your password:
C: A01 AUTHENTICATE PLAIN b25saWdodABtdXJkZXIARWltOFVpdGg=
S: A01 OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ LOGINDISABLED ACL RIGHTS=kxte QUOTA 
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN 
MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT 
THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE LISTEXT 
LIST-SUBSCRIBED X-NETSCAPE URLAUTH] Success (tls protection)
Authenticated.
Security strength factor: 256
. select inbox
* FLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk)
* OK [PERMANENTFLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk 
\*)] 
* 20 EXISTS
* 0 RECENT
* OK [UNSEEN 15] 
* OK [UIDVALIDITY 1112292825] 
* OK [UIDNEXT 90] 
* OK [NOMODSEQ] Sorry, modsequences have not been enabled on this mailbox
* OK [URLMECH INTERNAL]
. OK [READ-WRITE] Completed
. logout
* BYE LOGOUT received
. OK Completed
Connection closed.
-----------------------------------------------------
The successful login is recorded thusly in the logs on mail.wi:
-----------------------------------------------------
Sep 30 08:16:23 localhost imap[19059]: accepted connection
Sep 30 08:16:23 localhost master[19759]: about to exec 
/usr/lib/cyrus-imapd/imapd
Sep 30 08:16:23 localhost imap[19759]: executed
Sep 30 08:16:23 localhost imap[19059]: imapd:Loading hard-coded DH 
parameters
Sep 30 08:16:23 localhost imap[19059]: SSL_accept() incomplete -> wait
Sep 30 08:16:23 localhost imap[19059]: SSL_accept() succeeded -> done
Sep 30 08:16:23 localhost imap[19059]: starttls: TLSv1 with cipher 
DHE-RSA-AES256-SHA (256/256 bits new) no authentication
Sep 30 08:16:28 localhost imap[19059]: login: imap.wi [192.168.190.226] 
onlight PLAIN+TLS User logged in
Sep 30 08:16:36 localhost imap[19059]: skiplist: recovered 
/var/lib/imap/user/o/onlight.seen (2 records, 15316 bytes) in 0 seconds
Sep 30 08:16:36 localhost imap[19059]: seen_db: user onlight opened 
/var/lib/imap/user/o/onlight.seen
Sep 30 08:16:36 localhost imap[19059]: open: user onlight opened inbox
Sep 30 08:18:10 localhost master[19037]: process 19059 exited, status 0
-----------------------------------------------------

But, when I try the same, as the actual user, via imap.wi, I am unable 
to select the inbox:
-----------------------------------------------------
# imtest -t "" -m PLAIN -u onlight -a onlight imap.wi
S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ STARTTLS AUTH=PLAIN SASL-IR] imap.wi Cyrus 
IMAP Murder v2.3.12p2-Invoca-RPM-2.3.12p2-1 server ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
STARTTLS AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS 
NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY 
SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
C: S01 STARTTLS
S: S01 OK Begin TLS negotiation now
verify error:num=18:self signed certificate
TLS connection established: TLSv1 with cipher DHE-RSA-AES256-SHA 
(256/256 bits)
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE 
UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT 
SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
Please enter your password:
C: A01 AUTHENTICATE PLAIN b25saWdodABvbmxpZ2h0AG9od2ViNG9G
S: A01 OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ LOGINDISABLED ACL RIGHTS=kxte QUOTA 
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN 
MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT 
THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE LISTEXT 
LIST-SUBSCRIBED X-NETSCAPE URLAUTH] Success (tls protection)
Authenticated.
Security strength factor: 256
. select inbox
. NO Server(s) unavailable to complete operation
. logout
* BYE LOGOUT received
. OK Completed
Connection closed.
-----------------------------------------------------

Again, the log output from mail.wi:
-----------------------------------------------------
Sep 30 08:20:34 localhost imap[19052]: accepted connection
Sep 30 08:20:34 localhost master[19762]: about to exec 
/usr/lib/cyrus-imapd/imapd
Sep 30 08:20:34 localhost imap[19762]: executed
Sep 30 08:20:34 localhost imap[19052]: imapd:Loading hard-coded DH 
parameters
Sep 30 08:20:34 localhost imap[19052]: SSL_accept() incomplete -> wait
Sep 30 08:20:34 localhost imap[19052]: SSL_accept() succeeded -> done
Sep 30 08:20:34 localhost imap[19052]: starttls: TLSv1 with cipher 
DHE-RSA-AES256-SHA (256/256 bits new) no authentication
Sep 30 08:21:51 localhost master[19037]: process 19052 exited, status 0
-----------------------------------------------------

And from imap.wi:
-----------------------------------------------------
Sep 30 08:21:57 inside2 imap[17661]: accepted connection
Sep 30 08:21:57 inside2 master[27691]: about to exec 
/usr/lib/cyrus-imapd/proxyd
Sep 30 08:21:57 inside2 imap[27691]: executed
Sep 30 08:21:58 inside2 imap[17661]: imapd:Loading hard-coded DH parameters
Sep 30 08:21:58 inside2 imap[17661]: SSL_accept() succeeded -> done
Sep 30 08:21:58 inside2 imap[17661]: starttls: TLSv1 with cipher 
DHE-RSA-AES256-SHA (256/256 bits new) no authentication
Sep 30 08:22:02 inside2 imap[17661]: login: imap.wi [192.168.190.226] 
onlight PLAIN+TLS User logged in
Sep 30 08:22:06 inside2 imap[17661]: Doing a peer verify
Sep 30 08:22:06 inside2 imap[17661]: verify error:num=19:self signed 
certificate in certificate chain
Sep 30 08:22:06 inside2 imap[17661]: received server certificate
Sep 30 08:22:06 inside2 imap[17661]: starttls: TLSv1 with cipher 
DHE-RSA-AES256-SHA (256/256 bits new client) no authentication
Sep 30 08:22:06 inside2 imap[17661]: couldn't authenticate to backend 
server: no mechanism available
Sep 30 08:24:09 inside2 master[17627]: process 17661 exited, status 0
-----------------------------------------------------

I have seen much discussion of the "no mechanism available" issue, but 
the answer typically is "install certificates," or "Use START_TLS" or 
the like.  Well, I have certificates, I have START_TLS, and I still have 
this problem.  How do I get the frontend to use PLAIN+TLS??

Please, any guidance would be appreciated.  I have already sunk way too 
much time into this and don't even have a working testbed to show for 
it.  I have spent two days pouring over the archives and cannot find a 
parallel situation to mine.

Best regards, and thanks in advance,
    -nic

-- 
Nic Bernstein                             nic at onlight.com
Onlight llc.                              www.onlight.com
2266 North Prospect Avenue #610	          v. 414.272.4477
Milwaukee, Wisconsin  53202-6306          f. 414.290.0335


From dangaudette at knet.ca  Tue Sep 30 10:47:45 2008
From: dangaudette at knet.ca (Dan Gaudette)
Date: Tue, 30 Sep 2008 09:47:45 -0500
Subject: Murder with Virtual Domains - deliveries from postfix fail
In-Reply-To: <48BF5CC5.6060203@olp.net>
References: <48BEDE83.3050505@knet.ca> <48BEE8B4.3090403@olp.net>
	<48BEFA17.90700@knet.ca> <48BF5CC5.6060203@olp.net>
Message-ID: <48E23C11.2030507@knet.ca>

Thanks again Dan - it was some of my virtual_ settings in postfix's 
main.cf causing the issue.

Dan

Dan White wrote:
> Dan Gaudette wrote:
>> Thanks Dan, but I'm still getting the same error.
>>
>> It'd be awesome if you could provide some more config.
>
> http://support.olp.net/cyrus/
>
> - Dan

-- 
Dan Gaudette
Keewaytinook Okimakanak / K-Net Services
Box 1439, 115 King Street
Sioux Lookout, ON, P8T 1B9
Phone: 807-737-1135 ext 1270
Fax: 807-737-1720
Email: dangaudette at knet.ca



From wes at umich.edu  Tue Sep 30 15:03:29 2008
From: wes at umich.edu (Wesley Craig)
Date: Tue, 30 Sep 2008 15:03:29 -0400
Subject: Problems with frontend to backend authentication in murder 2.3.12
In-Reply-To: <48E22A25.5000009@onlight.com>
References: <48E22A25.5000009@onlight.com>
Message-ID: <A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>

On 30 Sep 2008, at 09:31, Nic Bernstein wrote:
> I have seen much discussion of the "no mechanism available" issue, but
> the answer typically is "install certificates," or "Use START_TLS" or
> the like.  Well, I have certificates, I have START_TLS, and I still  
> have
> this problem.  How do I get the frontend to use PLAIN+TLS??

PLAIN+TLS is not a mechanism.  In the released code, if you want PLAIN 
+TLS, you need to configure the server to not allow plain text.  You  
also need to not configure the frontend with a mechanism at all.   
Personally, I think this is a bug.  See:

	https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3093

for a fix.  Good luck.

:wes

From nic at onlight.com  Tue Sep 30 15:36:09 2008
From: nic at onlight.com (Nic Bernstein)
Date: Tue, 30 Sep 2008 14:36:09 -0500
Subject: Problems with frontend to backend authentication in murder 2.3.12
In-Reply-To: <A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>
References: <48E22A25.5000009@onlight.com>
	<A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>
Message-ID: <48E27FA9.8020708@onlight.com>

Wesley Craig wrote:
> On 30 Sep 2008, at 09:31, Nic Bernstein wrote:
>> I have seen much discussion of the "no mechanism available" issue, but
>> the answer typically is "install certificates," or "Use START_TLS" or
>> the like.  Well, I have certificates, I have START_TLS, and I still have
>> this problem.  How do I get the frontend to use PLAIN+TLS??
>
> PLAIN+TLS is not a mechanism.  In the released code, if you want 
> PLAIN+TLS, you need to configure the server to not allow plain text.  
> You also need to not configure the frontend with a mechanism at all.  
> Personally, I think this is a bug.  See:
>
>     https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3093
>
> for a fix.  Good luck.
>
> :wes
Thanks for your answer, but I am not sure I understand all of what you 
say. 

The PLAIN+TLS not being a mechanism I get, I was just trying anything.

Given your suggestions, I have tried the following:

On the backend server, "mail.wi":
    removed "sasl_mech_list" entirely
    added "allowplaintext: false" (in Invoca rpm default setting is "true")

On the frontend server, "imap.wi":
    removed "mail_wi_mechs" entirely

Otherwise both servers are configured as previously stated in this thread.

When I test again using imtest I get exactly the same error:
-----------------------------------------------------------
# imtest -t "" -m PLAIN -u onlight -a onlight imap.wi
S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ STARTTLS AUTH=PLAIN SASL-IR] imap.wi Cyrus 
IMAP Murder v2.3.12p2-Invoca-RPM-2.3.12p2-1 server ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
STARTTLS AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS 
NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY 
SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
C: S01 STARTTLS
S: S01 OK Begin TLS negotiation now
verify error:num=18:self signed certificate
TLS connection established: TLSv1 with cipher DHE-RSA-AES256-SHA 
(256/256 bits)
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE 
UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT 
SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
Please enter your password:
C: A01 AUTHENTICATE PLAIN b25saWdodABvbmxpZ2h0AG9od2ViNG9G
S: A01 OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ LOGINDISABLED ACL RIGHTS=kxte QUOTA 
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN 
MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT 
THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE LISTEXT 
LIST-SUBSCRIBED X-NETSCAPE URLAUTH] Success (tls protection)
Authenticated.
Security strength factor: 256
. select inbox
. NO Server(s) unavailable to complete operation
. logout
* BYE LOGOUT received
. OK Completed
Connection closed.
-----------------------------------------------------------

As before the frontend log shows:

-----------------------------------------------------------
Sep 30 14:24:32 inside2 imap[7197]: Doing a peer verify
Sep 30 14:24:32 inside2 imap[7197]: verify error:num=19:self signed 
certificate in certificate chain
Sep 30 14:24:32 inside2 imap[7197]: received server certificate
Sep 30 14:24:32 inside2 imap[7197]: starttls: TLSv1 with cipher 
DHE-RSA-AES256-SHA (256/256 bits new client) no authentication
Sep 30 14:24:32 inside2 imap[7197]: couldn't authenticate to backend 
server: no mechanism available
-----------------------------------------------------------

For the record, I tried this both with and without "allowplaintext: 
false" in the frontend imapd.conf and get the same results (also tried 
with and without "-m PLAIN" in imtest command).

For completeness, I retried my imtest to the backend server with these 
results:

-----------------------------------------------------------
# imtest -t "" -m PLAIN -u onlight -a murder mail.wi
S: * OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ STARTTLS LOGINDISABLED] mail.wi Cyrus IMAP 
Murder v2.3.12p2-Invoca-RPM-2.3.12p2-1 server ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
STARTTLS LOGINDISABLED ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS NAMESPACE 
UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT 
SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
C: S01 STARTTLS
S: S01 OK Begin TLS negotiation now
verify error:num=19:self signed certificate in certificate chain
TLS connection established: TLSv1 with cipher DHE-RSA-AES256-SHA 
(256/256 bits)
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID MUPDATE=mupdate://postman/ 
AUTH=LOGIN AUTH=PLAIN SASL-IR ACL RIGHTS=kxte QUOTA MAILBOX-REFERRALS 
NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY 
SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE 
CATENATE CONDSTORE SCAN IDLE LISTEXT LIST-SUBSCRIBED X-NETSCAPE URLAUTH
S: C01 OK Completed
Please enter your password:
C: A01 AUTHENTICATE PLAIN b25saWdodABtdXJkZXIARWltOFVpdGg=
S: A01 OK [CAPABILITY IMAP4 IMAP4rev1 LITERAL+ ID 
MUPDATE=mupdate://postman/ LOGINDISABLED ACL RIGHTS=kxte QUOTA 
MAILBOX-REFERRALS NAMESPACE UIDPLUS NO_ATOMIC_RENAME UNSELECT CHILDREN 
MULTIAPPEND BINARY SORT SORT=MODSEQ THREAD=ORDEREDSUBJECT 
THREAD=REFERENCES ANNOTATEMORE CATENATE CONDSTORE SCAN IDLE LISTEXT 
LIST-SUBSCRIBED X-NETSCAPE URLAUTH] Success (tls protection)
Authenticated.
Security strength factor: 256
. select inbox
* FLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk)
* OK [PERMANENTFLAGS (\Answered \Flagged \Draft \Deleted \Seen NonJunk 
\*)] 
* 20 EXISTS
* 0 RECENT
* OK [UNSEEN 15] 
* OK [UIDVALIDITY 1112292825] 
* OK [UIDNEXT 90] 
* OK [NOMODSEQ] Sorry, modsequences have not been enabled on this mailbox
* OK [URLMECH INTERNAL]
. OK [READ-WRITE] Completed
. logout
* BYE LOGOUT received
. OK Completed
Connection closed.
-----------------------------------------------------------

So please forgive me if I am missing something, but I don't seem to be 
any closer.

Any help??
    -nic

-- 
Nic Bernstein                             nic at onlight.com
Onlight llc.                              www.onlight.com
2266 North Prospect Avenue #610	          v. 414.272.4477
Milwaukee, Wisconsin  53202-6306          f. 414.290.0335


From wes at umich.edu  Tue Sep 30 16:05:29 2008
From: wes at umich.edu (Wesley Craig)
Date: Tue, 30 Sep 2008 16:05:29 -0400
Subject: Problems with frontend to backend authentication in murder 2.3.12
In-Reply-To: <48E27FA9.8020708@onlight.com>
References: <48E22A25.5000009@onlight.com>
	<A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>
	<48E27FA9.8020708@onlight.com>
Message-ID: <2C6E03FB-C2E5-4D12-9917-46B70BD01B03@umich.edu>

On 30 Sep 2008, at 15:36, Nic Bernstein wrote:
> So please forgive me if I am missing something, but I don't seem to  
> be any closer.

Did you stop & restart the front- and backends?  The only other  
suggestion I have is strace imapd.  Since the process breaks before  
authentication, you won't otherwise get telemetry.

:wes

From nic at onlight.com  Tue Sep 30 16:12:57 2008
From: nic at onlight.com (Nic Bernstein)
Date: Tue, 30 Sep 2008 15:12:57 -0500
Subject: Problems with frontend to backend authentication in murder 2.3.12
In-Reply-To: <2C6E03FB-C2E5-4D12-9917-46B70BD01B03@umich.edu>
References: <48E22A25.5000009@onlight.com>
	<A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>
	<48E27FA9.8020708@onlight.com>
	<2C6E03FB-C2E5-4D12-9917-46B70BD01B03@umich.edu>
Message-ID: <48E28849.8010408@onlight.com>

Wesley Craig wrote:
> On 30 Sep 2008, at 15:36, Nic Bernstein wrote:
>> So please forgive me if I am missing something, but I don't seem to 
>> be any closer.
>
> Did you stop & restart the front- and backends?  The only other 
> suggestion I have is strace imapd.  Since the process breaks before 
> authentication, you won't otherwise get telemetry.
>
> :wes
Yes I stopped and restarted both front and backend systems after each 
change.  I am rebuilding my packages with your patch and will try that 
shortly.  Anything I should be looking out for?

Strace on which system, frontend or backend?  I'm guessing frontend, but...

Thanks again for your help,
    -nic

-- 
Nic Bernstein                             nic at onlight.com
Onlight llc.                              www.onlight.com
2266 North Prospect Avenue #610	          v. 414.272.4477
Milwaukee, Wisconsin  53202-6306          f. 414.290.0335


From wes at umich.edu  Tue Sep 30 16:17:54 2008
From: wes at umich.edu (Wesley Craig)
Date: Tue, 30 Sep 2008 16:17:54 -0400
Subject: Problems with frontend to backend authentication in murder 2.3.12
In-Reply-To: <48E28849.8010408@onlight.com>
References: <48E22A25.5000009@onlight.com>
	<A59EF033-7ED0-4E46-B123-F0A293D8A8A8@umich.edu>
	<48E27FA9.8020708@onlight.com>
	<2C6E03FB-C2E5-4D12-9917-46B70BD01B03@umich.edu>
	<48E28849.8010408@onlight.com>
Message-ID: <BD1769D1-DF80-4A2D-BCB8-F9F3CFD991CB@umich.edu>

On 30 Sep 2008, at 16:12, Nic Bernstein wrote:
> Strace on which system, frontend or backend?  I'm guessing  
> frontend, but...

It will be a lot easier on the front, yes.  Use imtest, authenticate,  
and then start strace before you SELECT INBOX.

:wes

From davidk at cs.umass.edu  Tue Sep 30 17:01:18 2008
From: davidk at cs.umass.edu (David Korpiewski)
Date: Tue, 30 Sep 2008 17:01:18 -0400
Subject: Why can't I see my mailboxes as an administrator through cyradm?
Message-ID: <48E2939E.1040804@cs.umass.edu>

I'm running the cyradm tool and when I log in as one of the accounts who 
are supposedly the administrators of my system I only see my local 
mailboxes and not the upper level mailboxes.   In other words, I see my 
own inbox, but not the inbox of everyone else.

I need to delete some users but cannot because I can't see them!

Any ideas would be extremely appreciated.

I'm running mac OSX 5.5.

Example of what I see:
root# ./cyradm -user cyrusadmin localhost
Password:
localhost> lm
INBOX (\Noinferiors)
localhost>


imapd.conf:
(server name updated to protect my systems)

admins: cyrusimap, cyrusadmin, steve
configdirectory: /var/imap
partition-default: /var/spool/imap
unixhierarchysep: yes
altnamespace: yes
servername: mail.umass.edu
sievedir: /usr/sieve
sendmail: /usr/sbin/sendmail
lmtp_downcase_rcpt: 1
unix_group_enable: 0
berkeley_txns_max: 400
berkeley_locks_max: 20000
berkeley_cachesize: 8192
berkeley_max_log_region: 2048
berkeley_max_log_file: 10240
berkeley_max_log_buffer: 2048
tls_key_file: /etc/certificates/mail.umass.edu.key
quota_warn_frequency_days: 1
tls_cert_file: /etc/certificates/mail.umass.edu.crt
enable_quota_warnings: yes
imap_auth_cram_md5: yes
pop_auth_apop: yes
log_rolling_days_enabled: 1
log_rolling_days: 2
imap_auth_plain: yes
tls_ca_file: /etc/certificates/mail.umass.edu.chcrt
tls_server_options: use
imap_auth_login: yes
imap_auth_gssapi: yes
pop_auth_gssapi: yes
mupdate_config: replicated
mupdate_server: mail2.umass.edu
mupdate_username: apple_mupdate_user
mupdate_authname: apple_mupdate_user



-- 
===========================================
David Korpiewski
Software Specialist I
CSCF - Computer Science Computing Facility
Department of Computer Science
Phone: 413-545-4319
Fax:   413-577-2285
===========================================

From thomas.cataldo at aliasource.fr  Tue Sep 30 17:04:44 2008
From: thomas.cataldo at aliasource.fr (Thomas Cataldo)
Date: Tue, 30 Sep 2008 23:04:44 +0200
Subject: Question about bodystructure answer on cyrus 2.2.13 (debian etch)
Message-ID: <f19173c90809301404i25e16ab0i3372ea863f5ca7b@mail.gmail.com>

Hi,

I am writing an imap client library and I am confusing by one cyrus response.

Here is my telnet dialog with cyrus on a test server :

Trying 10.0.0.5...
Connected to 10.0.0.5.
Escape character is '^]'.
* OK obm Cyrus IMAP4 v2.2.13-Debian-2.2.13-10 server ready
A1 login thomas at zz.com aliacom
A1 OK User logged in
A2 select inbox
* FLAGS (\Answered \Flagged \Draft \Deleted \Seen Junk NonJunk
$MDNSent receipt-handled $Label1 $Forwarded $label2)
* OK [PERMANENTFLAGS (\Answered \Flagged \Draft \Deleted \Seen Junk
NonJunk $MDNSent receipt-handled $Label1 $Forwarded $label2 \*)]
* 489 EXISTS
* 0 RECENT
* OK [UNSEEN 2]
* OK [UIDVALIDITY 1197326009]
* OK [UIDNEXT 5263]
A2 OK [READ-WRITE] Completed
A3 uid fetch 4826 (BODYSTRUCTURE)
* 78 FETCH (UID 4826 BODYSTRUCTURE (("TEXT" "PLAIN" ("CHARSET"
"ISO-8859-1" "FORMAT" "flowed") NIL NIL "8BIT" 137 8 NIL NIL
NIL)("MESSAGE" "RFC822" ("NAME*" {147}
ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56)
NIL NIL "8BIT" 1544 ("Wed, 14 Feb 2007 10:12:39 +0100" "j'ai
=?ISO-8859-1?Q?lanc=E9_une_grosse_impression_sur_?=
=?ISO-8859-1?Q?LP2300RV?=" (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Aliasource Toulouse" NIL "toulouse"
"aliasource.fr")) NIL NIL NIL "<45D2D287.6000806 at aliasource.fr>")
("TEXT" "PLAIN" ("CHARSET" "ISO-8859-1" "FORMAT" "flowed") NIL NIL
"8BIT" 137 8 NIL NIL NIL) 36 NIL ("INLINE" ("FILENAME*" {147}
ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56))
NIL) "MIXED" ("BOUNDARY" "------------020307030708000209000306") NIL
NIL))
A3 OK Completed (0.000 sec)

My problem is in the response to the body structure request : cyrus
tells me he will send me 147 bytes and my lib can deal with that. The
problem is, the data sent by cyrus is way longer than 147 bytes... can
someone point me to what I misunderstood ?

Regards, thomas.

From tcataldo at gmail.com  Tue Sep 30 17:10:27 2008
From: tcataldo at gmail.com (Thomas Cataldo)
Date: Tue, 30 Sep 2008 23:10:27 +0200
Subject: Question about bodystructure answer on cyrus 2.2.13 (debian etch)
Message-ID: <f19173c90809301410p7b4addabx845e0386d3fcd9a1@mail.gmail.com>

Hi,

I am writing an imap client library and I am confusing by one cyrus response.

Here is my telnet dialog with cyrus on a test server :

Trying 10.0.0.5...
Connected to 10.0.0.5.
Escape character is '^]'.
* OK obm Cyrus IMAP4 v2.2.13-Debian-2.2.13-10 server ready
A1 login thomas at zz.com aliacom
A1 OK User logged in
A2 select inbox
* FLAGS (\Answered \Flagged \Draft \Deleted \Seen Junk NonJunk
$MDNSent receipt-handled $Label1 $Forwarded $label2)
* OK [PERMANENTFLAGS (\Answered \Flagged \Draft \Deleted \Seen Junk
NonJunk $MDNSent receipt-handled $Label1 $Forwarded $label2 \*)]
* 489 EXISTS
* 0 RECENT
* OK [UNSEEN 2]
* OK [UIDVALIDITY 1197326009]
* OK [UIDNEXT 5263]
A2 OK [READ-WRITE] Completed
A3 uid fetch 4826 (BODYSTRUCTURE)
* 78 FETCH (UID 4826 BODYSTRUCTURE (("TEXT" "PLAIN" ("CHARSET"
"ISO-8859-1" "FORMAT" "flowed") NIL NIL "8BIT" 137 8 NIL NIL
NIL)("MESSAGE" "RFC822" ("NAME*" {147}
ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56)
NIL NIL "8BIT" 1544 ("Wed, 14 Feb 2007 10:12:39 +0100" "j'ai
=?ISO-8859-1?Q?lanc=E9_une_grosse_impression_sur_?=
=?ISO-8859-1?Q?LP2300RV?=" (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Virginie Nouzies" NIL "virginie.nouzies"
"aliasource.fr")) (("Aliasource Toulouse" NIL "toulouse"
"aliasource.fr")) NIL NIL NIL "<45D2D287.6000806 at aliasource.fr>")
("TEXT" "PLAIN" ("CHARSET" "ISO-8859-1" "FORMAT" "flowed") NIL NIL
"8BIT" 137 8 NIL NIL NIL) 36 NIL ("INLINE" ("FILENAME*" {147}
ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56))
NIL) "MIXED" ("BOUNDARY" "------------020307030708000209000306") NIL
NIL))
A3 OK Completed (0.000 sec)

My problem is in the response to the body structure request : cyrus
tells me he will send me 147 bytes and my lib can deal with that. The
problem is, the data sent by cyrus is way longer than 147 bytes... can
someone point me to what I misunderstood ?

Regards, thomas.

From brong at fastmail.fm  Tue Sep 30 19:32:51 2008
From: brong at fastmail.fm (Bron Gondwana)
Date: Wed, 1 Oct 2008 09:32:51 +1000
Subject: Question about bodystructure answer on cyrus 2.2.13 (debian etch)
In-Reply-To: <f19173c90809301410p7b4addabx845e0386d3fcd9a1@mail.gmail.com>
References: <f19173c90809301410p7b4addabx845e0386d3fcd9a1@mail.gmail.com>
Message-ID: <20080930233251.GA31618@brong.net>

On Tue, Sep 30, 2008 at 11:10:27PM +0200, Thomas Cataldo wrote:
> NIL)("MESSAGE" "RFC822" ("NAME*" {147}
> ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56)
> NIL NIL "8BIT" 1544 ("Wed, 14 Feb 2007 10:12:39 +0100" "j'ai

> My problem is in the response to the body structure request : cyrus
> tells me he will send me 147 bytes and my lib can deal with that. The
> problem is, the data sent by cyrus is way longer than 147 bytes... can
> someone point me to what I misunderstood ?

The "147" bytes is this bit here:
ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56

Which is just one "ATOM".  All the stuff after this is other ATOMs,
which aren't part of the 147 bytes.  You can easily get multiple
ATOMs in a single response encoded in this way.

Bron.

From tcataldo at gmail.com  Tue Sep 30 20:08:13 2008
From: tcataldo at gmail.com (Thomas Cataldo)
Date: Wed, 1 Oct 2008 02:08:13 +0200
Subject: Question about bodystructure answer on cyrus 2.2.13 (debian etch)
In-Reply-To: <20080930233251.GA31618@brong.net>
References: <f19173c90809301410p7b4addabx845e0386d3fcd9a1@mail.gmail.com>
	<20080930233251.GA31618@brong.net>
Message-ID: <f19173c90809301708i2f26aee3hfc8660e1a422892f@mail.gmail.com>

On Wed, Oct 1, 2008 at 1:32 AM, Bron Gondwana <brong at fastmail.fm> wrote:
> On Tue, Sep 30, 2008 at 11:10:27PM +0200, Thomas Cataldo wrote:
>> NIL)("MESSAGE" "RFC822" ("NAME*" {147}
>> ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56)
>> NIL NIL "8BIT" 1544 ("Wed, 14 Feb 2007 10:12:39 +0100" "j'ai
>
>> My problem is in the response to the body structure request : cyrus
>> tells me he will send me 147 bytes and my lib can deal with that. The
>> problem is, the data sent by cyrus is way longer than 147 bytes... can
>> someone point me to what I misunderstood ?
>
> The "147" bytes is this bit here:
> ISO-8859-1''%6A%27%61%69%20%6C%61%6E%63%E9%20%75%6E%65%20%67%72%6F%73%73%65%20%69%6D%70%72%65%73%73%69%6F%6E%20%73%75%72%20%4C%50%32%33%30%30%52%56
>
> Which is just one "ATOM".  All the stuff after this is other ATOMs,
> which aren't part of the 147 bytes.  You can easily get multiple
> ATOMs in a single response encoded in this way.

Thank you, I realized what I was doing wrong.

>
> Bron.
>