only half of the problem solved -- cyrus deliver slow -- spee ded up!

[Su Li]

Thanks Chrisian,

I got that. Now I don't see deliver process any more. 

Thanks for all, who gave me so many good ideas for tuning up my performance!
I can deliver about 10 msg/sec now. I think disk IO is a big bif issue. I
striped 3 disks into one and put IMAP mail store in that disk. It give me a
big improvement in deliver speed. I did mean other tuning is not important. 

I am still looking for the bottle neck of speed delivery. 

Thanks all,


Su


-----Original Message-----
From: Christian Schulte <cs at schulte.it>
To: Su Li <sli at rim.net>
CC: info-cyrus at lists.andrew.cmu.edu <info-cyrus at lists.andrew.cmu.edu>
Sent: Fri Sep 20 23:13:03 2002
Subject: Re: only half of the problem solved -- cyrus deliver slow

Hi,

I just read your posts. You definetly want to change the cyrus.m4 mailer 
definition. If you are already compiling sendmail, then have a look at 
the directory cf/mailer !
Therein is a file called cyrus.m4 which you just have to change to 
deliver to the socket you just created. I did that and it works much 
much better than with deliver!
If you are unsure, then  just download the actual sendmail release 
8.12.6 and have a look at cf/mailer/cyrusv2.m4 in it. This should work! 
There is no need to switch to postfix!

Here is my working cyrus.m4 file. Have a look at the Mcyrus mailer 
definition !


PUSHDIVERT(-1)
#
# Copyright (c) 1998-2001 Sendmail, Inc. and its suppliers.
#    All rights reserved.
#
# By using this file, you agree to the terms and conditions set
# forth in the LICENSE file which can be found at the top level of
# the sendmail distribution.
#
#
# This code incorporates code from Carnegie Mellon University, whose
# copyright notice and conditions of redistribution are as follows:
#
#***************************************************************************
#    (C) Copyright 1995 by Carnegie Mellon University
#
#                      All Rights Reserved
#
# Permission to use, copy, modify, and distribute this software and its
# documentation for any purpose and without fee is hereby granted,
# provided that the above copyright notice appear in all copies and that
# both that copyright notice and this permission notice appear in
# supporting documentation, and that the name of CMU not be
# used in advertising or publicity pertaining to distribution of the
# software without specific, written prior permission.
#
# CMU DISCLAIMS ALL WARRANTIES WITH REGARD TO THIS SOFTWARE, INCLUDING
# ALL IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS, IN NO EVENT SHALL
# CMU BE LIABLE FOR ANY SPECIAL, INDIRECT OR CONSEQUENTIAL DAMAGES OR
# ANY DAMAGES WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS,
# WHETHER IN AN ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION,
# ARISING OUT OF OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS
# SOFTWARE.
#
#    Contributed to Berkeley by John Gardiner Myers <jgm+ at CMU.EDU>.
#

_DEFIFNOT(`CYRUS_MAILER_FLAGS', `Ah5@/:|')
ifdef(`CYRUS_MAILER_PATH',, `define(`CYRUS_MAILER_PATH', 
/usr/local/bin/deliver)')
ifdef(`CYRUS_MAILER_ARGS',, `define(`CYRUS_MAILER_ARGS', `deliver -m $h 
-f $f -- $u')')
ifdef(`CYRUS_MAILER_USER',, `define(`CYRUS_MAILER_USER', `cyrus:smmsp')')
_DEFIFNOT(`CYRUS_BB_MAILER_FLAGS', `u')
ifdef(`CYRUS_BB_MAILER_ARGS',, `define(`CYRUS_BB_MAILER_ARGS', `deliver 
-f $f -m $u')')
define(`_CYRUS_QGRP', `ifelse(defn(`CYRUS_MAILER_QGRP'),`',`', ` 
Q=CYRUS_MAILER_QGRP,')')dnl

POPDIVERT

##################################################
###   Cyrus Mailer specification               ###
##################################################

VERSIONID(`$Id: cyrus.m4,v 8.23 2001/11/12 23:11:34 ca Exp $ (Carnegie 
Mellon)')

Mcyrus,         P=[IPC], F=lsDFMnqA@/:|SmXz, E=\r\n,
                S=EnvFromL/HdrFromL, R=EnvToL/HdrToL, T=DNS/RFC822/X-Unix,
                A=FILE /usr/local/var/imap/socket/lmtp

Mcyrusbb,    P=CYRUS_MAILER_PATH, F=_MODMF_(CONCAT(`lsDFMn', 
CYRUS_BB_MAILER_FLAGS), `CYRUS'), S=EnvFromL/HdrFromL, R=EnvToL/HdrToL,
        ifdef(`CYRUS_MAILER_MAX', `M=CYRUS_MAILER_MAX, 
')U=CYRUS_MAILER_USER, T=DNS/RFC822/X-Unix,_CYRUS_QGRP
        A=CYRUS_BB_MAILER_ARGS



Su Li wrote:

>Thanks,
>
>I am thinking of switching to postfix. I hear a few things about it too.
>Maybe I have to bug you some later time. But the bottle neck right now
seems
>like the imap server.
>
>For "enable lmtpunix", I think that is a very good point. 
>
>I tried add the following line to imapd.conf:
>lmtpsocket: /var/imap/socket/lmtp
>
>But I still get: " cyrus  9425  9418  0 14:28 ? 00:00:00 deliver -e -m  --
>loadtest641".
>
>There must be something else I need to change to enable lmtpunix, and not
to
>use /cyrus/bin/deliver.
>Should I do something in sendmail config file -- in your case postfix
config
>file?
>
>
>
>Any one knows how to set up sendmail for lmtp socket delivery so that I
>don't get lots a deliver -e -m in the system?
>
>
>Thanks,
>
>Su
> 
>
>-----Original Message-----
>From: Scott Russell [mailto:lnxgeek at us.ibm.com]
>Sent: September 18, 2002 2:00 PM
>To: Su Li
>Cc: 'Lawrence Greenfield'; info-cyrus at lists.andrew.cmu.edu
>Subject: Re: only half of the problem solved -- cyrus deliver slow
>
>
>On Wed, Sep 18, 2002 at 01:23:08PM -0400, Su Li wrote:
>  
>
>>I tried set sendmail configuration to deliverymode=queue. and use
>>    
>>
>"sendmail
>  
>
>>-db" and "sendmail -q1s". I got the same through put. I using sendmail
>>8.11.6, will that effect the through put the email delivery of cyrus imap?
>>    
>>
>
>  
>
>>I did went through the configuration of sendmail about cyrus. But I still
>>get:
>>
>>cyrus     3645  3644  0 13:17 ?        00:00:00 deliver -e -m  --
>>loadtest510
>>
>>Is that the process that you was talking about, which is not good for
>>performance? If yes, what should I change?
>>    
>>
>
>I'm not a sendmail user, I use postfix instead. It's easier to
>configure and maintain. It's well supported, has an active mailing
>list, good docs,  and in general it 'just works'.
>
>If you're spawning /usr/cyrus/bin/deliver processes as it appears in
>your ps listing then yes, that's going to hurt you.
>
>In your cyrus.conf enable lmtpunix: socket and configure sendmail to
>deliver directly to the socket, not use the deliver binary.
>
>If you want to switch to postfix let me know. I'll help you configure
>it. For sendmail you should ask someone else on this list, or the
>sendmail list, how to setup sendmail for lmtp socket delivery.
>
>  
>