On Tue, 2009-09-08 at 16:56 +0200, Michael Menge wrote:
[...]
> Quoting Bernd Petrovitsch <bernd@firmix.at>:
[...]
> > We are running cyrus-imapd with all files (mailboxes, Berkeley-DB,
> > mmap()ed files) on an ext3 filesystem (with data=ordered) on a iSCSI
> > block device (and the actual storage is on a NetApp box if that matters)
> > on a Xeon 3.2GHz CPU (with 4 cores/2 HT thread - ).
> > The kernel is 2.6.18-128.el5 (from the RHEL5/CentOS-5 updates).
> 
> Don't know if i can help as we have an different setting
> cyrus-2.3.14, SLES 10, xfs on iSCSI and Skiplist instead of BDB.
How large is the setup?
We have ~25K mailboxes with ~1E6 mails per day (on the average) and run
up to 300 popds and some imapds in parallel.

> > On a low-(to-now-)volume test cluster, everything runs fine. On the
> > high-volume production cluster[0], we experienced a corrupted BDB.
> > Googling didn't yield any useful result on the cause (or hint on
> > improvement of the configuration).
> >
> Which Version of Cyrus did you use? Which DB was Corrupted?
- cyrus-imapd-2.3.7 (from RHEL5/CentOS-5) with some minor patches in the
  popd (UUID format and an enhancement to the authentication - both
  shouldn't have any impact on the storage part)
- The duplicate.db.
  Yes, we (can and will) scrap it (if only to fix the current problem) -
  and we don't use duplicate suppression anyways (because of the
  performance impact).

> Did this happen only once or on a regulare base?
It happened now and then and is somewhat inconvenient.
And it's not fun if the /var/log partition is full just because
cyr_expire stumbles over a corrupted BDB.

> > Does anyone have experience with such a setup?
> 
> With the differences mentioned above, this setups works fine.
We switched to iSCSI just recently - so that's the only really "new"
thing in the setup.
And it works fine hereover too (and since the popds, imapds and mail
delivery work just fine, it's not a crisis now) - it's just the
annoyance as above every other month or so.

	Bernd
-- 
Firmix Software GmbH                   http://www.firmix.at/
mobil: +43 664 4416156                 fax: +43 1 7890849-55
          Embedded Linux Development and Services