Need advice on building a Cyrus IMAP cluster
Dave McMurtrie
dave64 at andrew.cmu.edu
Mon Aug 3 21:10:28 EDT 2009
Dave McMurtrie wrote:
> Though I have no experience with it, I seem to recall that someone
> attempted to use GFS with an active/active Cyrus cluster and it was a
> disaster. It was mentioned either on info-cyrus or in the Cyrus wiki.
> If google doesn't help you find this, I can try to remember where I read it.
>
Replying to myself:
Close... It was GPFS, not GFS. Here's the info-cyrus post I was
thinking of:
http://lists.andrew.cmu.edu/pipermail/info-cyrus/2004-February/008975.html
A couple points that Mr. Ulmer makes are valid. When we first went into
production with the active/active cluster at Pitt, it ground to a halt
under heavy load because of mmap() usage. We ended up changing the
map_refresh() code so it would MAP_PRIVATE instead of MAP_SHARED. This
relieved the cluster of the burden of tracking the mmap() state across
all of the nodes.
Also, we did not use Berkeley DB or Skiplist for anything. All of our
databases were flat. I think BDB may use shared memory, which
definitely won't work across cluster nodes using only a distributed
filesystem. If this is the case, BDB just can't be used.
HTH,
Dave
--
Dave McMurtrie, SPE
Email Systems Team Leader
Carnegie Mellon University,
Computing Services
More information about the Info-cyrus
mailing list