<!DOCTYPE html><html><head><title></title><style type="text/css">p.MsoNormal,p.MsoNoSpacing{margin:0}
p.MsoNormal,p.MsoNoSpacing{margin:0}</style></head><body><div style="font-family:Arial;">Hi Michael,<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Sorry about the delay in looking at this - I was mad crazy busy getting ready to go overseas. At Fosdem now, about to give a talk about JMAP!<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">OK, let's start with the things that give me a little bit of hives...<br></div><div style="font-family:Arial;"><br></div><pre id="v1330" class="v-Blob-textContent" style="position:relative;" title="">configdirectory: /srv/cyrus-be
partition-default: /srv/cyrus-be
partition-ssd: /srv/cyrus-be/ssd-part<br></pre><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Ouch. There's a couple of things I wouldn't do there - having the partition be the same as the config directory, and having a separate partition be a subdirectory of a partition. They're both asking for trouble. I would probably lay my system out like:<br></div><div style="font-family:Arial;"><br></div><pre class="v-Blob-textContent" style="position:relative;" title="">configdirectory: /srv/cyrus-be/conf
partition-default: /srv/cyrus-be/default-part
partition-ssd: /srv/cyrus-be/ssd-part<br></pre><div style="font-family:Arial;"><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">And then each tree would only have one type of thing in it.<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Anyway, I don't think that would break anything.<br></div><div style="font-family:Arial;"><br></div></div><pre class="v-Blob-textContent" style="position:relative;" title="">metapartition-ssd: /srv/cyrus-ssd-be/meta/ssd-part
metapartition_files: header index cache expunge squat annotations lock dav archivecache<br></pre><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Ooh, I haven't tested having cache and archivecache on the same location. That's really interesting. Again, I'd be in favour of separation here, give them different paths. That might be tricky with ssd though, the way this is laid out. I assume you have some kind of symlink farm going on?<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Otherwise it all looks OK. Are you getting other IOERRORs in your log files which could show things aborting? It really looks like your conversations DB is getting out of sync due to other failures.<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Cheers,<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Bron.<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;"><div style="font-family:Arial;"><br></div></div><div style="font-family:Arial;">On Thu, Jan 31, 2019, at 19:36, Michael Menge wrote:<br></div><blockquote id="fastmail-quoted" type="cite"><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">Quoting Bron Gondwana <brong@fastmail.fm>:<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">> On Fri, Jan 25, 2019, at 20:00, Michael Menge wrote:<br></div><div style="font-family:Arial;">>> Hi Bron<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> Quoting Bron Gondwana <brong@fastmail.fm>:<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> > Sorry I haven't been following along with this earlier. Can you post<br></div><div style="font-family:Arial;">>> > your imapd.conf and cyrus.conf as well as let her know if you run<br></div><div style="font-family:Arial;">>> > anything which directly messes with files on disk.<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> Thanks for looking into it. I have attached the backend and replica<br></div><div style="font-family:Arial;">>> configs. There should be nothing messing with the files on disk<br></div><div style="font-family:Arial;">>> directly. Some times we need to restore mails from file based<br></div><div style="font-family:Arial;">>> backup (bacula) followed by a reconstruct but this was not the<br></div><div style="font-family:Arial;">>> case this time.<br></div><div style="font-family:Arial;">><br></div><div style="font-family:Arial;">> Do you always rebuild the conversations db after doing the <br></div><div style="font-family:Arial;">> reconstruct? That will be necessary now. We switched to doing all <br></div><div style="font-family:Arial;">> our restores using IMAP append a while back so we're never fiddling <br></div><div style="font-family:Arial;">> the file system under Cyrus.<br></div><div style="font-family:Arial;">><br></div><div style="font-family:Arial;">>> ><br></div><div style="font-family:Arial;">>> > Also, what operating system is this on and what Cyrus version?<br></div><div style="font-family:Arial;">>> ><br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> We are running a cyrus 3.0.8 compiled with the following Options<br></div><div style="font-family:Arial;">>> (./configure --enable-murder --enable-http --enable-calalarmd<br></div><div style="font-family:Arial;">>> --enable-replication --enable-backup --enable-idled<br></div><div style="font-family:Arial;">>> --enable-autocreate CFLAGS="-fPIC -g")<br></div><div style="font-family:Arial;">>> in a murder configuration on a RHEL 7.5 System. As filesystem we use xfs.<br></div><div style="font-family:Arial;">><br></div><div style="font-family:Arial;">> They should be fine. I'll have a read of the config when I'm at a <br></div><div style="font-family:Arial;">> real computer.<br></div><div style="font-family:Arial;">><br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">did you find anything in the config that would explain the problems?<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> > Bron.<br></div><div style="font-family:Arial;">>> ><br></div><div style="font-family:Arial;">>> > On Fri, Jan 25, 2019, at 04:08, Michael Menge wrote:<br></div><div style="font-family:Arial;">>> >> Hi,<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> I have discovered an other problem with the conversations db:<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> Thousends of lines with "IOERROR: conversations_audit on load:" and<br></div><div style="font-family:Arial;">>> >> "IOERROR: conversations_audit on store:"<br></div><div style="font-family:Arial;">>> >> A look at the source code shows that these errors are logged after<br></div><div style="font-family:Arial;">>> >> "_sanity_check_counts" is called.<br></div><div style="font-family:Arial;">>> >> The log level LOG_ERR and the prefix IOERROR indicate that I have a<br></div><div style="font-family:Arial;">>> >> serious problem. Do I?<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> This problem occurred for accounts where the rebuild of the<br></div><div style="font-family:Arial;">>> >> conversations db was successful.<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> I don't want to rebuild the conversations db every few days.<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> Any help is appreciated.<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> Kind regards<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> Michael Menge<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> <br></div><div style="font-family:Arial;">>> --------------------------------------------------------------------------------<br></div><div style="font-family:Arial;">>> >> M.Menge Tel.: (49) 7071/29-70316<br></div><div style="font-family:Arial;">>> >> Universität Tübingen Fax.: (49) 7071/29-5912<br></div><div style="font-family:Arial;">>> >> Zentrum für Datenverarbeitung mail:<br></div><div style="font-family:Arial;">>> >> michael.menge@zdv.uni-tuebingen.de<br></div><div style="font-family:Arial;">>> >> Wächterstraße 76<br></div><div style="font-family:Arial;">>> >> 72074 Tübingen<br></div><div style="font-family:Arial;">>> >><br></div><div style="font-family:Arial;">>> >> ----<br></div><div style="font-family:Arial;">>> >> Cyrus Home Page: http://www.cyrusimap.org/<br></div><div style="font-family:Arial;">>> >> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/<br></div><div style="font-family:Arial;">>> >> To Unsubscribe:<br></div><div style="font-family:Arial;">>> >> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus<br></div><div style="font-family:Arial;">>> ><br></div><div style="font-family:Arial;">>> > --<br></div><div style="font-family:Arial;">>> > Bron Gondwana<br></div><div style="font-family:Arial;">>> > brong@fastmail.fm<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> --------------------------------------------------------------------------------<br></div><div style="font-family:Arial;">>> M.Menge Tel.: (49) 7071/29-70316<br></div><div style="font-family:Arial;">>> Universität Tübingen Fax.: (49) 7071/29-5912<br></div><div style="font-family:Arial;">>> Zentrum für Datenverarbeitung mail:<br></div><div style="font-family:Arial;">>> michael.menge@zdv.uni-tuebingen.de<br></div><div style="font-family:Arial;">>> Wächterstraße 76<br></div><div style="font-family:Arial;">>> 72074 Tübingen<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> ----<br></div><div style="font-family:Arial;">>> Cyrus Home Page: http://www.cyrusimap.org/<br></div><div style="font-family:Arial;">>> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/<br></div><div style="font-family:Arial;">>> To Unsubscribe:<br></div><div style="font-family:Arial;">>> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus<br></div><div style="font-family:Arial;">>><br></div><div style="font-family:Arial;">>> *Attachments:*<br></div><div style="font-family:Arial;">>> * imapd_be.conf<br></div><div style="font-family:Arial;">>> * cyrus_be.conf<br></div><div style="font-family:Arial;">>> * cyrus_re.conf<br></div><div style="font-family:Arial;">>> * imapd_re.conf<br></div><div style="font-family:Arial;">><br></div><div style="font-family:Arial;">> --<br></div><div style="font-family:Arial;">> Bron Gondwana<br></div><div style="font-family:Arial;">> brong@fastmail.fm<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">--------------------------------------------------------------------------------<br></div><div style="font-family:Arial;">M.Menge Tel.: (49) 7071/29-70316<br></div><div style="font-family:Arial;">Universität Tübingen Fax.: (49) 7071/29-5912<br></div><div style="font-family:Arial;">Zentrum für Datenverarbeitung mail: <br></div><div style="font-family:Arial;">michael.menge@zdv.uni-tuebingen.de<br></div><div style="font-family:Arial;">Wächterstraße 76<br></div><div style="font-family:Arial;">72074 Tübingen<br></div><div style="font-family:Arial;"><br></div><div style="font-family:Arial;">----<br></div><div style="font-family:Arial;">Cyrus Home Page: http://www.cyrusimap.org/<br></div><div style="font-family:Arial;">List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/<br></div><div style="font-family:Arial;">To Unsubscribe:<br></div><div style="font-family:Arial;">https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus<br></div></blockquote><div style="font-family:Arial;"><br></div><div id="sig56629417"><div class="signature">--<br></div><div class="signature"> Bron Gondwana, CEO, FastMail Pty Ltd<br></div><div class="signature"> brong@fastmailteam.com<br></div><div class="signature"><br></div></div><div style="font-family:Arial;"><br></div></body></html>