Cyrus + Xapian

[Robert Stepanek]

Hi Albert,

we just had a chat on the issue you are reporting in the regular Cyrus call: there have been a few fixes for squatter since 3.0.5. Would you be able to compile from the current development snapshot [1]? If not, 3.0.6 will be released soon, which will also contain the fixes.

This probably will not resolve the issue, but it would give us one more data point if squatter turns out to run cleanly on the development release.

Cheers,
Robert

[1] https://github.com/cyrusimap/cyrus-imapd

On Mon, Apr 23, 2018, at 09:48, Robert Stepanek wrote:
> Hi Albert,
> 
> On Sat, Apr 21, 2018, at 08:05, Albert Shih wrote:
> > Le 20/04/2018 à 16:18:23+0200, Robert Stepanek a écrit
> 
> > >  Would you be able to inspect a [..]
> > > core dump of squatter? 
> > 
> > No dump (don't know why).
> 
> For Linux, one has to set a kernel flag to allow core dumps for 
> processes that changed ownership: 
> https://github.com/cyrusimap/cyrus-imapd/blob/master/docsrc/imap/reference/faqs/o-coredump.rst
> 
> There's probably a similar thing for FreeBSD, but I haven't worked with 
> FreeBSD since quite some time.
> 
> > The « funny » thing is, know it's absolutly sure, the first time I get a
> > Seg Fault, but the second time it's working perfectly....
> 
> I'd be tempted to start guessing here, but it's really too early to 
> tell. A core trace that tells us exactly where it's crashing is really 
> the best next step.
> 
> > One question about the way squatter/xapian/cyrus interact, but is it
> > possible to loose email if squatter/xapian goes to segmentation during a
> > incomming mail ?
> 
> The squatter process is running separately from the IMAP-related 
> processes. There's shouldn't be any issue losing mail. At worst, you 
> might end up with corrupted indices, but they all can be rebuilt from 
> the mail folders.
> 
> Cheers,
> Robert
> 
> > 
> > Thanks for the help.
> > 
> > Regards.
> > 
> > 
> > > >
> > > >
> > > > I'm trying to configure xapian and cyrus-imapd, so I put this in
> > > > my config
> > > >
> > > >   sync_log: on sync_log_channels: squatter search_engine:
> > > >   xapian search_index_headers: no search_batchsize: 16384
> > > >   defaultsearchtier: t1 t1searchpartition-default: /var/imap/search
> > > >   conversations: on conversations_db: twoskip
> > > >
> > > > but when I launch squatter they crash randomly, meaning I can
> > > > launch squatter, it going to run during 10sec, sometime 30 sec,
> > > > after that they give a me
> > > >
> > > >   squatter[34140]: indexing mailbox user.************...
> > > >   Indexing mailbox user.************... Segmentation fault
> > > >
> > > > It seems (human watch) this happen only when beginning indexing
> > > > a new user, so I tough it's because he need to create the
> > > >
> > > >   /var/imap/search/*/user/*/xapian
> > > >
> > > > so I create all this directory....but don't seem give any
> > > > difference.
> > > >
> > > > But I pretty certain squatter give a segmentation fault every
> > > > *FIRST* time he run on a user.
> > > >
> > > > So I guessing I do something wrong dans squatter need some «
> > > > initialize »...
> > > >
> > > > Regards.
> > > >
> > > >
> > > >
> > > >
> > > > -- Albert SHIH DIO bâtiment 15 xmpp: jas at obspm.fr Heure
> > > > local/Local time: Fri Apr 20 15:30:07 CEST 2018 ---- Cyrus
> > > > Home Page: http://www.cyrusimap.org/ List Archives/Info:
> > > > http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe:
> > > > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> > > ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info:
> > > http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe:
> > > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> > --
> > Albert SHIH
> > DIO bâtiment 15
> > Observatoire de Paris
> > xmpp: jas at obspm.fr
> > Heure local/Local time:
> > Sat Apr 21 07:57:04 CEST 2018
> ----
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus