Cyrus + Xapian

[Robert Stepanek]

Hi Albert,

On Sat, Apr 21, 2018, at 08:05, Albert Shih wrote:
> Le 20/04/2018 à 16:18:23+0200, Robert Stepanek a écrit

> >  Would you be able to inspect a [..]
> > core dump of squatter? 
> 
> No dump (don't know why).

For Linux, one has to set a kernel flag to allow core dumps for processes that changed ownership: https://github.com/cyrusimap/cyrus-imapd/blob/master/docsrc/imap/reference/faqs/o-coredump.rst

There's probably a similar thing for FreeBSD, but I haven't worked with FreeBSD since quite some time.

> The « funny » thing is, know it's absolutly sure, the first time I get a
> Seg Fault, but the second time it's working perfectly....

I'd be tempted to start guessing here, but it's really too early to tell. A core trace that tells us exactly where it's crashing is really the best next step.

> One question about the way squatter/xapian/cyrus interact, but is it
> possible to loose email if squatter/xapian goes to segmentation during a
> incomming mail ?

The squatter process is running separately from the IMAP-related processes. There's shouldn't be any issue losing mail. At worst, you might end up with corrupted indices, but they all can be rebuilt from the mail folders.

Cheers,
Robert

> 
> Thanks for the help.
> 
> Regards.
> 
> 
> > >
> > >
> > > I'm trying to configure xapian and cyrus-imapd, so I put this in
> > > my config
> > >
> > >   sync_log: on sync_log_channels: squatter search_engine:
> > >   xapian search_index_headers: no search_batchsize: 16384
> > >   defaultsearchtier: t1 t1searchpartition-default: /var/imap/search
> > >   conversations: on conversations_db: twoskip
> > >
> > > but when I launch squatter they crash randomly, meaning I can
> > > launch squatter, it going to run during 10sec, sometime 30 sec,
> > > after that they give a me
> > >
> > >   squatter[34140]: indexing mailbox user.************...
> > >   Indexing mailbox user.************... Segmentation fault
> > >
> > > It seems (human watch) this happen only when beginning indexing
> > > a new user, so I tough it's because he need to create the
> > >
> > >   /var/imap/search/*/user/*/xapian
> > >
> > > so I create all this directory....but don't seem give any
> > > difference.
> > >
> > > But I pretty certain squatter give a segmentation fault every
> > > *FIRST* time he run on a user.
> > >
> > > So I guessing I do something wrong dans squatter need some «
> > > initialize »...
> > >
> > > Regards.
> > >
> > >
> > >
> > >
> > > -- Albert SHIH DIO bâtiment 15 xmpp: jas at obspm.fr Heure
> > > local/Local time: Fri Apr 20 15:30:07 CEST 2018 ---- Cyrus
> > > Home Page: http://www.cyrusimap.org/ List Archives/Info:
> > > http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe:
> > > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> > ---- Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info:
> > http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe:
> > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
> --
> Albert SHIH
> DIO bâtiment 15
> Observatoire de Paris
> xmpp: jas at obspm.fr
> Heure local/Local time:
> Sat Apr 21 07:57:04 CEST 2018