cyrus-murder problems with database corruption in the frontend/master

[João Assad]

João Assad wrote:

>> Derrick J Brashear wrote:
>> curiously, the strace output isn't showing an mmap() call fail, that 
>> I see, before the error shows up.
>
> I could do a strace -f wich would dump all the traces from all the 
> threads into a single file... but its a nightmare to read it.
> by reading some strace output here I've noticed mmaps complaining 
> about ENOMEM way before the mmap inside map_refresh goes crazy.
> then It came to me that cyrus only do mmap inside map_refresh and It 
> seemed to me that it was tcp_wrappers mmap that was causing the rist 
> ENOMEM
>
> Im trying to recompile without tcp_wrappers and check if I can clean 
> strace output a bit.
>

Actually its not tcp_wrappers.

When I start importing , I get 723 messeages like the ones below:

16677 22:43:37.184060 rt_sigaction(SIGPIPE, {SIG_IGN}, NULL, 8) = 0
16677 22:43:37.184221 mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, 
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = -1 ENOMEM (Cannot allocate memory)
16677 22:43:37.184350 time([1113011017]) = 1113011017
16677 22:43:37.184442 rt_sigaction(SIGPIPE, {0x585aa0, [], SA_RESTORER, 
0x4f4f48}, {SIG_IGN}, 8) = 0
16677 22:43:37.184540 send(5, "<19>Apr  8 22:43:37 cyrus/mupdat"..., 89, 
0) = 89
16677 22:43:37.184634 rt_sigaction(SIGPIPE, {SIG_IGN}, NULL, 8) = 0
16677 22:43:37.184782 mmap2(NULL, 10489856, PROT_READ|PROT_WRITE, 
MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = -1 ENOMEM (Cannot allocate memory)

723 mmap2 failures with ENOMEM

and on my cyrus log I get this

cyrus-fe1 cyrus/mupdate[16671]: could not start a new worker thread (not 
fatal)
cyrus-fe1 last message repeated 722 times

Im still trying to reproduce the mmap failure inside map_refresh, but 
debuging with strace -f makes cyrus too slow

---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html