squatter exits with "fatal error: Virtual memory exhausted" on huge mailbox

[Sebastian Hagedorn]

Hi,

we run 2.3.14 and we have one user with an enormous mailbox (not his 
INBOX!). It contains around 230,000 messages. We run squatter with a 
cronjob on all mailboxes. Recently this one mailbox has apparently become 
too big for squatter. When I try to squat it in verbose mode, it ends like 
this:

...
Skipping tiny document part 'b563140' (size 0)
Opening document part 's563140'
Processing index character 7, 5 total words, temp file size is 35
Processing index character 10, 152 total words, temp file size is 1064
Processing index character 13, 152 total words, temp file size is 1064
Processing index character 15, 3 total words, temp file size is 21
Processing index character 23, 5 total words, temp file size is 35
Processing index character 27, 5 total words, temp file size is 35
Processing index character 30, 3 total words, temp file size is 21
Processing index character 32, 12938 total words, temp file size is 66346
Processing index character 33, 2692 total words, temp file size is 11856
Processing index character 39, 12553 total words, temp file size is 57119
Processing index character 40, 60791 total words, temp file size is 203723
Processing index character 41, 57972 total words, temp file size is 195005
Processing index character 42, 20959 total words, temp file size is 68807
Processing index character 43, 51335 total words, temp file size is 172871
Processing index character 44, 78879 total words, temp file size is 270078
Processing index character 45, 183196 total words, temp file size is 588133
Processing index character 46, 233839 total words, temp file size is 756846
Processing index character 47, 56284 total words, temp file size is 195995
Processing index character 48, 226012 total words, temp file size is 701263
Processing index character 49, 168692 total words, temp file size is 530284
Processing index character 50, 153898 total words, temp file size is 487575
Processing index character 51, 122957 total words, temp file size is 391515
Processing index character 52, 100478 total words, temp file size is 322795
Processing index character 53, 81760 total words, temp file size is 265813
Processing index character 54, 78645 total words, temp file size is 258465
Processing index character 55, 83934 total words, temp file size is 272204
Processing index character 56, 82022 total words, temp file size is 266903
Processing index character 57, 76410 total words, temp file size is 250698
Processing index character 58, 135314 total words, temp file size is 437180
Processing index character 59, 44962 total words, temp file size is 151528
Processing index character 60, 49223 total words, temp file size is 197205
Processing index character 61, 39112 total words, temp file size is 133934
Processing index character 62, 110296 total words, temp file size is 363204
Processing index character 63, 3887 total words, temp file size is 18737
Processing index character 64, 60070 total words, temp file size is 233407
Processing index character 88, 238 total words, temp file size is 770
Processing index character 91, 22210 total words, temp file size is 88887
Processing index character 92, 1490 total words, temp file size is 6242
Processing index character 93, 17768 total words, temp file size is 75520
Processing index character 94, 226 total words, temp file size is 962
Processing index character 95, 54059 total words, temp file size is 179583
Processing index character 96, 106 total words, temp file size is 506
Processing index character 97, 389316 total words, temp file size is 1227616
Processing index character 98, 140247 total words, temp file size is 457214
Processing index character 99, 243003 total words, temp file size is 782841
Processing index character 100, 262183 total words, temp file size is 833170
Processing index character 101, 681642 total words, temp file size is 
2107147
fatal error: Virtual memory exhausted

We will try to get this user to split this mailbox or to clean it up, but I 
wondered if there is something else we can do. The machine has ample 
amounts of memory, so I'm unsure why the call to malloc would fail ...
-- 
     .:.Sebastian Hagedorn - RZKR-R1 (Gebäude 52), Zimmer 18.:.
                 .:.Regionales Rechenzentrum (RRZK).:.
.:.Universität zu Köln / Cologne University - ✆ +49-221-478-5587.:.
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 194 bytes
Desc: not available
Url : http://lists.andrew.cmu.edu/pipermail/info-cyrus/attachments/20090713/8c50e2e4/attachment.bin