i imported all users via sxmboximp.
we have a 22gb mail store, some 30 or more users.
after all users logged in the indexer kicked in. I am throttling it via
IDX_MAXLOAD=4
IDX_MINLOAD=1
in general.cfg so that it doesn't kill the box.
The indexer shows partially aborted after a period of time. The logs indicate that it gets stuck at a point after an hour or so.
I have already tried ulimit -n 10000, that didn't change things.
I now set it to an excessive value ulimit -n 50000
Am waiting to see what will happen.
Relevant logs are below. Can anyone shed some light on whats going on and how to fix it?
TIA
/var/opt/scalix/xx/tomcat/logs/scalix-sis-indexer.log shows
2007-03-28 19:45:40,100 INFO [main] [SISConfig.load:32] SIS initialized and ready for indexing
2007-03-28 19:46:01,641 INFO [QueueManager] [BatchUpdater.processMods:219] User 0d100000afb09064-2.62.861.291: added 0 content, added 46 refs, deleted 0 content, deleted 48 refs in 1360 ms
2007-03-28 20:54:09,515 INFO [QueueManager] [BatchUpdater.processMods:219] User 0d100000afb09064-2.62.861.291: added 0 content, added 98 refs, deleted 0 content, deleted 102 refs in 1232 ms
2007-03-28 20:54:12,159 INFO [QueueManager] [BatchUpdater.processMods:219] User 0d100000afb09064-2.62.861.291: added 0 content, added 100 refs, deleted 1 content, deleted 99 refs in 815 ms
2007-03-28 20:54:13,240 INFO [QueueManager] [BatchUpdater.processMods:219] User 0d100000afb09064-2.62.861.291: added 0 content, added 101 refs, deleted 0 content, deleted 101 refs in 1078 ms
2007-03-28 20:54:43,949 INFO [QueueManager] [BatchUpdater.processMods:219] User 0d100000afb09064-2.62.861.291: added 61 content, added 73 refs, deleted 0 content, deleted 20 refs in 4481 ms
/var/opt/scalix/xx//tomcat/logs/scalix-sis-search.log
2007-03-28 19:45:40,098 INFO [main] [SISConfig.load:31] SIS initialized and ready for searching
2007-03-28 20:34:56,051 ERROR [TP-Processor10] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:34:56,088 ERROR [TP-Processor10] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:35:03,440 ERROR [TP-Processor12] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:35:03,441 ERROR [TP-Processor12] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:35:06,359 ERROR [TP-Processor3] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:35:06,360 ERROR [TP-Processor3] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:35:09,491 ERROR [TP-Processor6] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:35:09,492 ERROR [TP-Processor6] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:35:14,233 ERROR [TP-Processor7] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:35:14,234 ERROR [TP-Processor7] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:35:18,530 ERROR [TP-Processor5] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:35:18,531 ERROR [TP-Processor5] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:47:17,039 ERROR [TP-Processor2] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:47:17,039 ERROR [TP-Processor2] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:47:19,981 ERROR [TP-Processor8] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:47:19,982 ERROR [TP-Processor8] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:47:23,520 ERROR [TP-Processor16] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:47:23,520 ERROR [TP-Processor16] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:47:25,881 ERROR [TP-Processor5] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:47:25,882 ERROR [TP-Processor5] [WebUtil.errorResponse:63] Error in search engine
2007-03-28 20:47:28,055 ERROR [TP-Processor11] [SearchEngine.search:51] Index for user 03300000afb09064-2.62.861.291 does not exist
2007-03-28 20:47:28,056 ERROR [TP-Processor11] [WebUtil.errorResponse:63] Error in search engine
/var/opt/scalix/xx/s/logs/fatal shows
SERIOUS ERROR Indexer (Indexer ) Wed Mar 28 20:06:13 2007
[OM 10270] Process about to terminate due to error.
Signal (Segmentation Violation) trapped by process 3482
Procedure trace follows:
-> handleMatureRequests
<- handleMatureRequests
-> deleteFinishedFiles
<- deleteFinishedFiles
-> readQueue
<- readQueue
-> handleMatureRequests
<- handleMatureRequests
-> deleteFinishedFiles
<- deleteFinishedFiles
-> readQueue
<- readQueue
-> handleMatureRequests
-> sis_connect
<- sis_connect
-> sis_index
Pid of logging process: 3482
SERIOUS ERROR Indexer (Indexer ) Wed Mar 28 20:06:13 2007
[OM 10272] BACKTRACE:
/opt/scalix/lib/libom_er.so(er_add_backtrace+0xc6)[0x853ee6]
/opt/scalix/lib/libom_er.so[0x8541e6]
/opt/scalix/lib/libom_er.so(er_DumpProcAndExit+0x1f)[0x85438f]
/lib/tls/libpthread.so.0[0x6f7898]
/lib/tls/libc.so.6(_IO_fwrite+0x13e)[0x4f6c6e]
/opt/scalix/lib/libom_mdc.so(mdc_fwrite+0x43)[0xd994c3]
/opt/scalix/lib/libom_sis.so(sis__do_post+0x1c5)[0xbb80e5]
/opt/scalix/lib/libom_sis.so(sis_index+0x10d)[0xbb716d]
indexer[0x804b1b6]
/lib/tls/libc.so.6(__libc_start_main+0xd3)[0x4b7de3]
indexer[0x8049721]
Pid of logging process: 3482
