SWA + Search

[mrezzonico]

Hi all,

it seems me that the "Search" button in SWA doesn't works.
Every query return the message "No Search Results Returned".

I work with "Community Edition".
Is this the problem ?

Any help is appreciated. Miche

[Valerion]

Could the Indexer not working fine. Can you search from Outlook? Also, run sxmkindex "User Name" and see if it starts to work then (after waiting a while)

[mrezzonico]

Hi Valerion,

> Can you search from Outlook?
yes

> Also, run sxmkindex "User Name" and see if it starts to work then (after waiting a while)
scalix:/home/re # sxmkindex mrezzonico
name firstname /scalix: 2
Total messages processed: 2

After 30mins it doesn't work.

Regards. Miche

[Valerion]

Have a look in the SWA logs (/var/opt/scalix/??/tomcat/logs) and see if you can spot any errors. It may also be worthwhile to do a omshowlog -e to see if there are any errors in there.

Sounds like the indexer is working fine, so the problem must be with the web client, I think.

[mrezzonico]

Hi Valerion,

thanks a lot for your suggestion.

Looking in the logs but no error found.

Regards. Miche

[jaime.pinto]

I now have this problem. Search on mail doesn't work from SWA (or squirrelmail), but it's OK from Outlook

A couple of days ago everything was fine, when another member posted a similar problem with calendar.
viewtopic.php?t=8744&highlight=search+work

I read a couple of other posts on the subject, but inconclusive:
viewtopic.php?t=7151&highlight=search+work

This is a big issue for us now. What could have happened?
Thanks

[jaime.pinto]

I did a scheduled reboot of the server yesterday, and omastat shows all services are ok. But we still can't search emails, contacts or tasks via SWA.

What am I missing?
Thanks
Jaime

[Tobias]

I follow this topic very interested. For me, search in SWA works only for contacts, not for mail and not for notes. In outlook, I can search the emails. Curious, I think .... hope for a solution for your (and my) problem.

One thing, with "task" you mean notes?

[chris]

OK, everyone, here's what you need to check:

- do you get results with sxsearch on the command line? If so, then indexed search itself is working.

- do you have the platform enabled and correctly configured in swa.properties? the relevant settings are swa.platform.url= and swa.platform.enabled=true

- what are you seeing in scalix-sis-indexer.log and scalix-sis-search.log? The indexer log records the background management of the index files and the search log records actual user searches

Once we can narrow it down with those tests, should be able to get things sorted out.

Chris

[jaime.pinto]

- do you get results with sxsearch on the command line? If so, then indexed search itself is working.

It doesn't matter the combination I use, it always returns blank

swa.platform.url=http://myserver/api
swa.platform.enabled=true

2007-09-28 12:39:28,164 INFO [main] [SISConfig.load:32] SIS initialized and ready for indexing
2007-09-29 11:23:27,136 INFO [main] [SISConfig.init:46] Starting Scalix Search and Index Service (SIS) version 11.1.0.45
2007-09-29 11:23:27,179 INFO [main] [SISConfig.loadConfigFromFile:131] SIS Indexer configuration loaded from file /var/opt/scalix/m2/sis/sis.properties
2007-09-29 11:23:27,183 INFO [main] [SISConfig.init:89] Index root is /var/opt/scalix/m2/indexes
2007-09-29 11:23:27,194 INFO [main] [SISConfig.load:32] SIS initialized and ready for indexing

2007-09-20 11:46:48,715 INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.1.0.45
2007-09-20 11:46:48,739 INFO [main] [SISConfig.load:31] SIS initialized and ready for searching
2007-09-27 09:06:28,168 INFO [main] [SISConfig.unload:124] SIS unloaded
2007-09-27 09:06:54,132 INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.1.0.45
2007-09-27 09:06:54,178 INFO [main] [SISConfig.load:31] SIS initialized and ready for searching
2007-09-28 12:38:59,090 INFO [main] [SISConfig.unload:124] SIS unloaded
2007-09-28 12:39:28,046 INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.1.0.45
2007-09-28 12:39:28,163 INFO [main] [SISConfig.load:31] SIS initialized and ready for searching
2007-09-29 11:23:27,088 INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.1.0.45
2007-09-29 11:23:27,193 INFO [main] [SISConfig.load:31] SIS initialized and ready for searching

According to omstat everything it fine

scalix-server-11.1.0.10849-1.rhel5
scalix-swa-11.1.0.51-1
scalix-text-extractors-1.0-1.rhel5
scalix-tomcat-5.5.23-292
scalix-postgres-11.1.0.45-1
scalix-res-11.1.0.45-1
scalix-sac-11.1.0.45-1
scalix-mobile-11.1.0.45-1
scalix-tomcat-connector-11.1.0.45-1.rhel5
scalix-platform-11.1.0.50-1
scalix-sis-11.1.0.45-1

[chris]

Do your users have SIS-URL's set?

[root@mailserver httpd]# omshowu -n "homer simpson"
Authentication ID: Homer.Simpson@scalix.demo
<snip>
sxidx://mailserver.scalix.demo/03300000 ... 81.861.291

The URL should look something like that.

I assume you've already run sxmkindex for your users?

What are the contents of /var/opt/scalix/*/s/indexwork ?

Chris

[jaime.pinto]

SIS URL : sxidx://myserver/071000007d132d54-312.851.57.29

What are the contents of /var/opt/scalix/*/s/indexwork ?

over 5000 files of name format "1191187763.0"

[chris]

Ok, this I've seen before. I've never seen the problem appear on 11.0.4 code or newer, but have seen it carried over. The indexer has quit working entirely, the indexwork files (which contain the indexer's work queue) are just piling up and not being processed.

You'll need to initialize the indexes for everybody, but after that things should run smoothly.

There are instructions on http://www.scalix.com/wiki/index.php?ti ... buildIndex for rebuilding the indexes.

You'll want to make sure to set IDX_MINLOAD and IDX_MAXLOAD in the general.cfg to ensure that indexing doesn't negatively impact server performance.

Chris

[tantony]

Hi chris,

I have the same problem with 11.1, but it seems that i have a different problem then jaime.

I get a result with sxsearch and have a socket below /var/opt/scalix/ml/s/indexwork/ and two files (HEARTBEAT and 1191228874.0).
The settings are correct in swa.properties, checked all with omscan, rebuild the index 3 times for all users and the user have SIS-URL set.

Code: Select all

[root@mail ~]# sxsearch --direct=Test "tantony@DOMAIN.LOCAL"
0.208878 000195a4c2b77501 00011e31de43513f


Code: Select all

[root@mail logs]# omstat -a
PC Monitor                    Started        NON-STOP       0
Directory Relay Server        Started        09.26.07
Notification Server           Started        09.26.07       0
Shared memory daemon          Started        NON-STOP
Notification Monitor          Started        NON-STOP
Session Monitor               Started        NON-STOP
Indexer                       Started        NON-STOP
Stats Daemon                  Started        NON-STOP
Container Access Monitor      Started        NON-STOP
Item Structure Server         Started        09.26.07
Database Monitor              Started        09.26.07
Licence Monitor Daemon        Started        NON-STOP
LDAP Daemon                   Started        09.26.07
Queue Manager                 Started        NON-STOP
Item Delete Daemon            Started        NON-STOP
IMAP Server Daemon            Started        09.26.07
SMTP Relay                    Started        09.26.07
Mime Browser Controller       Started        09.26.07
Event Server                  Started        09.26.07


Code: Select all

[root@mail ~]# tail /var/opt/scalix/ml/tomcat/logs/scalix-sis-indexer.log
2007-10-01 11:09:39,824  INFO [QueueManager] [BatchUpdater.processMods:149] User 05400000e2b13d64-4.552.861.291: added 1 content, added 1 refs, deleted 1 content, deleted 1 refs in 35 ms
2007-10-01 11:10:33,870  INFO [QueueManager] [BatchUpdater.processMods:149] User 07300000e2b13d64-4.552.861.291: added 0 content, added 0 refs, deleted 0 content, deleted 1 refs in 2 ms


Code: Select all

[root@mail ~]# tail /var/opt/scalix/ml/tomcat/logs/scalix-sis-search.log
2007-09-26 01:08:14,934 ERROR [TP-Processor47] [SearchEngine.search:51] Index for user 0b600000e2b13d64-4.552.861.291 does not exist
2007-09-26 01:08:14,935 ERROR [TP-Processor47] [WebUtil.errorResponse:63] Error in search engine
2007-09-26 01:08:21,256 ERROR [TP-Processor34] [SearchEngine.search:51] Index for user 0b600000e2b13d64-4.552.861.291 does not exist
2007-09-26 01:08:21,256 ERROR [TP-Processor34] [WebUtil.errorResponse:63] Error in search engine
2007-09-26 01:08:21,916 ERROR [TP-Processor39] [SearchEngine.search:51] Index for user 0b600000e2b13d64-4.552.861.291 does not exist
2007-09-26 01:08:21,917 ERROR [TP-Processor39] [WebUtil.errorResponse:63] Error in search engine
2007-09-26 01:08:24,413 ERROR [TP-Processor23] [SearchEngine.search:51] Index for user 0b600000e2b13d64-4.552.861.291 does not exist
2007-09-26 01:08:24,414 ERROR [TP-Processor23] [WebUtil.errorResponse:63] Error in search engine
2007-09-26 01:08:30,178 ERROR [TP-Processor45] [SearchEngine.search:51] Index for user 0b600000e2b13d64-4.552.861.291 does not exist
2007-09-26 01:08:30,178 ERROR [TP-Processor45] [WebUtil.errorResponse:63] Error in search engine


The files log.* below ~/logs contains only not readable data (garbage).

Could you please give me an example how IDX_MINLOAD and IDX_MAXLOAD should look like with a quad core cpu.


Thomas

[savant]

Hi folks,

I have a similar problem as tantony does.

I cannot use search from within Outlook or SWA at all, but I can use sxsearch from the shell and get results just fine.

What he posted resembles my situation pretty exactly, only difference being that I'm running 11.2-GA vs. 11.1.

I just upgraded our Scalix server from a dedicated machine running FC4 and 10.0.x to a VMWare-hosted FC7 one and imported/upgraded the message store. Things are working fine, except for this issue.

Code: Select all

[root@klmcom logs]# omstat -a
PC Monitor                    Started        NON-STOP       0
Directory Relay Server        Started        13:54:46       
Notification Server           Started        13:54:46       0
Shared memory daemon          Started        NON-STOP       
Notification Monitor          Started        NON-STOP       
Session Monitor               Started        NON-STOP       
Indexer                       Started        NON-STOP       
Stats Daemon                  Started        NON-STOP       
Container Access Monitor      Started        NON-STOP       
Item Structure Server         Stopped        01.10.07       
Database Monitor              Started        13:54:46       
Licence Monitor Daemon        Started        NON-STOP       
LDAP Daemon                   Started        13:54:46       
Queue Manager                 Started        NON-STOP       
Item Delete Daemon            Started        NON-STOP       
IMAP Server Daemon            Started        13:54:46       
SMTP Relay                    Started        13:54:46       
Mime Browser Controller       Started        13:54:46       
Event Server                  Started        13:54:46

Code: Select all

[root@klmcom logs]# tail scalix-sis-indexer.log
2007-10-02 14:26:42,401  INFO [QueueManager] [BatchUpdater.processMods:149] User 0b50000068fdaf34-03.01.861.291: added 0 content, added 1 refs, deleted 1 content, deleted 3 refs in 41 ms
2007-10-02 14:27:10,021  INFO [QueueManager] [BatchUpdater.processMods:149] User 0950000068fdaf34-03.01.861.291: added 0 content, added 1 refs, deleted 0 content, deleted 1 refs in 34 ms
2007-10-02 14:39:38,306  INFO [QueueManager] [BatchUpdater.processMods:149] User 2a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 0 content, deleted 0 refs in 46 ms
2007-10-02 14:41:01,583  INFO [QueueManager] [BatchUpdater.processMods:149] User 3a50000068fdaf34-03.01.861.291: added 0 content, added 1 refs, deleted 0 content, deleted 1 refs in 539 ms
2007-10-02 14:41:20,035  INFO [QueueManager] [BatchUpdater.processMods:149] User 2a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 0 content, deleted 0 refs in 104 ms
2007-10-02 14:42:57,506  INFO [QueueManager] [BatchUpdater.processMods:149] User 0a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 0 content, deleted 1 refs in 174 ms
2007-10-02 14:43:21,981  INFO [QueueManager] [BatchUpdater.processMods:149] User 2a50000068fdaf34-03.01.861.291: added 0 content, added 0 refs, deleted 0 content, deleted 3 refs in 13 ms
2007-10-02 14:43:46,114  INFO [QueueManager] [BatchUpdater.processMods:149] User 2a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 0 content, deleted 4 refs in 69 ms
2007-10-02 14:44:02,668  INFO [QueueManager] [BatchUpdater.processMods:149] User 2a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 0 content, deleted 1 refs in 75 ms
2007-10-02 14:45:40,064  INFO [QueueManager] [BatchUpdater.processMods:149] User 0a50000068fdaf34-03.01.861.291: added 1 content, added 1 refs, deleted 1 content, deleted 1 refs in 146 ms

Code: Select all

sxsearch --direct=vpn "Simon Lastname"
0,000000 .938779 000196ed9eb36e74
12,000000 bff7da097 0.835259
1537,000000 d68138ae6 00012e15b6a412ab
0,000000 .759394 000195299249a1d4
12,000000 bff7da097 0.110619
15723,000000 b7acef44 00012e15b6a412ab
0,000000 .058665 0001664097da72ba
12000000112328704,000000 b6a412ab 0.055310
15,000000 c60a8fff4c9 00012e15b6a412ab
0,000000 .048887 0001a4f6562f94d9
12,000000 bff7da097 0.048887
1,000000 afbcb3079b7a 00012e0bff7da097
0,000000 .048396 000170c112e1c6e9
12,000000 bff7da097 0.047900
16644,000000 b328d9fe 00012e15b6a412ab
0,000000 .041482 000159aba5a6c342
12,000000 bff7da097 0.039110
151,000000 fe7d24e33d 00012e0bff7da097
0,000000 .035925 00017224580d3ac4
12000000112328704,000000 b6a412ab 0.034569
15,000000 c9a4fba03b4 00012e0bff7da097
0,000000 .034569 00015c9b93d94c21
12,000000 bff7da097 0.034569
1,000000 b32a3e9ca4ea 00012e0bff7da097
0,000000 .034569 00019af2f567eaf6

Code: Select all

relevant error message from /var/opt/scalix/*/tomcat/logs/scalix-sis-search.log

2007-10-01 14:12:35,736 ERROR [TP-Processor70] [WebUtil.errorResponse:63] Invalid search query
2007-10-01 14:12:46,511 ERROR [TP-Processor17] [WebUtil.errorResponse:63] Invalid search query
2007-10-01 14:36:08,448 FATAL [TP-Processor73] [SearchEngine.searchContent:190] Failed to parse user query
org.apache.lucene.queryParser.ParseException: Encountered ")" at line 1, column 125.
Was expecting one of:
    <NOT> ...
    "+" ...
    "-" ...
    "(" ...
    <QUOTED> ...
    <TERM> ...
    <PREFIXTERM> ...
    <WILDTERM> ...
    "[" ...
    "{" ...
    <NUMBER> ...
   
        at org.apache.lucene.queryParser.QueryParser.generateParseException(QueryParser.java:1226)
        at org.apache.lucene.queryParser.QueryParser.jj_consume_token(QueryParser.java:1109)
        at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:759)
        at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:684)
        at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:745)
        at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:684)
        at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:745)
        at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:712)
        at org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:745)
        at org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:684)
        at org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:122)
        at com.scalix.search.engine.QueryUtil.createContentQuery(QueryUtil.java:54)
        at com.scalix.search.engine.SearchEngine.searchContent(SearchEngine.java:188)
        at com.scalix.search.engine.SearchEngine.search(SearchEngine.java:78)
        at com.scalix.search.web.InternalSearchServlet.doSearch(InternalSearchServlet.java:167)
        at com.scalix.search.web.InternalSearchServlet.doGet(InternalSearchServlet.java:97)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:690)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
        at com.scalix.sis.web.IPFilter.doFilter(IPFilter.java:68)
        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
        at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:210)
        at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:174)
        at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:433)
        at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
        at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
        at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
        at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:151)
        at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:200)
        at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:283)
        at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:773)
        at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:703)
        at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:895)
        at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:685)
        at java.lang.Thread.run(Unknown Source)

This did not repeat later, though - I restarted the services (scalix and scalix-tomcat) and triggered a search via SWA and Outlook, no line in the log about it, but still no search results...

I really like the new release, but my users are getting restless over not being able to search - rebuilding indices with sxmkindex did not change anything. And as noted before, sxsearch from command line works fine.

The swa.properties settings are correct as well, SIS-URLs are set for all users.

Hope you guys figure this out

Regards,
Simon.