search doesn't work for me in SWA - exception in swa.log

[struempelix]

Hello,

I've setup scalix 11.0.3 on debian etch and it's running almost perfect (including Outlook connector).

However I'm facing an issue with the search functionality in SWA since 11.0.0 which never disappeared after upgrading to 0.1, 0.2 and 0.3. So I guess it's a very specific configuration issue.

When I put a "string" into the search box and I press the search button the search window appears but it never returns any result back. At the same time a UTILITY:SillyString exeption is thrown in scalix-swa.log.

I tried out all the hints I found in the forum like recreating the index, search on command line (which works) and so on but could not fix the problem

Could somebody advise me what I need to verify?

thanks,
jens

2007-04-16 12:19:48,019 DEBUG [SillyString.expandCapacity:149] UTILITY:SillyString -- expandCapcity
java.lang.Throwable: SillyString
at com.oddpost.util.SillyString.expandCapacity(SillyString.java:148)
at com.oddpost.util.SillyString.append(SillyString.java:504)
at com.oddpost.util.GeneralUtils.getStackTraceInner(GeneralUtils.java:191)
at com.oddpost.util.GeneralUtils.getStackTrace(GeneralUtils.java:158)
at com.oddpost.soap.SoapFault.<init>(SoapFault.java:135)
at com.oddpost.soap.SoapFault.<init>(SoapFault.java:116)
at com.oddpost.server.module.SoapMail.search(SoapMail.java:724)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at com.oddpost.soap.SoapModule.invokeMethod(SoapModule.java:231)
at com.oddpost.soap.SoapRequestImpl.execute(SoapRequestImpl.java:139)
at com.oddpost.server.HttpRequestHandler.handleRequest(HttpRequestHandler.java:228)
at com.oddpost.server.SoapServlet.doPost(SoapServlet.java:49)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.oddpost.server.filter.HttpConfFilter.doFilter(HttpConfFilter.java:174)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.jk.server.JkCoyoteHandler.invoke(JkCoyoteHandler.java:199)
at org.apache.jk.common.HandlerRequest.invoke(HandlerRequest.java:282)
at org.apache.jk.common.ChannelSocket.invoke(ChannelSocket.java:754)
at org.apache.jk.common.ChannelSocket.processConnection(ChannelSocket.java:684)
at org.apache.jk.common.ChannelSocket$SocketConnection.runIt(ChannelSocket.java:876)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)

################


DEBUG [HttpRequestHandler.sendResponse:301] ip: xxx.xxx.xxx.xxx; username: jens; message: <SOAP-ENV:Fault><faultcode>SOAP-ENV:SERVER.ConnectException</faultcode><faultstring>Connection refused

</faultstring><detail><e:ConnectException xmlns:e="http://scalix.com/errors"><message>Connection refused

</message><debug>java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333)
at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195)
at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
at java.net.Socket.connect(Socket.java:519)
at java.net.Socket.connect(Socket.java:469)
at java.net.Socket.&lt;init&gt;(Socket.java:366)
at java.net.Socket.&lt;init&gt;(Socket.java:239)
at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:79)
at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:121)
at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:706)
at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1321)

[struempelix]

Could somebody who is running scalix 11.0.3 on Debian confirm that SWA search is working in principle?

Thanks,
jens

[ScalixSupport]

Hi!

Could you please reply to me with the results of commands below:
rpm -qa | grep scalix
ps ax | grep index
ps ax | grep tomcat

Can you check for the error_log and access_log of apache if you see any error while trying
to search in SWA.

Thanks,
Subir

[struempelix]

Hi Subir,

dpkg --list | grep scalix returns:

Code: Select all


dpkg --list | grep scalix
ii  scalix-mobile                      11.0.3.31                       Scalix Mobile Web Client
ii  scalix-platform                    11.0.3.31                       Scalix Messaging Services
ii  scalix-postgres                    11.0.3.31                       Scalix scripts for PostgreSQL
ii  scalix-res                         11.0.3.31                       A Remote Execution Service for Scalix Messag
ii  scalix-sac                         11.0.3.31                       The Ubermanager component of the Scalix Admi
ii  scalix-server                      11.0.3.10719                    Scalix-server is an enterprise class messagi
ii  scalix-sis                         11.0.3.31                       Scalix Search and Index Services
ii  scalix-swa                         11.0.3.31                       Scalix Web Access
ii  scalix-text-extractors             1.0-2                           Helper programs to extract text from a varie
ii  scalix-tomcat                      5.5.16-226                      Apache Tomcat is the servlet container that
ii  scalix-tomcat-connector            11.0.3.31                       Module for connecting Tomcat and Apache via



ps ax | grep index returns:

Code: Select all


bug:/var/log/apache2# ps ax | grep index
 5353 ?        Ss     0:13 indexer
 5354 ?        S      0:02 index.catcher
 5503 ?        S      0:09 /opt/scalix/bin/index.browse
 5716 ?        S      0:09 /opt/scalix/bin/index.browse
 6741 ?        S      0:08 /opt/scalix/bin/index.browse
 6819 ?        S      0:08 /opt/scalix/bin/index.browse
 6820 ?        S      0:08 /opt/scalix/bin/index.browse
 6821 ?        S      0:08 /opt/scalix/bin/index.browse
 6822 ?        S      0:09 /opt/scalix/bin/index.browse
 6823 ?        S      0:09 /opt/scalix/bin/index.browse
 6824 ?        S      0:08 /opt/scalix/bin/index.browse
 6825 ?        S      0:09 /opt/scalix/bin/index.browse
 6827 ?        S      0:09 /opt/scalix/bin/index.browse
 6828 ?        S      0:09 /opt/scalix/bin/index.browse
 6829 ?        S      0:10 /opt/scalix/bin/index.browse
 6830 ?        S      0:10 /opt/scalix/bin/index.browse
 6831 ?        S      0:09 /opt/scalix/bin/index.browse
 6832 ?        S      0:09 /opt/scalix/bin/index.browse
 6833 ?        S      0:10 /opt/scalix/bin/index.browse
 6834 ?        S      0:09 /opt/scalix/bin/index.browse
 7322 ?        S      0:10 /opt/scalix/bin/index.browse
 7323 ?        S      0:10 /opt/scalix/bin/index.browse
  527 pts/1    R+     0:00 grep index

 

ps ax | grep tomcat returns:

Code: Select all


bug:/var/log/apache2# ps ax | grep tomcat
32545 pts/1    Sl     1:17 /usr/lib/jvm/java-1.5.0-sun/jre/bin/java -server -Xms256m -Xmx256m -Dscalix.instance=/var/opt/scalix/bg -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/var/opt/scalix/bg/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/scalix-tomcat/common/endorsed -classpath /usr/lib/jvm/java-1.5.0-sun/jre/lib/tools.jar:/opt/scalix-tomcat/bin/bootstrap.jar:/opt/scalix-tomcat/bin/commons-logging-api.jar -Dcatalina.base=/var/opt/scalix/bg/tomcat -Dcatalina.home=/opt/scalix-tomcat -Djava.io.tmpdir=/var/opt/scalix/bg/tomcat/temp org.apache.catalina.startup.Bootstrap start



I don't see any entries in access or error.log when I press the search button directly. But I see some periodic entries in the error.log

Code: Select all

Wed Apr 18 01:45:43 2007] [error] [client xx.xxx.xxx.xxx] client sent HTTP/1.1 request without hostname (see RFC2616 section 14.23): /w00tw00t.at.ISC.SANS.DFind:)
[Wed Apr 18 13:59:52 2007] [error] (111)Connection refused: proxy: AJP: attempt to connect to xx.xxx.xxx.xxx:8009 (test.example.com) failed
[Wed Apr 18 13:59:53 2007] [error] ap_proxy_connect_backend disabling worker for (test.example.com)
[Wed Apr 18 13:59:53 2007] [error] proxy: AJP: failed to make connection to backend: test.example.com
[Wed Apr 18 14:20:51 2007] [error] [client xx.xxx.xxx.xxx] client sent HTTP/1.1 request without hostname (see RFC2616 section 14.23): /w00tw00t.at.ISC.SANS.DFind:)


the access log is full of:

Code: Select all


[18/Apr/2007:15:31:32 +0200] "GET /sis/indexer?fn=delete&uid=0710000076013f54-302.78.412.58&dref=00012e088f9bcffb&pdref=00010ff524a3d4c6 HTTP/1.1" 200 4 "-" "-"
85.214.87.203 - - [18/Apr/2007:15:33:37 +0200] "GET /sis/indexer?fn=add&uid=0d10000076013f54-302.78.412.58&pdref=00011c00a616f5a9&dref=00012ced74c0e290&indexid=cb57d655-45f31067-46261e29-14bf5&flags=unseen,unflagged,unanswered,undeleted,undraft,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 204 4 "-" "-"



Thanks,
jens

[ScalixSupport]

Hi Jens!

What is the result for "lsof -i:8009"?

Thanks,
Subir

[struempelix]

Hi Subir,

lsof -i:8009 gives me 50 lines of:

apache2 1346 www-data 13u IPv4 8460341 TCP test.example.com:34849->test.example.com:8009 (ESTABLISHED)

and 50 lines of:

java 32545 root 26u IPv6 8459922 TCP test.example.com:8009->test.example.com:53393 (ESTABLISHED)

mmh, the java processes are bound to IPv6, could that be the problem?

Thanks,
jens

[ScalixSupport]

Hi Jens,

What is the contents of the file /etc/opt/scalix-tomcat/scalix-tomcat.conf?

Thanks,
Subir

[struempelix]

Hi Subir,
/etc/opt/scalix-tomcat/scalix-tomcat.conf contains:

Code: Select all

#
# Configuration file for Scalix Tomcat
#

# The directory where Java is installed
# (determined from /usr/bin/java managed by update-alternatives
# by default, change to hardcoded path if needed):
JAVA_HOME="`/opt/scalix-tomcat/bin/determine-java-home`"

# Additional arguments to be passed to Java:
JAVA_OPTS="-server -Xms256m -Xmx256m"


Cheers,
jens

[ScalixSupport]

Hey Jens!

For me the scalix-tomcat.conf file is:

#
# Configuration file for Scalix Tomcat
#

# The directory where Java is installed:
JAVA_HOME="/usr/java/jre1.5.0_06"

# Additional arguments to be passed to Java:
JAVA_OPTS="-server -Djava.net.preferIPv4Stack=true -Xms512m -Xmx512m"

Edit your file to have an additional option -Djava.net.preferIPv4Stack=true, restart
scalix-tomcat service and see if it benefits towards issue resolution.

Thanks,
Subir

[struempelix]

Hello Subir,
I already did that after seeing the IPv6 stuff in the lsof result. So my apache + tomcat are talking IPv4 only now, but the issue still happens.
Also, the exceptions in the swa.log is still the same. I thought that the
connection exception could have been related to the IPv6 thing. But it
still there as well as the SillyString exception.

Code: Select all

ps -ef | grep java
root      6298     1  1 14:14 pts/1    00:01:45 /usr/lib/jvm/java-1.5.0-sun/jre/bin/java -server -Xms256m -Xmx256m -Djava.net.preferIPv4Stack=true -Dscalix.instance=/var/opt/scalix/bg -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/var/opt/scalix/bg/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/scalix-tomcat/common/endorsed -classpath /usr/lib/jvm/java-1.5.0-sun/jre/lib/tools.jar:/opt/scalix-tomcat/bin/bootstrap.jar:/opt/scalix-tomcat/bin/commons-logging-api.jar -Dcatalina.base=/var/opt/scalix/bg/tomcat -Dcatalina.home=/opt/scalix-tomcat -Djava.io.tmpdir=/var/opt/scalix/bg/tomcat/temp org.apache.catalina.startup.Bootstrap start


Cheers,
jens

[ScalixSupport]

Hi Jens!

I would request you to install jre1.5.0_06 instead of that currently installed java-1.5.0-sun,
you can find the RPM at scalix-11.0.3-GA/third_party/jre/i386/jre-1_5_0_06-linux-i586.rpm
in the installer folder location. I am not too sure if the JRE installer mentioned above works in
Debian as well. If not, try searching a suitable one.

Also, make sure if the command "/opt/scalix-tomcat/bin/determine-java-home" works and
gives correct results on command-line.

Can you send the result of the command java -version.

Thanks,
Subir

[struempelix]

Hi Subir,
I did an jre update form 1.5.0_10-b3 (debian stable) to 1.5.0_11b3 (unstable) last week without positive impact on my problem.

I couldn't find 1.5.0_06 on java.com, So I'll try now extract the jre from the rpm and hope it installs. My experience with alien are not the best, so I don't want to convert the rpm to a deb.

I think determine-java-home works:

Code: Select all

java -version
java version "1.5.0_11"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_11-b03)
Java HotSpot(TM) Client VM (build 1.5.0_11-b03, mixed mode, sharing)


Anyhow, would be great if another debian user could confirm what version of JAVA is used and / or if SWA-Search is working fine.

Thanks,
jens

[ScalixSupport]

Hi Jens!

The command "java -version" returns 1.5.0_11 while the classpath in "ps -ef | grep java"
shows "/usr/lib/jvm/java-1.5.0-sun/jre/lib/tools.jar". Can you check the result of the command
"/usr/lib/jvm/java-1.5.0-sun/jre/bin/java -version"?

Thanks,
Subir

[struempelix]

Hi Subir,
/usr/lib/jvm/java-1.5.0-sun/jre/bin/java -version returns:

Code: Select all

java version "1.5.0_11"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_11-b03)
Java HotSpot(TM) Client VM (build 1.5.0_11-b03, mixed mode, sharing)


java-1.5.0-sun is a softlink to java-1.5.0-sun-1.5.0.11

Thanks,
jens

[ScalixSupport]

Hi!

Can you run the command "sxmkindex -r 00:00:00", see if search works now?

Thanks,
Subir