No access to /sac /webmail after upgrade from 10.0.1 to 11.0

[larsstig]

I upgrade from 10.0.1 to 11.0.2 on RHEL4
After upgrading I get the error from tomcat:
HTTP Status 404 - /webmail

type Status report

message /webmail

description The requested resource (/webmail) is not available.
Apache Tomcat/5.5.16

I also see a bunch of errors in /var/log/httpd/mod_jk.log:
[Wed Mar 28 15:16:37 2007] [info] ajp_service::jk_ajp_common.c (1749): Sending request to tomcat f
ailed, recoverable operation attempt=1
[Wed Mar 28 15:16:47 2007] [info] ajp_send_request::jk_ajp_common.c (1178): Socket 16 is not conne
cted any more (errno=-1)
[Wed Mar 28 15:16:47 2007] [info] ajp_send_request::jk_ajp_common.c (1202): Error sending request.
Will try another pooled connection
[Wed Mar 28 15:16:47 2007] [info] ajp_send_request::jk_ajp_common.c (1225): All endpoints are disc
onnected or dead
[Wed Mar 28 15:16:47 2007] [info] ajp_service::jk_ajp_common.c (1749): Sending request to tomcat f
ailed, recoverable operation attempt=1

tomcat is running:

# service scalix-tomcat status
Instance (comm) is running
ps aux | grep tomcat
root 9857 1.5 8.2 455796 63872 pts/1 Sl 15:15 0:12 /usr/java/jre1.5.0_06/bin/java -server -Djava.net.preferIPv4Stack=true -Xms256m -Xmx256m -Dscalix.instance=/var/opt/scalix/cm -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/var/opt/scalix/cm/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/scalix-tomcat/common/endorsed -classpath /usr/java/jre1.5.0_06/lib/tools.jar:/opt/scalix-tomcat/bin/bootstrap.jar:/opt/scalix-tomcat/bin/commons-logging-api.jar -Dcatalina.base=/var/opt/scalix/cm/tomcat -Dcatalina.home=/opt/scalix-tomcat -Djava.io.tmpdir=/var/opt/scalix/cm/tomcat/temp org.apache.catalina.startup.Bootstrap start
root 10911 0.0 0.0 4936 644 pts/1 R+ 15:28 0:00 grep tomcat


Any ideas?

Thanks,
-ls

[ScalixSupport]

Hi!

Can you run the scalix installer and re-configure the following components:
Scalix Messaging Services
Scalix PostgreSQL Database Integration
Scalix Apache/Tomcat Connector
Scalix Tomcat

Thanks,
Subir

[larsstig]

I reconfigured the following:

Scalix Messaging Services
Scalix PostgreSQL Database Integration
Scalix Tomcat

I could not reconfigure Scalix Apache/Tomcat Connector, the Scalix installer reports it as not reconfigurable,

This did not fix the problem.

-ls

[ScalixSupport]

Hi!

Ok, moving forward, restart scalix-tomcat service, check the result with the command
"ps -ax | grep tomcat", if you find more than one instances of tomcat service kill both
gracefully/forcefully and start scalix-tomcat afresh. Next, what is that result for command
"java -version", this command ideally should give the JRE version and should run from
anywhere.

Thanks,
Subir

[larsstig]

Ok here's the commands I ran and output. Only one tomcat is running, and java -version is the version that was installed by scalix-installer.

Code: Select all

[root@comm scalix-11.0.2.1-GA]# /etc/init.d/scalix-tomcat stop
Stopping Tomcat service (comm):                            [  OK  ]
[root@comm scalix-11.0.2.1-GA]# ps aux | grep tomcat
root     18286  0.0  0.0  5144  648 pts/1    S+   08:02   0:00 grep tomcat
[root@comm scalix-11.0.2.1-GA]# /etc/init.d/scalix-tomcat start
Starting Tomcat service (comm):                            [  OK  ]
[root@comm scalix-11.0.2.1-GA]# ps aux | grep tomcat
root     18329  103  5.9 444364 46440 pts/1  Rl   08:03   0:06 /usr/java/jre1.5.0_06/bin/java -server -Djava.net.preferIPv4Stack=true -Xms256m -Xmx256m -Dscalix.instance=/var/opt/scalix/cm -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.config.file=/var/opt/scalix/cm/tomcat/conf/logging.properties -Djava.endorsed.dirs=/opt/scalix-tomcat/common/endorsed -classpath /usr/java/jre1.5.0_06/lib/tools.jar:/opt/scalix-tomcat/bin/bootstrap.jar:/opt/scalix-tomcat/bin/commons-logging-api.jar -Dcatalina.base=/var/opt/scalix/cm/tomcat -Dcatalina.home=/opt/scalix-tomcat -Djava.io.tmpdir=/var/opt/scalix/cm/tomcat/temp org.apache.catalina.startup.Bootstrap start
root     18343  0.0  0.0  4000  644 pts/1    R+   08:03   0:00 grep tomcat
[root@comm scalix-11.0.2.1-GA]# java -version
java version "1.5.0_06"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_06-b05)
Java HotSpot(TM) Client VM (build 1.5.0_06-b05, mixed mode, sharing)


Still no luck.

Appreciate your help, thanks,

-ls

[ScalixSupport]

Hi!

Do send the catalina logs which you could find at /var/opt/scalix/??/tomcat/logs/ folder.

Thanks,
Subir

[larsstig]

Catalina log from today:

Code: Select all

INFO: Starting Servlet Engine: Apache Tomcat/5.5.16
Mar 29, 2007 6:58:27 AM org.apache.catalina.core.StandardHost start
INFO: XML validation disabled
Mar 29, 2007 6:58:31 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on comm.sorensenIT.com/172.16.1.3:8009
Mar 29, 2007 6:58:31 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=1/754  config=null
Mar 29, 2007 6:58:31 AM org.apache.catalina.storeconfig.StoreLoader load
INFO: Find registry server-registry.xml at classpath resource
Mar 29, 2007 6:58:32 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 5651 ms
Mar 29, 2007 8:02:41 AM org.apache.catalina.core.StandardService stop
INFO: Stopping service Catalina
Mar 29, 2007 8:02:41 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: Failed shutdown of Apache Portable Runtime
Mar 29, 2007 8:03:14 AM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The Apache Tomcat Native library which allows optimal performance in production environments
was not found on the java.library.path: /usr/java/jre1.5.0_06/lib/i386/server:/usr/java/jre1.5.0_06
/lib/i386:/usr/java/jre1.5.0_06/../lib/i386
Mar 29, 2007 8:03:14 AM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 3142 ms
Mar 29, 2007 8:03:15 AM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Mar 29, 2007 8:03:15 AM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/5.5.16
Mar 29, 2007 8:03:15 AM org.apache.catalina.core.StandardHost start
INFO: XML validation disabled
Mar 29, 2007 8:03:18 AM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on comm.sorensenIT.com/172.16.1.3:8009
Mar 29, 2007 8:03:18 AM org.apache.jk.server.JkMain start
INFO: Jk running ID=0 time=0/176  config=null
Mar 29, 2007 8:03:18 AM org.apache.catalina.storeconfig.StoreLoader load
INFO: Find registry server-registry.xml at classpath resource
Mar 29, 2007 8:03:19 AM org.apache.catalina.startup.Catalina start
INFO: Server startup in 4836 ms


I do see an error not finding the Tomcat native library. Is this the cause? How do I fix this?

Thanks,

-ls

[ScalixSupport]

Hi!

This seems OK to me, did you see some errors in error_log or access_log in /var/log/httpd
folder?

Thanks,
Subir

[larsstig]

There's a number of these in the access_log:

Code: Select all

172.16.1.3 - - [29/Mar/2007:23:10:12 -0500] "GET /sis/indexer?fn=add&uid=53200000f5177744-3.1.61.271&pdref=00011a077b
8dece3&dref=0001021f576aebec&indexid=30110ac-4477715f-460a9aff-1c&flags=unseen,unflagged,unanswered,undeleted,undraft
,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 404 9
88 "-" "-"
172.16.1.3 - - [29/Mar/2007:23:10:22 -0500] "GET /sis/indexer?fn=add&uid=53200000f5177744-3.1.61.271&pdref=00011a077b
8dece3&dref=0001021f576aebec&indexid=30110ac-4477715f-460a9aff-1c&flags=unseen,unflagged,unanswered,undeleted,undraft
,unlabel1,unlabel2,unlabel3,unlabel4,unlabel5,unlabel6,unlabel7,unlabel8,unjunk,unnonjunk,unforwarded HTTP/1.1" 404 9
88 "-" "-"



Nothing in the error_log

-ls

[ScalixSupport]

Hi!

Can you check if Tomcat is listening on the AJP1.3/mod_jk connector port:

Code: Select all

lsof -i :8009

and, if not, post the contents of your /opt/scalix-tomcat/conf/server.xml config file?

[Edit]
Also, can you check if SELinux is running?

Thanks,
Subir

[larsstig]

Output of lsof -i:8009:

Code: Select all

[root@comm httpd]# lsof -i:8009
COMMAND  PID     USER   FD   TYPE DEVICE SIZE NODE NAME
java    4734     root   11u  IPv4  12859       TCP comm.sorensenIT.com:8009 (LISTEN)
java    4734     root   14u  IPv4  15141       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33333 (ESTABLISHED)
java    4734     root   15u  IPv4  15366       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33334 (ESTABLISHED)
java    4734     root   16u  IPv4  15369       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33335 (ESTABLISHED)
java    4734     root   17u  IPv4  15375       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33337 (ESTABLISHED)
java    4734     root   18u  IPv4  15380       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33338 (ESTABLISHED)
java    4734     root   19u  IPv4  15383       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33340 (ESTABLISHED)
java    4734     root   20u  IPv4  15391       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33344 (ESTABLISHED)
java    4734     root   21u  IPv4  15425       TCP comm.sorensenIT.com:8009->comm.sorensenIT.com:33347 (ESTABLISHED)
httpd   5032 asterisk   13u  IPv4  15365       TCP comm.sorensenIT.com:33333->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5033 asterisk   13u  IPv4  15368       TCP comm.sorensenIT.com:33334->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5034 asterisk   13u  IPv4  15424       TCP comm.sorensenIT.com:33344->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5035 asterisk   13u  IPv4  15374       TCP comm.sorensenIT.com:33335->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5036 asterisk   13u  IPv4  15434       TCP comm.sorensenIT.com:33347->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5037 asterisk   13u  IPv4  15379       TCP comm.sorensenIT.com:33337->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5038 asterisk   13u  IPv4  15382       TCP comm.sorensenIT.com:33338->comm.sorensenIT.com:8009 (ESTABLISHED)
httpd   5039 asterisk   13u  IPv4  15390       TCP comm.sorensenIT.com:33340->comm.sorensenIT.com:8009 (ESTABLISHED)
[root@comm httpd]#


selinux is enabled, but in permissive mode meaning it only prints warnings in the log, but does not prevent anything.

-ls

[ScalixSupport]

Hi!

Please remove the 80 in
res.tomcat.tcp.port=80
of the file /var/opt/scalix/??/res/config/res.properties and restart Tomcat. You should then
be able to login.

In Version 10 of Scalix the installer installs a new instance of tomcat under
/opt/scalix-tomcat. Can you check if /opt/scalix-tomcat/bin/setclasspath.sh file contains
JAVA_HOME and JAVA_OPTS variable and that they are set to the correct values?

In the file /etc/httpd/conf.d/scalix-tomcat-connector.conf, do you see the lines,

Code: Select all

Include /etc/opt/scalix-tomcat/connector/jk/instance-*.conf
Include /etc/opt/scalix-tomcat/connector/jk/workers.conf

What is the content of the file /etc/opt/scalix-tomcat/scalix-tomcat.conf, check if the
JAVA_HOME path is correct?

Make selinux disabled, see it helps.

Thanks,
Subir

[larsstig]

There was no 80 in the res.tomcat.tcp.port= line.

setclasspath.sh does not set JAVA_HOME or JAVA_OPTS, contents:

Code: Select all

# -----------------------------------------------------------------------------
#  Set CLASSPATH and Java options
#
#  This file was modified by Scalix for use in Scalix Tomcat package.
#
#  $Id: scalix-setclasspath.sh,v 1.5 2006/10/26 16:00:20 dkelly Exp $
# -----------------------------------------------------------------------------

# Load configuration:
CONFIG_SCRIPT=/etc/opt/scalix-tomcat/scalix-tomcat.conf
[ -f "$CONFIG_SCRIPT" ] && source $CONFIG_SCRIPT

INSTDIR=$(/opt/scalix-tomcat/bin/sxtomcat-get-inst-dir)
JAVA_OPTS="$JAVA_OPTS -Dscalix.instance=$(dirname $INSTDIR)"

# Make sure prerequisite environment variables are set
if [ -z "$JAVA_HOME" ]; then
  echo "The JAVA_HOME environment variable is not defined"
  echo "This environment variable is needed to run this program"
  exit 1
fi
if [ ! -x "$JAVA_HOME"/bin/java ]; then
  echo "The Java interpreter is not found"
  echo "This is needed to run this program"
  exit 1
fi
if [ -z "$BASEDIR" ]; then
  echo "The BASEDIR environment variable is not defined"
  echo "This environment variable is needed to run this program"
  exit 1
fi
if [ ! -x "$BASEDIR"/bin/setclasspath.sh ]; then
  echo "The BASEDIR environment variable is not defined correctly"
  echo "This environment variable is needed to run this program"
  exit 1
fi

# Set the default -Djava.endorsed.dirs argument
JAVA_ENDORSED_DIRS="$BASEDIR/common/endorsed"

# Set standard CLASSPATH
CLASSPATH="$JAVA_HOME"/lib/tools.jar

# Set standard commands for invoking Java.
_RUNJAVA="$JAVA_HOME"/bin/java


/etc/httpd/conf.d/scalix-tomcat-connector.conf does have the lines you metion.

Content of /etc/opt/scalix-tomcat/scalix-tomcat.conf:

Code: Select all

# cat /etc/opt/scalix-tomcat/scalix-tomcat.conf
#
# Configuration file for Scalix Tomcat
#

# The directory where Java is installed:
JAVA_HOME="/usr/java/jre1.5.0_06"

# Additional arguments to be passed to Java:
JAVA_OPTS="-server -Djava.net.preferIPv4Stack=true"


These are the correct settings.

Completely disabling selinux makes no difference either.

-ls

[ScalixSupport]

Hi!

Can you send the contents of file /etc/httpd/conf.d/scalix-tomcat-connector.conf also what
is the result for "ls -al /etc/opt/scalix-tomcat/connector/*"?

Thanks,
Subir

[larsstig]

scalix-tomcat-connector.conf:

Code: Select all


# ---------------------------------------------------------------------------
# Load deflate and JK modules used by Scalix:
# ---------------------------------------------------------------------------

<IfModule !mod_deflate.c>
LoadModule deflate_module modules/mod_deflate.so
</IfModule>

<IfModule !mod_jk.c>
LoadModule jk_module modules/mod_jk.so
</IfModule>

# ---------------------------------------------------------------------------
# Configure on-the-fly deflate compression of the pages:
# ---------------------------------------------------------------------------

<Location />
  AddOutputFilterByType DEFLATE text/xml text/html text/css
  AddOutputFilterByType DEFLATE application/x-javascript
</Location>

# ---------------------------------------------------------------------------
# mod_jk connector configuration (part common to all platforms)
# ---------------------------------------------------------------------------

# Setup JK connector needed to run Tomcat under Apache server:

<IfModule mod_jk.c>

# Set the jk log level [debug/error/info]
JkLogLevel          info
# Select the log format
JkLogStampFormat   "[%a %b %d %H:%M:%S %Y] "
# JkOptions indicate to send SSL KEY SIZE,
JkOptions          +ForwardKeySize +ForwardURICompat -ForwardDirectories
# JkRequestLogFormat set the request format
JkRequestLogFormat "%w %V %T"

Include /etc/opt/scalix-tomcat/connector/jk/instance-*.conf
Include /etc/opt/scalix-tomcat/connector/jk/workers.conf

</IfModule>

# ---------------------------------------------------------------------------
# mod_jk connector configuration (part specific to RedHat)
# ---------------------------------------------------------------------------

<IfModule mod_jk.c>
# Where to put jk logs
# Update this path to match your logs directory location
# (put mod_jk.log next to access_log)
JkLogFile     /var/log/httpd/mod_jk.log
</IfModule>


Code: Select all

> ls -la /etc/opt/scalix-tomcat/connector/*
/etc/opt/scalix-tomcat/connector/ajp:
total 80
drwxr-xr-x  2 root root 4096 Feb 22 20:57 .
drwxr-xr-x  4 root root 4096 Feb 22 20:57 ..
-rw-r--r--  1 root root   50 Mar 29 09:38 app-comm.api.conf
-rw-r--r--  1 root root   50 Mar 29 09:38 app-comm.caa.conf
-rw-r--r--  1 root root   46 Mar 29 09:38 app-comm.m.conf
-rw-r--r--  1 root root   50 Mar 29 09:38 app-comm.res.conf
-rw-r--r--  1 root root   50 Mar 29 09:38 app-comm.sac.conf
-rw-r--r--  1 root root   50 Mar 29 09:38 app-comm.sis.conf
-rw-r--r--  1 root root   58 Mar 29 11:45 app-comm.webmail.conf
-rw-r--r--  1 root root  471 Mar 29 11:45 instance-comm.conf

/etc/opt/scalix-tomcat/connector/jk:
total 88
drwxr-xr-x  2 root root 4096 Feb 22 20:57 .
drwxr-xr-x  4 root root 4096 Feb 22 20:57 ..
-rw-r--r--  1 root root   19 Mar 29 09:38 app-comm.api.conf
-rw-r--r--  1 root root   19 Mar 29 09:38 app-comm.caa.conf
-rw-r--r--  1 root root   17 Mar 29 09:38 app-comm.m.conf
-rw-r--r--  1 root root   19 Mar 29 09:38 app-comm.res.conf
-rw-r--r--  1 root root   19 Mar 29 09:38 app-comm.sac.conf
-rw-r--r--  1 root root   19 Mar 29 09:38 app-comm.sis.conf
-rw-r--r--  1 root root   23 Mar 29 11:45 app-comm.webmail.conf
-rw-r--r--  1 root root  830 Mar 29 11:45 instance-comm.conf
-rw-r--r--  1 root root   34 Mar 29 11:45 workers.conf