Search gives no result, re-open bug #14325?

[Goulou]

Hi everybody,

I'm experiencing a strong problem, and already spent one week trying to solve it : my searches in SWA give no results...

While writing the message below (I was making searches to try to include citations and reference...), I found that bug #14325 (https://bugzilla.scalix.com/show_bug.cgi?id=14325) (SWA search doesnt work with Locale set to german) should correspond exactly to what I'm experiencing here : my locale is set to French, and when searching with sxsearch, I get the result in the following form : "1,000000 .097675 00011c0550475ddd", with a coma (default float separator in french...) instead of a dot

It is said to be "Fixed after 11.0.X.754 and for 11.0.4", but I'm running 11.3, and it doesn't seem to be... (still, it was set P1...)

I'm just leaving the message I wrote (with logs showing that everything should work... ) below, but the most important is above...

I may answer in few minutes to my message... time to check if the workaround is working...

Cheers,

Frédéric.



I read ten times every message about this issue on the forum, and here is where I am now : the simplest configuration ever made, to try to spot the problem :
-I just made a fresh install of scalix 11.3U1, on a fresh new server (in a VMWare box), on Fedora Core 7
-I have only one user (Frederic), he has only one mail in the mailbox (actually the mail sent to root after its cache has been built), its id is "goulou"
-I already run sxmkindex, its output is following :

Code: Select all

[root@mailserver httpd]# sxmkindex
sxadmin /mailserver: 0
sxqueryadmin /mailserver: 0
Frederic /mailserver: 1
+Bulletin Boards: 0
Total messages processed: 1


-output from sxsearch works, and is :

Code: Select all

[root@mailserver httpd]# sxsearch goulou "from:root AND MSG-TYPE:email"
1,000000 .097675 00011c0550475ddd


-There is nothing else on this server, no Vhost defined in Apache (I thought it was the problem on my previous install...)

-In /var/log/httpd, error.log is empty, and access.log contains the following :

Code: Select all

[root@mailserver httpd]# tail access_log
192.168.1.8 - - [03/Mar/2008:01:21:09 +0100] "POST /webmail/jsoap?module=soapmail HTTP/1.1" 200 299 "http://mailserver.xxx.net/webmail/mailwindowloader.jsp?locale=en_US&dummy=301104240573_2" "Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12"
192.168.1.2 - - [03/Mar/2008:01:21:51 +0100] "GET /sis/searcher?uid=03100000b283bc74-2.1.861.291&q=
%28from%3a%22root%22%20OR%20subject%3a%22root%22%20OR%20BODY%3a%22root%22%20OR
%20to%3a%22root%22%29%20AND%20%28MSG-TYPE%3aemail%29&folders=inc%3a00011200e145247
5%2c00011202de33ee54%2c00011c0015e17a53%2c00010001dea679d1%2c000100020bc34f00%2c00010003fd886953%
2c0001000401b851a3%2c00010005b8306bca&start=0&end=99&raw=true&stats=true HTTP/1.1" 200 61 "-" "-"
192.168.1.2 - - [03/Mar/2008:01:21:51 +0100] "GET /api/frederic@xxx.net/search/?q=
(from:%22root%22%20OR%20subject:%22root%22%20OR%20BODY:%22root%22%20OR%20to:%22root
%22)%20AND%20(MSG-TYPE:email)&e0=Public%20Folders/*&e1=Other%20Users/*&start=1&end=100&preview=true HTTP/1.1" 200 11 "-" "Scalix Web Access"
192.168.1.8 - - [03/Mar/2008:01:21:51 +0100] "POST /webmail/jsoap?module=soapmail HTTP/1.1" 200 232 "http://mailserver.xxx.net/webmail/wnd_Search.jsp?locale=en_US" "Mozilla/5.0 (Windows; U; Windows NT 6.0; fr; rv:1.8.1.12) Gecko/20080201 Firefox/2.0.0.12"

As you can guess, the server is on 192.168.1.2, the client on 1.8.

-This user seems to have a valid sxidx, as shown here :

Code: Select all

[root@mailserver httpd]# omshowu goulou
Authentication ID: goulou
Globally Unique ID: 13100000b283bc74-2.1.861.291
User Name : Frederic (...)
MailNode : mailserver
Internet Address : (...)
System Login : 60536
Password : set
Admin Capabilities : NO
Mailbox Admin Capabilities : NO
Language : AMERICAN
Mail Account: Unlocked
Last Signon : 03.03.08 01:23:09
Receipt of mail : ENABLED
Service level : 0
Excluded from Tidying : NO
Recovery Folder visible : NO
User Class : Full
SIS URL : sxidx://mailserver.xxx.net/03100000b283bc74-2.1.861.291

-At last, scalix-sis-search.log seems completely normal.....

Code: Select all

[root@mailserver httpd]# cat /var/opt/scalix/mr/tomcat/logs/scalix-sis-search.log
2008-03-03 00:35:14,415  INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.3.0.77
2008-03-03 00:35:14,500  INFO [main] [SISConfig.load:31] SIS initialized and ready for searching
2008-03-03 00:48:50,335  INFO [main] [SISConfig.unload:124] SIS unloaded
2008-03-03 00:49:21,302  INFO [main] [SISConfig.init:45] Starting Scalix Search and Index Service (SIS) version 11.3.0.77
2008-03-03 00:49:21,391  INFO [main] [SISConfig.load:31] SIS initialized and ready for searching

(and scalix-sis-indexer.log is normal too, adding content, being ready for indexing, and so on).

-I could also post output of "ps ax | grep index"/"post"/"java", but I think it enough for now, and I can tell you that they don't seem to have anything wrong.
omstat -a and omstat -s also show that everything is started, enabled, except for "Item Structure Server", shown as "stopped"
-In my previous installation of Scalix, I also rebuilt the "MIME" (


I really spent the whole week trying to fix this issue, without success, so if anyone could tell me what's wrong...

Thanks in advance,

Goulou

[Goulou]

I have to come to the conclusion that in 11.3, bug #14325 is still present.
And I may add that I think it should come back with its priority 1, since I spent 1 week trying to solve it...
After changing /etc/sysconfig/i18n to en_US.UTF-8, everyting came fine, and search works again...
Let me just mention that I was close to leaving Scalix at the end of the week, but fortunately, it already proved to do so many things that I couldn't quit like that!

About the workarounds : I tried to add the lines in /opt/scalix-tomcat/bin/setclasspath.sh and in /etc/opt/scalix-tomcat/scalix-tomcat.conf , but it didn't change anything (even after reboot).
I had no choice but to set global locale in /etc/sysconfig/i18n to en_US.UTF-8, which is quite annoying...

Goulou.

PS : here are my current versions, which should be the last release...

Code: Select all

[root@mailserver ~]# rpm -qa | grep -i scalix
scalix-libical-0.27.20071008-1
scalix-sac-11.3.0.77-1
scalix-server-11.3.0.11339-1.f7
scalix-tomcat-5.5.25-57
scalix-res-11.3.0.77-1
scalix-mobile-11.3.0.77-1
scalix-tomcat-connector-11.3.0.77-1.f7
scalix-platform-11.3.0.77-1
scalix-sis-11.3.0.77-1
scalix-postgres-11.3.0.77-1
scalix-chardet-1.0.20071031-1.f7
scalix-swa-11.3.0.97-1


[Rienk]

I experienced the same problem where sxsearch returned
“0,803981 00011c40633ce46c 0001105a97596282â€

[bammers]

Folks, just to let you know there is a fix for this targeted for the 11.4.3 release.
This will allow users to set their preferred locale in "/etc/sysconfig/i18n" without problem.

I hope this information helps.

Chris

[pasquale]

Hello, I'm a brand new user...
I have had the same problem with the search.
Bammers, you said there is a fix, but where I can find it,
and how can I install it?
I'm using Scalix 11.4.3.
(sorry for my English, I'm Italian....)

Thanks
Pasquale

[bammers]

Hi Pasquale,

Your English is perfect - please don't apologise for it! I lived in Italy for a while and my Italian is much worse...

Regarding your problem, I think you need to re-check your system, as 11.4.3 has not yet been released - it is targeted as early in 2009.
However, there are two ways I can hopefully help you fix your problem before then:

1) Globally set your locale to LANG="en_US.UTF-8" in /etc/sysconfig/i18n and reboot your system. This will solve the problem but your users may not like it too much as it is not Italian
2) Just set the locale of the affected process instead, as follows:
a) Stop the search service (omoff -d0 search)
b) Change the locale in the current shell (export LANG="en_US.UTF-8")
c) Restart the service (omon search)

If you choose (2), remember you must remember to do it each time your system is restarted.

Let me know you you get on.

Best regards,

- Chris

[pasquale]

My release is effectively 11.4.2... of course.

I changed the /etc/sysconfig/ i18n with the line your suggested me.
Now it seems to work fine.
This change didn't affect the Italian localization of the webmail.
Only the Operating System seems to be is in English. No problem.
The (about 100) users don't know about this change.
We all use only the webmail.

Thank you very much.
Merry Christmas and Happy New Year

Pasquale

[bammers]

Just to let everyone know, 11.4.3 release is now available, containing the fix for this issue.

[ivoruetsche]

I solve the problem too; because we use different internal and wan ip addresses. It's not the same problem from Goulou, but maybe a hint for others.

/var/opt/scalix/l1/tomcat/logs/scalix-sis-search.log:
2008-05-04 13:16:36,322 ERROR [TP-Processor15] [WebUtil.errorResponse:63] Client from IP address 192.168.1.10 is unauthorized to access this resource. Check index.client.whitelist in sis.properties.

So, i add in the /var/opt/scalix/??/sis/sis.properties my internal IP Adresse:
index.client.whitelist=192.168.1.10,191.1.22.110,127.0.0.1
search.client.whitelist=192.168.1.10,191.1.22.110,127.0.0.1
indexadmin.client.whitelist=192.168.1.10,191.1.22.110,127.0.0.1

Then i execute an sxmkindex -R and all was happy.

cu ivo

[bammers]

I am glad people are finding this now works as expected - and thanks for your posts which help others. Please let me know if there are any more related issues.
BTW, the fix was tracked in a newer bug called "[Defect] search from SWA may not work when LANG is not set to en_US.UTF-8" (https://bugzilla.scalix.com/show_bug.cgi?id=18405)

Regards

Bammers