Imap cache issues

[ebhannes]

I experienced the same problem like mmas.
Upgrading to 11.4.2 leaves me quite happy, until some imap cache corruptions occured. I cannot state definitly that it had happened after a reboot but i don't want to stress my users again for testing purposes.
The difference in my case is that new emails are visible but new items in the calendar (TB + lighnting) aren't. Again using the script works.

Has someone some skills in modifying the imapcachescript to delete every users imap cache automatically? It has also the effect of getting rid of hundreds of [OM4000] mime...
error messages.

bye
Hannes

[sg]

Try this perl script, we've used it to clear the imap-caches of all users every night:

Code: Select all

#!/usr/bin/perl

use strict;

my $debug = 0;
my $REALPATH=`/opt/scalix/bin/omrealpath "~/"`;
chomp ($REALPATH);
my $zeile;


open (users, "/opt/scalix/bin/omshowu -m all |");
while ($zeile = <users>)
{
    chomp($zeile);
    my $FOLDER=`/opt/scalix/bin/omshowu -n "$zeile" -f 2>/dev/null| grep "User Folder" | awk -F/  '{print \$2 "/" \$3 }' `;
    chomp($FOLDER);
    my $ID=`/opt/scalix/bin/omshowu -n "$zeile" | grep "System Login :" | awk -F: '{print \$2}'`;
    $ID =~ s/\s//g;
    chomp($ID);

    $FOLDER = $REALPATH . $FOLDER . "/imap-cache";

    if (($FOLDER =~ /\s/) || ($FOLDER =~ /\n/) || (!($FOLDER =~ /imap-cache\Z/)) || (length($FOLDER) < 40))
    {
        die "Would delete $FOLDER\n";
    };

    if ($debug) {print "locking mail-account ...\n";};
    system "/opt/scalix/bin/ommodu -o \"$zeile\" -K >/dev/null 2>&1";
    if ($debug) {print "killing IMAP-processes for user $1 (uid $ID) ...\n";};
    system "pkill -u '$ID' in.imap41d";
    if ($debug) {print "removing $FOLDER ...\n";};
    system "rm -rf  $FOLDER";
    if ($debug) {print "unlocking mail-account ...\n";};
    system "/opt/scalix/bin/ommodu -o \"$zeile\" -k 2>&1 | grep -v 'ommodu: The user was modified successfully'";
    if ($debug) {print "done!\n";};
};

close (users);


[ebhannes]

Thank you so much, i will try it in the near future.

bye hannes

[florian]

So....

while there is one remaining and relatively rare known case in the currently available 11.4.3 code that can produce a corrupted IMAP cache (which will be fixed in 11.4.4, to be available in April), this release has resolved the more common cause.

Therefore, I'd rather suggest to upgrade to 11.4.3 ASAP and not really implement such a workaround. Keep in mind that this script does (and has to, it is therefore to be considered correct!) temporarily, even if it is only for a brief moment, terminate user's sessions and lock the user out, so it can produce user-visible errors in SWA and other IMAP clients.

I would personally not want to use such an approach on a system of mine on a continous basis....

Florian

[sg]

Therefore, I'd rather suggest to upgrade to 11.4.3 ASAP and not really implement such a workaround. Keep in mind that this script does (and has to, it is therefore to be considered correct!) temporarily, even if it is only for a brief moment, terminate user's sessions and lock the user out, so it can produce user-visible errors in SWA and other IMAP clients.

I would personally not want to use such an approach on a system of mine on a continous basis....

That's why we ran the script at night. On some systems it was the only way, to get rid of the corruptions for a long time. We saw no errors resulting from deleteing the imap-caches, but rather from not deleting them.

We've got some little remaining problems with the imap-cache corruption.

[florian]

We've got some little remaining problems with the imap-cache corruption.

Is this with 11.4.3, and if so, what nature are these problems of?

Florian

[sg]

We've got some little remaining problems with the imap-cache corruption.

Is this with 11.4.3, and if so, what nature are these problems of?

Florian

Yes, this is with 11.4.3 and it's an Enterprise Edition.

Most of the problems we had with 11.4.2 are gone since the update to 11.4.3.

With 11.4.3 we had some problems with 'ghost messages' - messages in Bulletin Boards which has been deleted by an user, but were still partially seen by other users. This Problem should be solved by now.

There is still a little problem with flagged messages, but also in the context of bulletin boards.

Sebastian

PS: We're not using the above script anymore, because most of the problems seem to be solved.

[mmas]

for your further testing, make sure whether, when the problem appears, it can be recovered from by just killing the user's IMAP processes w/o clearing the on-disk cache files. I think the wiki script (which was contributed, so i don't have the specs) would actually have an option to do just that (-k?? please check)

Hi, this morning my swa user phone me saying he has the "email not showed also if 2 new emails presents" problem. It came again after a month.
So I execute the following commands:

/opt/scalix/bin/ommodu -o "user" -K
pkill -u $USERID in.imap41d
/opt/scalix/bin/ommodu -o "user" -k

and the problem was solved. No imap cache cleaning. Server not rebooted recently.
One thing: I use an external program configured to access via imap to user mailbox and popup message when new emails arrive.
If two users access the same mailbox via swa can conflict or crash the imap-cache?

[florian]

what version of Scalix are you using?

(rpm -qa | grep scalix-server)

Florian

[mmas]

what version of Scalix are you using?

(rpm -qa | grep scalix-server)

Hi,

scalix-server-11.4.3.12339-1.rhel5

I search for imap errors about this user but nothing found.

Well I have also an old scalix-server-11.2.0.11121-1.rhel5 mail server with all users using only SWA. Here I need to clean imap cache and I note the problem is frequent because (I think) they share mailbox. They have generic mailbox and more people access it via SWA. I know this scalix version is old but I write about it only to get you more information. The new version of scalix are really better and I'm happy about swa and outlook connector.

Thanks for your reply.

[florian]

We have a Hotfix available in Tech Support for commercial customers with valid support entitlement that may further reduce the frequency of the issue. If you are one of those, you may want to open a support ticket at http://www.scalix.com/support

The fix is currently in QA and full regression testing and will be made generally available, together with other improvements, in Scalix 11.4.4, due near end April or in early May.

Florian

[ebhannes]

Updating to version 11.4.3 is not an option for me since i don't want to substitute one problem with another. Somewhere in the forum i heard about german language causes problem with some system folder. Have to search for it, but it sounded like a real killer not to user version 11.4.3. Is this documented in known bugs somewhere? Any other known bugs?

Thanks
Hannes

[florian]

the only thing I can see you referring to is https://bugzilla.scalix.com/show_bug.cgi?id=19284 - which is actually also present in 11.4.2 (it was indeed a regression over 11.4.1 caused by another fix) and remaining an issue in 11.4.3, will be fixed in 11.4.4.

At this point I see no reason whatsoever for customers running 11.4.2 to upgrade to 11.4.3; performance and stability, especially for IMAP clients and SWA is significantly improved.

Florian