2gb file size limit on omcpoutu

Discuss the Scalix Server software

Moderators: ScalixSupport, admin

jkoyle

2gb file size limit on omcpoutu

Postby jkoyle » Sat Oct 15, 2005 12:31 pm

Initial setup had users sync'd with AD., Now migrating to OpenLDAP.
To do this, I've used omcpoutu to save a users mail,
ommodent "name" -n "ADMINISTERED-BY=scalix" to break the AD sync, then delete the user.
Finally recreate in openldap and resync followed by omcpinu.

All works great - until I come to a user with larger than 2gb mail dir.

[root@scalix archive]# omcpoutu -n "bob user" -f bob.out
File size limit exceeded

I've verified that it isn't the OS. I can use dd and create a 3gb file no problems. The bob.out file stops cold at 2gb.

How can I accomplish what I need to do as described above?

John

jch
Scalix
Scalix
Posts: 202
Joined: Thu Mar 25, 2004 10:25 am

Postby jch » Sat Oct 15, 2005 2:41 pm

There's a fix for this pending, but for the moment try this:

Move some of the user's larger folders into a public folder somewhere and then do an omcpoutu. Then delete the user's remaining folders, put the folders in the public folder area back and do another omcpoutu. Do two omcpoutu's to get the user back.

I must admit I haven't tried this so I'd try it out on a smaller user before you do the big user to make sure you've got the process right -- it would be annoying if you lost some mail :-)

jch

ScalixSupport
Scalix
Scalix
Posts: 5503
Joined: Thu Mar 25, 2004 8:15 pm

Postby ScalixSupport » Sat Oct 15, 2005 4:52 pm

A Scalix mailbox is made up of a number of components that you can use omcpoutu to copy individually.

Intray is obvious, Pending is the server term for the Sent Items folder and Filing Cabinet is any other folder other than Intray, Outtray and Pending tray.

So, use the -S switch for the ompoutu command followed by i, p or f.

The man page explains this in more detail and gives examples.

This may allow you to break down the size of the omcpoutu file.

Cheers

Dave

florian
Scalix
Scalix
Posts: 3852
Joined: Fri Dec 24, 2004 8:16 am
Location: Frankfurt, Germany
Contact:

Postby florian » Sun Oct 16, 2005 12:03 pm

Actually, depending on the version of Scalix you're using, you might already have the fix....

If this is Scalix 9.4 or later, you can redirect omcpoutu to write to standard output, i.e.

omcpoutu -n "Bob User" -f - >bob.user.cpoutu

The purpose of this is that you can redirect the output of omcpoutu to a pipe, so that you can compress the data or so, as in

omcpoutu -n "Bob User" -f - | gzip -c -9 >bob.user.cpoutu.gz

Naturally, omcpinu can use the same syntax.

This and at least one more new option to the omcpoutu command will be fully documented in an uncoming release of Scalix.

Hope this helps,
Florian.
Florian von Kurnatowski, Die Harder!

jkoyle

Postby jkoyle » Mon Oct 17, 2005 9:03 am

[root@host archive]# omcpinu -f - < file.out
File size limit exceeded

The backup via stdout worked beautifully. Unfortunately, now my CTO's email is offline because the import isn't working. Is there an updated omcpinu utility that does work?

jch
Scalix
Scalix
Posts: 202
Joined: Thu Mar 25, 2004 10:25 am

Postby jch » Mon Oct 17, 2005 9:37 am

Try

Code: Select all

cat file.out | omcpinu -f -


DIdn't know that was in the curent release. You learn something new every day :)

jch

jkoyle

Postby jkoyle » Mon Oct 17, 2005 9:39 am

I've tried it with the syntax you suggest. The original file was also gzipped, and I tried with:

zcat file.gz | omcpinu -f -

as well - still no joy

jch
Scalix
Scalix
Posts: 202
Joined: Thu Mar 25, 2004 10:25 am

Postby jch » Mon Oct 17, 2005 9:42 am

What error message do you get with the pipeline (as opposed to the straightfoward redirection)?

jch

jkoyle

Postby jkoyle » Mon Oct 17, 2005 9:54 am

Same exact error message as before File size limit exceeded. This is the same error that I got with omcpoutu before using the redirection that Florian mentioned.

chrish01
Posts: 37
Joined: Mon Nov 14, 2005 9:00 pm

Postby chrish01 » Sun Mar 05, 2006 4:12 am

Im having the same problem with a 7gb cpoutu file. I *really* need to get this in right away as its an executives mail as well.

I have a complete backup of the message store as well, but due to some of the changes we had to made, simply backing up and restoring the store was not an option.

Cheers.

florian
Scalix
Scalix
Posts: 3852
Joined: Fri Dec 24, 2004 8:16 am
Location: Frankfurt, Germany
Contact:

Postby florian » Sun Mar 05, 2006 9:13 am

Christian,

- are you getting this error message right at the beginning of the "restore" operation or does it run for a while (i.e. import the first 2 GB or so?).
- which shell are you using? is this bash or anything else? What OS is this?

-- Florian.
Florian von Kurnatowski, Die Harder!

chrish01
Posts: 37
Joined: Mon Nov 14, 2005 9:00 pm

Postby chrish01 » Sun Mar 05, 2006 6:32 pm

FC4, running Scalix 10 ontop of Xen 3.0.1. Using both bash and zsh.

When running `cat person.dat | omcpinu -f - ` it errors decently quick.
When running `omcpinu -f - < person.dat` it seems to go for a while, then error.

Jason Warren
Posts: 31
Joined: Wed Nov 09, 2005 12:22 pm
Location: East Retford
Contact:

Postby Jason Warren » Tue Apr 04, 2006 11:02 am

Hi,
Did this get resolved?
Best Regards
Jason

skellenb

Postby skellenb » Thu Jun 08, 2006 7:58 am

i have the same problems importing a File larger than 2 GB

Running SuSE 10 OSS, Scalix 10


Did this get resolved?
Best Regards


Stefan

kanderson

Postby kanderson » Thu Jun 08, 2006 11:15 pm

I haven't seen this as a problem. My >2GB imports have worked fine.

SLES9 SP2/3 Scalix 10

Kev.


Return to “Scalix Server”



Who is online

Users browsing this forum: No registered users and 1 guest

cron