Copy many small files

From: Ahmed F. Al Twaijiry (a.altwaijiry@mobily.com.sa)
Date: Tue May 22 2007 - 15:27:47 EDT


Hi everyone

We want to copy around 140000 small files (each file size from 50K to 1M with
total size around 150GB) from Solaris server to Windows server.

the copy usually take more than 15 hours to finish (using scp, we have cygwin
installed in windows), and this is too much

I was thinking about copying to windows using the command "tar czv ListOfFiles
| ssh -c blowfish remote.box.com tar xz -C /home/user/PathToCopy" to speed up
the copy

let me know what you think and if you have any suggestion or recommendation
(please don't ask me to add more bandwidth to network or replace the servers,
simply I can't do it :) )

PS: we are not allowed to use rcp :(
-----------------------------------------------------------------------------
------------------
Disclaimer
This email and any files transmitted with are
classified as confidential unless otherwise specified. This e-mail is intended
solely for the use of the individual or entity to whom this e-mail is
addressed. If you have received this email by mistake, please notify the
sender and delete this e-mail immediately and permanently. Although measures
were taken to free this e-mail and its attachments from any malicious code
infection, it is the responsibility of the recipient to check this email and
any attachments for the presence of such infection. The use of EEC(Mobily)
e-mail service is limited for EEC(Mobily) business use only.
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers



This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:41:59 EDT