large data repository sync over WAN

From: Rob Windsor (windsor@warthog.com)
Date: Wed Feb 21 2007 - 14:09:32 EST


We need to sync 10TB of data in small files from one North American
coast to the other.

Our tenative plans are to sneakernet the data and then use some form of
sync to catch up the delta.

Aside from bandwidth constraints, we found that rsync quickly craps out
with large numbers of files.

What tools have you used to do this?

Rob++

-- 
Internet: windsor@warthog.com                             __o
Life: Rob@Carrollton.Texas.USA.Earth                    _`\<,_
                                                        (_)/ (_)
"They couldn't hit an elephant at this distance."
   -- Major General John Sedgwick
_______________________________________________
sunmanagers mailing list
sunmanagers@sunmanagers.org
http://www.sunmanagers.org/mailman/listinfo/sunmanagers


This archive was generated by hypermail 2.1.7 : Wed Apr 09 2008 - 23:41:40 EDT