Question concerning large number of files and transfer to another directory.

From: Brewer, Edward (BREWERE@OD.NIH.GOV)
Date: Wed Apr 24 2002 - 11:57:17 EDT


Admins,

I have a two part question.

1) I have a very large number of files in a single directory (250,000) and
I need to tune the system to handle users issuing an ls or a sorted ls
command efficiently. Using the performance guide online I surmised that I
should first look at the namei cache. Following the guide I found that the
hit ratio is high enough but comparing the badtimehit vs goodhits is .16% so
according to the document I need to tune this.

reference:
http://www.tru64unix.compaq.com/docs/base_doc/DOCUMENTATION/V51_HTML/ARH9GBT
E/CHFSXXXX.HTM#sectnameicache

The question: Is it a good idea to increase maxusers also?...maxuser is set
to 2048....we have a 8 GB system..with 4 GB hardwired to shared memory
(gs160 wildfire 2 QBB 2 GB per QBB). We have over 50,000 free pages. This
system is using Tru64 5.1.

2) I need to copy these files to another directory structure( they orginals
are nfs mounted). I tried creating a script with cp command (several cp
command that key off the first few letters of the file names; thus spawning
several cp's...this failed because the cp command couldn't handle the list
created by the wildcard structure. So if I use

vdump -0 -f - /<old directory> | vrestore -xf - -D /<new directory>

Is this the most effective way to copy?

TIA,
Lee Brewer

BTW: For now I can not break up the directory into smaller directories.



This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:48:39 EDT