From: Aldridge, Robert E. (REAldridge@mcdermott.com)
Date: Wed Oct 09 2002 - 13:14:32 EDT
Just to correct my previous summary:
The AdvFS file domain actually was full.
I saw those values for "Used" space and "blocks" and individually each file
system looks like it has plenty of space (319GB).
However, all three file systems share the 319GB in the AdvFS domain.
Mysteriously the file systems regained free space after I cleaned up "var"
-- now I suspect that a user got logged in and cleaned up files on the "nm"
domain at the same time I was cleaning "var".
Also, someone pointed out that AdvFS sets aside perhaps 10% of the file
system as "reserved" space.
Thanks for the comments and follow-up.
Robert
-----Original Message-----
From: Aldridge, Robert E. [mailto:REAldridge@mcdermott.com]
Sent: Wednesday, October 09, 2002 9:00 AM
To: 'tru64-unix-managers@ornl.gov'
Subject: SUMMARY: Handling error - AdvFS domain is full
Importance: Low
Here's my "own" resolution to the issue.
- Cleaning out /var so that it was not 100% full, restored access to the
AdvFS domain that was full.
What I think happened, is that a user file system (/nm/projects) was filled
to capacity by a user. This triggered a logging "loop", filling the "/var"
file system, which caused the entire AdvFS domain to become inaccessible.
So if you'd care to explain, the only issues I have open are:
- /var fills up -- why does the AdvFS show at 100% full (when using df) ?
- If a user file system is full, why does it get logged nearly 100 times per
second to kern.log ? This only aggravates the system problems. Any way to
control that logging frequency?
Incidentally, the support center suggested I use /sbin/advfs/vdf instead of
df when looking at AdvFS file systems.
Thank you,
Robert
-----Original Message-----
From: Aldridge, Robert E.
Sent: Wednesday, October 09, 2002 8:23 AM
To: 'tru64-unix-managers@ornl.gov'
Subject: Handling error - AdvFS domain is full
Tru64 Managers:
I'm puzzled because one of our AdvFS file systems "domains" is full.
The actual file systems are NOT full.
The /var file system IS full -- could that be the root issue? Or a symptom
of the AdvFS domain being full?
Suggestions, please?
File systems show:
nm#projects 319937640 270720644 0 100%
/nm/projects
nm#home 319937640 1359715 0 100% /nm/home
nm#programs 319937640 47647559 0 100%
/nm/programs
Error message is below:
Subject: EVM ALERT [600]: AdvFS: AdvFS domain nm is full
------------- Begin Forwarded Message -------------
Date: Wed, 9 Oct 2002 07:43:30 -0400 (EDT)
From: system PRIVILEGED account <root@saturn.xx.com>
Subject: EVM ALERT [600]: AdvFS: AdvFS domain nm is full
Content-Length: 1073
============================ EVM Log event ===========================
EVM event name: sys.unix.fs.advfs.fdmn.full
This event is posted by the AdvFS filesystem to provide
notification that the specified AdvFS domain is full. No more
space is available for writing.
======================================================================
Formatted Message:
AdvFS: AdvFS domain nm is full
Event Data Items:
Event Name : sys.unix.fs.advfs.fdmn.full
Cluster Event : True
Priority : 600
PID : 556672
PPID : 569688
Event Id : 13236546
Member Id : 1
Timestamp : 09-Oct-2002 07:43:30
Host IP address : 131.x.x.49
Cluster IP address: 131.x.x.52
Host Name : mars.rdd.mcdermott.com
Cluster Name : saturn
Format : AdvFS: AdvFS domain $domain is full
Reference : cat:evmexp.cat:450
Variable Items:
domain (STRING) = "nm"
======================================================================
------------- End Forwarded Message -------------
This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:48:55 EDT