[HPADM] RE: SUMMARY (for now) RESTATING: lsof doesn't show nfsd? - what is /dev/udp

From: Jeff Lightner (jlightner@water.com)
Date: Mon Nov 28 2005 - 11:18:04 EST


My original question as well as the restated version with additional
details follows this update.

 

I later noticed that lsof DOES report the port for nfsd on HP-UX 11.00 -
the issue only occurs on 11.11 (and probably 11.23 - haven't looked
there).

 

Having gotten no solution on this list or on HP's ITRC forums I decided
to write the author of lsof, Mr. Vic Abell. He not only was gracious
enough to answer but has been doing follow up with his contacts within
HP.

 

The first thing he did was point me to the lsof FAQ which explains why
some ports that would be open are not seen by lsof. As I had never run
into this before and had been using lsof for some years it hadn't even
occurred to me to reread the FAQ. It was an interesting read so I'd
definitely recommend it for any lsof question even if you've been using
it for a while like I have.

 

In any event Vic said it was OK to post an intermediate answer as it may
be some time (if ever) before any changes are made by HP to allow lsof
to see these ports. That is because this isn't exactly a bug but
rather a different way of doing things so HP may or may not decide to
address it.

 

Vic's summary of the reason:

..."lsof is unable to report on the connection parameters (e.g., IP
address, port number, window sizes, queue lengths, etc.) of a TLI/XTI
stream, such as the one nfsd is using, because the PSTAT(2) interface
from which lsof gets all HP-UX 11.11 open file information is not
receiving connection parameters from the kernel TLI/XTI modules and
therefore can't report them to lsof."

 

My thanks to those who responded. Also of course great thanks to Vic
Abell who continues to do follow up with HP.

 

If I hear anything further I'll post another summary.

 

________________________________

From: hpux-admin-owner@DutchWorks.nl
[mailto:hpux-admin-owner@DutchWorks.nl] On Behalf Of Jeff Lightner
Sent: Thursday, October 27, 2005 8:58 AM
To: hpux-admin@DutchWorks.nl
Subject: [HPADM] RESTATING: lsof doesn't show nfsd? - what is /dev/udp

 

OK I've now received a couple of responses that make it appear I haven't
properly explained this. One implies I don't know how to use lsof
which I DO and the other implies the port is not active which it IS and
also implies that /dev/udp doesn't exist which it DOES.

 

So I figure I'll cut and paste what I see:

 

netstat -an |grep 2049

(IPs obfuscated with xx)

tcp 0 0 *.2049 *.*
LISTEN

tcp 0 0 10.0.xx.xx.2049 10.0.xx.xx.599
ESTABLISHED

tcp 0 0 10.0.xx.xx.2049 10.0.xx.xx.607
ESTABLISHED

tcp 0 0 10.0.xx.xx.2049 10.0.xx.xx.811
ESTABLISHED

udp 0 0 *.2049 *.*

udp 0 0 *.2049 *.*

udp 0 0 *.2049 *.*

udp 0 0 *.2049 *.*

 

lsof -i :2049

Shows nothing

 

lsof |grep 2049:

lsof |grep 2049

bptm 28172 root 11u CHR 203,0x1f3100 0t0 2049
/dev/sctl/c31t3l1

(This has nothing to do with nfsd - just showing that nowhere in lsof
does it see PORT 2049).

 

 

lsof |grep nfsd

(We're running 16 nfsd's as this is a filesystem that gets shared out to
almost every other server.)

nfsd 3834 root cwd DIR 64,0x3 8192 2 /

nfsd 3834 root rtd DIR 64,0x3 8192 2 /

nfsd 3834 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3834 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3834 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3834 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3834 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3834 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3834 root 4u STR 21,0x740002 0t0 84
/dev/tcp->rpcmod->tcpm->ip

nfsd 3834 root 5u STR 21,0x30000b 0t0 84
/dev/tcp->rpcmod->tcpm->ip

nfsd 3834 root 7u STR 21,0x2c000e 0t0 84
/dev/tcp->rpcmod->tcpm->ip

nfsd 3834 root 8u STR 21,0xa40005 0t0 84
/dev/tcp->rpcmod->tcpm->ip

nfsd 3834 root 9u STR 21,0x3c000b 0t0 84
/dev/tcp->rpcmod->tcpm->ip

nfsd 3835 root cwd DIR 64,0x3 8192 2 /

nfsd 3835 root rtd DIR 64,0x3 8192 2 /

nfsd 3835 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3835 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3835 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3835 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3835 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3835 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3835 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3840 root cwd DIR 64,0x3 8192 2 /

nfsd 3840 root rtd DIR 64,0x3 8192 2 /

nfsd 3840 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3840 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3840 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3840 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3840 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3840 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3840 root 4u STR 22,0x780002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3841 root cwd DIR 64,0x3 8192 2 /

nfsd 3841 root rtd DIR 64,0x3 8192 2 /

nfsd 3841 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3841 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3841 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3841 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3841 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3841 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3841 root 4u STR 22,0x7c0003 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3842 root cwd DIR 64,0x3 8192 2 /

nfsd 3842 root rtd DIR 64,0x3 8192 2 /

nfsd 3842 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3842 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3842 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3842 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3842 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3842 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3842 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3843 root cwd DIR 64,0x3 8192 2 /

nfsd 3843 root rtd DIR 64,0x3 8192 2 /

nfsd 3843 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3843 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3843 root 4u STR 22,0x7c0003 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3844 root cwd DIR 64,0x3 8192 2 /

nfsd 3844 root rtd DIR 64,0x3 8192 2 /

nfsd 3844 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3844 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3844 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3845 root cwd DIR 64,0x3 8192 2 /

nfsd 3845 root rtd DIR 64,0x3 8192 2 /

nfsd 3845 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3845 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3845 root 4u STR 22,0x7c0003 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3846 root cwd DIR 64,0x3 8192 2 /

nfsd 3846 root rtd DIR 64,0x3 8192 2 /

nfsd 3846 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3846 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3846 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3847 root cwd DIR 64,0x3 8192 2 /

nfsd 3847 root rtd DIR 64,0x3 8192 2 /

nfsd 3847 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3847 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3847 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3848 root cwd DIR 64,0x3 8192 2 /

nfsd 3848 root rtd DIR 64,0x3 8192 2 /

nfsd 3848 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3848 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3848 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3849 root cwd DIR 64,0x3 8192 2 /

nfsd 3849 root rtd DIR 64,0x3 8192 2 /

nfsd 3849 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3849 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3849 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3850 root cwd DIR 64,0x3 8192 2 /

nfsd 3850 root rtd DIR 64,0x3 8192 2 /

nfsd 3850 root txt REG 64,0x7 3270x2 0t0 66
/dev/null

nfsd 3842 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3842 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3842 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3843 root cwd DIR 64,0x3 8192 2 /

nfsd 3843 root rtd DIR 64,0x3 8192 2 /

nfsd 3843 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00 3850 root 0r C 3843 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3843 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3843 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3843 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3843 root 4u STR 22,0x7c0003 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3844 root cwd DIR 64,0x3 8192 2 /

nfsd 3844 root rtd DIR 64,0x3 8192 2 /

nfsd 3844 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3844 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3844 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3844 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3844 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3845 root cwd DIR 64,0x3 8192 2 /

nfsd 3845 root rtd DIR 64,0x3 8192 2 /

nfsd 3845 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3845 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3845 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3845 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3845 root 4u STR 22,0x7c0003 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3846 root cwd DIR 64,0x3 8192 2 /

nfsd 3846 root rtd DIR 64,0x3 8192 2 /

nfsd 3846 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3846 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3846 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3846 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3846 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3847 root cwd DIR 64,0x3 8192 2 /

nfsd 3847 root rtd DIR 64,0x3 8192 2 /

nfsd 3847 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3847 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3847 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3847 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3847 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3848 root cwd DIR 64,0x3 8192 2 /

nfsd 3848 root rtd DIR 64,0x3 8192 2 /

nfsd 3848 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3848 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3848 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3848 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3848 root 4u STR 22,0x800002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3849 root cwd DIR 64,0x3 8192 2 /

nfsd 3849 root rtd DIR 64,0x3 8192 2 /

nfsd 3849 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 45056 30236
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 16384 5411
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 12794 5334
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 135168 955
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 741376 30235
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 1814528 27739
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 24576 4972
/usr (/dev/vg00/lvol7)

nfsd 3849 root mem REG 64,0x7 155648 118
/usr (/dev/vg00/lvol7)

nfsd 3849 root 0r CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 1w CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 2w CHR 3,0x2 0t0 66
/dev/null

nfsd 3849 root 3u FIFO 0x559aa048 0t0 2073

nfsd 3849 root 4u STR 22,0x840002 0t0 81
/dev/udp->nfsm->udpm->ip

nfsd 3850 root cwd DIR 64,0x3 8192 2 /

nfsd 3850 root rtd DIR 64,0x3 8192 2 /

nfsd 3850 root txt REG 64,0x7 32768 780
/usr (/dev/vg00/lvol7)

nfsd 3850 root mem REG 64,0x7 53248 27687
/usr (/dev/vg00/lvol7)

nfsd 3850 root mem REG 64,0x