SUMMARY: LSM+Raid5 configuration in a box contains 3 disks conne cted wit a SCSI cable(no raid controller)

From: Padiyath Kumar (Kumar.Padiyath@psi.ch)
Date: Wed Jun 11 2003 - 08:16:24 EDT


   Hallo,
    I got 1 reply from Senulis Joseph. Thanks very much. It was very
helpful. Now I have created
    my Raid5 volume. Iam enclosing the reply from Joe . I did the following.

    The OS is Tru64 V5.1A (PK4)
    
    My disks are dsk2, dsk3, dsk4, dsk5. Iam not using all the partitions.
>From dsk2, dsk3 and dsk4
    I use 'h' partiotion. Dsk5 is used for log information. All the disks
except dsk5 are partitioned
    in the same way.For example dsk2 looks like:

 # /dev/rdisk/dsk2c:
type: SCSI
disk: ST336607LW
label:
flags: dynamic_geometry
bytes/sector: 512
sectors/track: 720
tracks/cylinder: 2
sectors/cylinder: 1440
cylinders: 49855
sectors/unit: 71687372
rpm: 10033
interleave: 1
trackskew: 102
cylinderskew: 102
headswitch: 0 # milliseconds
track-to-track seek: 0 # milliseconds
drivedata: 0

8 partitions:
# size offset fstype fsize bsize cpg #
~Cyl values
  a: 400000 0 unused 0 0 #
0 - 277*
  b: 1400000 400000 unused 0 0 # 277*-
1249
  c: 71687372 0 unused 0 0 # 0
- 49782*
  d: 400000 1800000 unused 0 0 # 1250 -
1527*
  e: 0 0 unused 0 0 #
0 - 0
  f: 0 0 unused 0 0 #
0 - 0
  g: 0 0 unused 0 0 #
0 - 0
  h: 69487372 2200000 LSMsimp # 1527*-
49782*

disklabel -r dsk5:
 =============

# /dev/rdisk/dsk5c:
type: SCSI
disk: ST336607LW
label:
flags: dynamic_geometry
bytes/sector: 512
sectors/track: 720
tracks/cylinder: 2
sectors/cylinder: 1440
cylinders: 49855
sectors/unit: 71687372
rpm: 10033
interleave: 1
trackskew: 102
cylinderskew: 102
headswitch: 0 # milliseconds
track-to-track seek: 0 # milliseconds
drivedata: 0

8 partitions:
# size offset fstype fsize bsize cpg #
~Cyl values
  a: 400000 0 unused 0 0 #
0 - 277*
  b: 1400000 400000 unused 0 0 # 277*-
1249
  c: 71687372 0 unused 0 0 # 0
- 49782*
  d: 400000 1800000 unused 0 0 # 1250 -
1527*
  e: 0 0 unused 0 0 #
0 - 0
  f: 0 0 unused 0 0 #
0 - 0
  g: 71683276 0 LSMpubl # 0
- 49780*
  h: 4096 71683276 LSMpriv # 49780*-
49782*

 I used the following commands to create the raid:
   =================================================
        disklabel -wr dsk2
        volsetup -o force dsk2h
        volprint -ht
        voldiskadd dsk3h dsk4h
        volmake sd disk01-01 disk01,2200000,60000000
        volmake sd disk02-01 disk02,2200000,60000000
        volmake sd disk03-01 dsk2h,2200000,60000000
        voldiskadd dsk5
        volmake sd disk05-01 disk03,0,50000000
        volmake plex plex_r5 layout=raid stwidth=16k
sd=disk01-01,disk02-01,disk03-01
        volmake -U raid5 vol vol5 plex=plex_r5
        volassist addlog vol5 disk03
        volume start vol5
        mkfdmn /dev/vol/rootdg/vol5 data1_domain
        mkfset data1_domain data1
        mount data1_domain#data1 /mnt

    regards,
    Kumar

  Reply from Joe:
  ==============
(1) /usr/sbin/volinstall
(2) /sbin/vold -m disable
(3) /sbin/voldctl init
(4) /sbin/voldg init rootdg
(5) For each disk to be used: - Steps (a) and (b) may not be needed if the
c partition was cleared as above.
        (a) /sbin/disklabel -z <disk> - where <disk>, or "disk
access" name, is the basic OS disk name of the form dsk0.
        (b) /sbin/disklabel -wr <disk>
        (c) /sbin/voldg adddisk <disk>=<disk> - Our convention is
to make the "disk media" name on the left side of the "=" sign the same as
the "disk access" name on the right side.
(6) /sbin/voliod set 2
(7) /sbin/voldctl enable
(8) /sbin/volprint -dt - to get the exact disk sizes of the disks, under
the PUBLEN column.
(9) Make each disk a "sub-disk," except the disk for the log files:
        (a) /sbin/volmake sd <disk>-01 len=<disk size> offset=0
disk=<disk>
(10) Set up plexes:
the AdvFs domain that will use the disk and <##> is a unique two digit
number for each plex.
        (a) For each sub-disk to be used in a RAID-5 volume:
                (i) /sbin/volmake plex <domain>-01 layout=RAID5
stwidth=<#> \ sd=<sub-disk>,... - where <domain> will be the AdvFs
domain that will use the disk and <#> is the stripe width, which must evenly
divide into the disk size. Search for legal values around 16. Note that
all sub-disks are listed here, unlike for mirrored plexes.
(11) Set up volumes:
        (a) For each RAID-5 volume:
                (i) /sbin/volmake -U raid5 vol <domain>
plex=<domain>-<##>
                (ii) /sbin/volume start <domain> - Note that it took
about 3 hours to build a volume consisting of five 18 GB disks.
(12) For each AdvFS domain that will use each LSM volume:
        (a) /sbin/mkfdmn /dev/vol/rootdg/<domain> <domain>
(13) Set up the LSM logs for each volume:
        (a) /sbin/volassist addlog <domain> <log disk/partition>
(14) /volprint -ht | lpr - Write the node name and the date on the
listing and save it with this checklist.
(15) /volprint -l | lpr - Write the node name and the date on the
listing and save it with this checklist.

--Joe



This archive was generated by hypermail 2.1.7 : Sat Apr 12 2008 - 10:49:21 EDT