Proper Openfiler Installation

Here is my recommended Openfiler installation guide. I initially was going to use pen/flash/usb/thumb drives, but I found out that they are a) very slow, b) somewhat unreliable and c) have a limited write-cycle life.

This is part one of two.

Openfiler Installation - Part I

This setup assumes a configuration of a Chenbro case, motherboard with 2 GB nics on board, an extra NIC for management, a PCI-X slot, 2 small hard drives for booting attached to the motherboard, an Areca 1230 RAID Card,2 GB of RAM and a bunch of SATA disks attached to the Areca card.

At the end of this installation, you will end up with a reliable NFS/iSCSI box that can be used with VMware ESX with good performance. The machine will boot from the hard drives attached to the motherboard, so all hard drive slots (12 available) can be used for storage drives. We did try to use USB sticks to boot from, but they were a) somewhat unreliable and b) have a limited write-cycle (1-5 million writes) and c) quite slow.

You need to have 3 IP’s for the machine – one for management and one for the monitoring of the Areca card. Then you need 1 IP for the iSCSI/NFS traffic – this one is usually on a different subnet.

1) Setup your hardware.
2) Boot the machine – set BIOS appropriately (make boot order CD, then motherboard attached hard drive boot disks)
3) Go into Areca RAID – Press F6
4) Setup IP for Areca card in Ethernet config – default password is 0000
5) Setup RAID volume as one large volume across all disks – either use Quick Volume & Raid setup, or create a Raid and then a Volume
6) Press F10 to Reset/Exit
7) Boot from Openfiler 2.3 64 bit
8) From boot prompt type: expert text
9) Skip the media test
10) Press OK on Welcome to Openfiler
11) Keyboard – US
12) Use Disk Druid
13) Initialize – Yes
14) If any partitions – wipe them out
15) Create a new 200 MB with Filesystem Type: software raid on the first boot disk (usually sda – these will be the smaller disks) – Note that you need to pick the correct hard drive to apply to – only one at a time. Use TAB to move from selection to selection and cursor keys to move up/down.
16) Do the same for the 2nd boot disk (usually sdb)
17) Create a new 10000 MB with Filesystem Type: software raid on the first boot disk
18) Do the same for the 2nd boot disk (usually sdb)
19) Create a new 5000 MB swap partition on each of the boot disks (sda and sdb)
20) Before you begin this step, note which partitions are the 200 MB ones. Now use the RAID option on the partition overview screen. Type “/boot” in the mount point (only type what is inside the quotes). Filesystem type should be ext3. Use RAID1 and only include the 200 MB partitions on each of the 2 boot disks.
21) Again use the RAID option to create a “/” mount point. Again use RAID1, ext3 and use the remaining 2 partitions - one on each disk.
22) Click OK
23) Configure the Ethernet appropriately (usually we don’t use DHCP) and make sure to Activate on Boot for all of them. Also…only put the management IP in on one of them and put the other two as fake IPs for now as they will be replaced by a bonded connection later.
24) Set the hostname – ex: openfiler1.lexcom.local
25) Set the Timezone to America/Regina (unless you are somewhere else!)
26) Set the password
27) Click OK on Log screen
28) Let it install – takes about 15 minutes
29) When it is finished, it may eject the CD. Put it back in and then reboot to the Openfiler CD. These next steps ensure that the machine will boot from either software raided drive.
30) At the boot prompt, type: linux rescue
31) Click OK on next two screens.
32) Answer No to network interface question
33) Click Continue and then OK on next screen
34) At the shell prompt, type: fdisk –l (this is a lowercase “L”)
35) Note which partitions are the 200 MB boot partitions and which ones are the 10000 MB root partitions. (Usually the boot drives are sda and sdb)
36) We want to mount one of the 10000 MB. So type (replace sda2 in the line below with the correct partition):
mount /dev/sda2 /mnt/source
37) Type: cd /mnt/source/sbin
38) Type: ./grub
39) For these next lines, make sure you use the drives that are the boot drives (again, usually sda and sdb) At the grub prompt type (again, replace sda with the correct drive – this will not have a number as that indicates the partition, only the letter):
device (hd0) /dev/sda
40) Type: root (hd0,0) ß-after this expect unknown partition message
41) Type: setup (hd0)
42) Type: device (hd1) /dev/sdb
43) Type: root (hd1,0) ß-after this expect unknown partition message
44) Type: setup (hd1)
45) Type: quit
46) At the shell prompt, type exit
47) Eject the CD and ensure that the BIOS is set to boot from the motherboard hard drives.
48) Reboot and continue with Openfiler configuration.

I will post part two as soon as it is done.