Novell Home

AppNote: Installation and Configuration of 2 Node iSCSI Based Cluster Using NetWare 6.5 SP1

Novell Cool Solutions: AppNote
By Svetlin Petrov

Digg This - Slashdot This

Posted: 13 Apr 2004
 

Svetlin Petrov
CNE5, CNE6, CDE, CNI
SPetrovREMOVETHIS@myrealbox.com

Abstract:

NetWare 6.5 supports the iSCSI - a new internet standard which defines how industry standard SCSI (Small Computer Systems Interface) storage protocols are run over industry standard TCP/IP. iSCSI on Gigabit Ethernet hardware is a fraction of the cost of a full Fiber Channel SAN solution. The iSCSI Target and Initiator components included in NetWare 6.5 allow NetWare 6.5 to be used as an iSCSI Disk Server (shared disk system) for Novell Cluster Services.

Table of Contents

1.0 Introduction
2.0 Installation
3.0 iSCSI Target Configuration
3.1 Using NetWare Remote Manager
3.2 Using NSS Management Utility - NSSMU
3.3 Adding eDirectory Trustees
4.0 iSCSI Initiators Configuration
4.1 Loading iSCSI Initiators
4.2 Adding iSCSI Target Connection
4.3 Using iSCSI Initiator Commands
5.0 Novell Cluster Services Installation
6.0 Clustered NSS Pool and Volume Creation and Configuration
6.1 Using NSS Management Utility - NSSMU
6.2 Using Novell iManager
6.3 Using NetWare Remote Manager
7.0 Management and Configuration of Novell Cluster Services
7.1 Using ConsoleOne
7.2 Using NetWare Remote Manager
7.3 Using Novell iManager
7.4 Using console commands
8.0 Additional Information

Video versions:

iSCSI Configuration (3.64 MB)
Cluster Services Installation (2.29 MB)
Cluster Services Configuration and Management (7.51 MB)

Note: UnZIP the archives and open the HTML file. Macromedia Flash support is required for your browser.

1.0 Introduction

This lab guide can be used on three NetWare 6.5 SP1 servers - iSCSI-TARGET, CLUSTER-NODE1 and CLUSTER-NODE2. As Novell Small Business Suite (SBS) 6.5 is based on NetWare 6.5 SP1, the same procedure can be used for SBS 6.5. The iSCSI-TARGET server will provide the shared storage system and the other two NetWare 6.5 servers will access it using the support included in NetWare 6.5 for iSCSI.

NetWare 6.5 SP1 overlay installation ISO images can be downloaded from http://support.novell.com/filefinder/18197/index.html.
The IP addresses of the three servers are as follows:
iSCSI-TARGET - 10.0.0.120, CLUSTER-NODE1 - 10.0.0.121, CLUSTER-NODE2 - 10.0.0.122.

2.0 Installation

During the installation of the iSCSI-TARGET NetWare 6.5 SP1 server the "iSCSI Target" component must be selected.


Click to view larger image.

The installation will copy the necessary files and will add the ton.ncf command to the autoexec.ncf file of the iSCSI-TARGET server. When the server is rebooted all iSCSI target NLMs will load automatically.


3.0 iSCSI Target Configuration

The next step is the creation of the iSCSI partition. For this purpose you can use two NetWare 6.5 management utilities - NSSMU and NetWare Remote Manager.

  1. Log in NetWare Remote Manager with Admin equivalent user using the following URL:

    https://iSCSI-Target-Server-IP-Address-or-DNS-Name:8009


  2. Choose Partition Disks
  3. Select the device with free space which will hold the iSCSI partition and after that choose Create.



  4. Choose Novell iSCSI for the partition type.
  5. Click on Create a New partition and after that enter the size of the iSCSI partition.
  6. Click on CREATE to finish the creation of the iSCSI partition.

The iSCSI partition can also be created with the NSS Management Utility.

  1. Type NSSMU from the system console to start NSS Management Utility.
  2. Choose Partitions and press Ins.
  3. Choose a free space and press ENTER.
  4. From Select Partition Type select iSCSI.



  5. Enter the size of the new iSCSI partition and label (optional).



  6. Choose Create.

A new iSCSI partition is created and it's listed as iSCSI partition in NSSMU and NetWare Remote Manager.


Click to view larger image.

This screen shot shows the iSCSI partition in NSSMU.


Click to view larger image.

This screen shot shows the iSCSI partition in NetWare Remote Manager.

The iSCSI target modules can be unloaded using the command toff and loaded with the command ton from the system console.


Click to view larger image.

After the iSCSI partition in eDirectory is created an object is created which represents it. The two cluster node NetWare servers must be added as trustees of the eDirectory object of the iSCSI partition. To do this:

  1. Start ConsoleOne



  2. Choose the iSCSI object - it's name is something like:

    iscsi-802a42ad-c845-d811-b30d-0050da351dd8


  3. Right-click on the iSCSI object and choose Properties and after that Add Trustee...
  4. Choose the eDirectory objects of the CLUSTER-NODE1 and CLUSTER-NODE2 servers.



  5. The default assigned rights are enough (Browse).
  6. Click on OK to save the changes.

The two cluster node NetWare servers can be added as trustees of the eDirectory object of the iSCSI partition using Novell iManager also.

4.0 iSCSI Initiators Configuration

On each of the NetWare 6.5 SP1 cluster nodes load the iSCSI initiator modules executing the command ion from the system console.


Click to view larger image.


Click to view larger image.

After that configure the iSCSI initiators of every cluster node server to connect to the iSCSI target.

  1. Using NetWare Remote Manager choose iSCSI Services in the Storage Services section and click on the Add Target.



  2. In the Network Address: field enter the IP address of the iSCSI target server and press Next >>.



  3. On the next screen a list will be displayed of the available iSCSI targets. If the iSCSI initiator server is not configured to be a trustee of the iSCSI partition eDirectory object this screen will not show any iSCSI targets. Choose the iSCSI target which will be used for the cluster and press Next >>.



  4. The next screen shows the established iSCSI sessions.

Click to view larger image.

This screen shot shows the storage session of the Cluster-Node1 server.


This screen shot shows the storage session of the Cluster-Node2 server.

The storage session can be established from the system console using the iSCSI initiator commands also.
For example:

iscsinit connect 10.0.0.120 iqn.1984-08.com.novell:iscsi-802a42ad-c845-d811-b30d-0050da351dd8.test


Click to view larger image.

It's necessary to configure both cluster node servers to connect to the iSCSI target every time during the boot process. To do this:

  1. Copy the name of the iSCSI target in the clipboard.



  2. Open for editing the file SYS:\SYSTEM\ION.NCF on each of the cluster node servers, add the command iscsinit connect 10.0.0.120 and paste the name of the iSCSI target next to it.


    The command in the ion.ncf file on each of the cluster nodes should be:

    iscsinit connect iSCSI_Target_Address iSCSI_Target_Name

    For the test servers used in this lab guide it's:

    iscsinit connect 10.0.0.120 iqn.1984-08.com.novell:iscsi-802a42ad-c845-d811-b30d-0050da351dd8.test


  3. Add the ion command to the Autoexec.ncf file of each cluster node server.



  4. Select the device which represent the iSCSI target and press F6 to share it for clustering.
  5. Check every cluster node server if the the iSCSI target name is displayed in the list of the available devices. This can be done with NSSMU, NetWare Remote Manager, iManager or from the system console using the list devices command.




The next step is the installation of the Novell Cluster Services.

5.0 Novell Cluster Services Installation

  1. From the NetWare 6.5 SP1 OS CD start NWDEPLOYNOBROWSER.EXE. Of course you can use the Autorun function of the CD and follow the instructions from the browser window which will open automatically.



  2. Novell NetWare Deployment Manager will start.



  3. From the Post-Installation Tasks choose Install/Upgrade Cluster.


  4. Press Next >.



  5. From the next screen choose Create new cluster and press Next >.



  6. Enter the name of the cluster object and browse the eDirectory tree for a container for the new cluster.



  7. For this lab guide the organizational unit (OU) Cluster Services is used, but you can use another name or choose the Organization object (O) as a container for the new cluster.



  8. Press Next >.



  9. Browse the eDirectory tree and select the two servers which will participate in the cluster. If you want to add more than two cluster nodes an additional license is required.





  10. Each of the selected servers is accessed and if it has more than one IP address the installation prompts for which IP address will be used for the cluster services.



  11. After the two cluster node servers are selected press Next >.



  12. Enter the IP address which will be used by the cluster and press Next >. This IP address will be always available when the cluster is running.



  13. Select the storage device with shared media and press Next >.



  14. If you want the clustering components to start automatically choose the Yes option and press Next >.



  15. The installation program will copy the necessary files and will create the eDirectory cluster objects.



  16. The installation will add the LDNCS.NCF command to the Autoexec.ncf file of each cluster node server.


    Check if the LDNCS.NCF command is added after the ion command. If not - move the LDNCS.NCF command after the ion command. This is necessary because the iSCSI initiator modules must load and connect to the iSCSI target before cluster services begin to load.


  17. The final window informs you that the installation is complete.


Next the clustering modules will load on both cluster nodes and CLUSTER-NODE1 and CLUSTER-NODE2 will join the TEST_CLUSTER.


Click to view larger image.


Click to view larger image.

6.0 Clustered NSS Pool and Volume Creation and Configuration

This task can be done using NSS Management Utility from the system console or using Novell iManager or NetWare Remote Manager. When a clustered NSS pool is created, the volumes which are created on it can be cluster enabled if they must be highly available.

To create clustered NSS pool with NSSMU:

  1. Type NSSMU from the system console to start NSS Management Utility.
  2. Choose Pools and press Ins.
  3. Enter the name for the new NSS pool (for example GRPWISE) and press ENTER.



  4. From Available Partitions select the iSCSI partition which is used by both cluster nodes and press ENTER.



  5. Enter the size of the NSS partition for the new pool.



  6. On the Create Pool window enter the IP address of the clustered pool. Each clustered pool must have its own IP address.



  7. If necessary, edit the Virtual Server Name and CIFS Server Name names and enter the appropriate names for your environment.
  8. If the cluster will offer CIFS and AFP highly available services choose Yes for CIFS and AFP in the Advertising Protocols section.
  9. Press Create to finish the process of clustered pool creation.
  10. Check on the Logger screen of the NetWare server if the pool is created and activated and the secondary IP address associated with the pool is added.

To create clustered NSS pool with Novell iManager:

  1. Log in iManager with Admin equivalent user. One of the ways to do this is to use the following URL: http://Server-IP-Address-or-DNS-Name/nps/iManager.html.
  2. Choose Pools from the Storage Roles and Tasks in iManager.
  3. Browse the eDirectory tree and choose the eDirectory object of some of the cluster node servers.



  4. Press New... and enter the name of the clustered pool in the New Pool window.



  5. Press Next >> and in the next New Pool window enter the size of the new pool. The Cluster Enable on Creation and Activate On Creation options are checked by default.



  6. Press Next >> and in the next New Pool window enter the IP address of the clustered pool.



  7. If necessary edit the Virtual Server Name and Server Name (CIFS server name) names and enter the appropriate names for your environment.
  8. If the cluster will offer CIFS and AFP highly available services choose Yes for CIFS and AFP in the Advertising Protocols section.
  9. Press Finish to finish the process of clustered pool creation.
  10. Check on the Logger screen of the NetWare server if the pool is created and activated and the secondary IP address associated with the pool is added.

The next step is the creation of a volume on the clustered NSS pool. This can be done again using NSS Management Utility from the system console or using iManager.

  1. Log in iManager with Admin equivalent user. One of the ways to do this is to use the following URL: http://Server-IP-Address-or-DNS-Name/nps/iManager.html
  2. Choose Volumes from the Storage Roles and Tasks in iManager.
  3. Browse the eDirectory tree and choose the eDirectory object of some of the cluster node servers.



  4. Press New... and enter the name of the volume in the New Volume window.



  5. Press Next >> and in the next New Volume window enter the size of the new volume and choose the cluster enabled pool which was created.



  6. Press Next >> and in the next New Volume window change the default properties of the new volume if necessary.



  7. Press Finish.



  8. The new volume is created on the clustered NSS pool.

To create clustered NSS pool and volume with NetWare Remote Manager:

  1. Log in NetWare Remote Manager with Admin equivalent user using the following URL:

    https://Cluster-Node-1-or-2-Server-IP-Address-or-DNS-Name:8009


  2. Choose Partition Disks and find the iSCSI HAM device which represent the iSCSI target and after that choose Create.



  3. Choose Novell Storage Services for the Partition Type.
  4. Click on Create a New Pool and Volume.



  5. Enter the size and the name of the pool.
  6. Enter the name of the new volume and choose the appropriate volume attributes for your environment.
  7. Click on CREATE to finish the pool and volume creation.



  8. On the next screen enter the IP address of the clustered pool and choose which advertising protocols to use.



  9. Click on Create to finish cluster pool enabling.

7.0 Management and Configuration of Novell Cluster Services

You can manage and configure the cluster using ConsoleOne, NetWare Remote Manager and Novell iManager. The cluster management and configuration functionality was added to iManager in NetWare 6.5 SP1.

From ConsoleOne - browse the eDirectory tree for the cluster object container.


Click to view larger image.

To switch from Console View to Cluster State View:

  1. Right click on the cluster object.
  2. From the Views choose Cluster State View

Click to view larger image.

From NetWare Remote Manager - choose Clustering and use Cluster Config or Cluster Management.


Click to view larger image.


Click to view larger image.

From Novell iManager - choose Cluster Administration task in Roles and Tasks and use Configure, Cluster Management or Event Log.


Click to view larger image.


Click to view larger image.

Using the help cluster command from the system console you can see the available cluster console commands.


Click to view larger image.

If you restart CLUSTER-NODE1 or CLUSTER-NODE2 the GRPWISE volume and the pool IP address will be activated automatically on the remaining running cluster node. In addition you can test the GRPWISE_SERVER cluster resource migrating it several times between the cluster nodes.


Click to view larger image.


Click to view larger image.


Click to view larger image.

After the fail-over or migration process of the clustered volumes the network connection will be reconnected automatically.


Click to view larger image.


Click to view larger image.

8.0 Additional Information

You can find additional information about High Availabilty, iSCSI and Clustering in the following BrainShare presentations:

BrainShare 2003

TUT210 - Novell iSCSI - Implementing Affordable SAN Solutions

TUT313 - iSCSI
 

BrainShare 2004

BUS323 - How to Implement a Cluster of Clusters

TUT122 - Planning A High Availability Implementation

TUT223 - Implementing Novell Business Continuity Clusters and Disaster Recovery (OpenOffice format)

TUT317 - Novell iSCSI Building Affordable SAN Solutions

TUT322 - Business Continuity Using NetWare Services

TUT323 - High Availability Concepts of Novell Cluster Services

TUT324 - SAN Design Considerations

TUT340 - How to Successfully Cluster GroupWise

TUT392 - N-way Dimensional Storage Cluster Architecture for Novell Environments

AppNotes

In addition the following Novell AppNotes describe how to cluster-enable DHCP, DNS, SLP and Novell BorderManager.

Novell AppNotes October 2003
Cluster-Enabling DHCP, DNS, and SLP Services in NetWare 6

Novell AppNotes September 2003
Running Novell BorderManager on Novell Cluster Services

iSCSI Initiators Download

The iSCSI initiators for NetWare 5.1 and NetWare 6 can be downloaded from http://www.novell.com/download


Novell Cool Solutions (corporate web communities) are produced by WebWise Solutions. www.webwiseone.com

© 2014 Novell