Red Hat CLUSTER SUITE FOR ENTERPRISE LINUX 5.1 Instalační příručka

Configuring and Managing a Red HatCluster5.1Red Hat Cluster for RedHat Enterprise Linux 5.1ISBN: N/APublication date:

If you spot a typo, or if you have thought of a way to make this manual better, we would love tohear from you. Please submit a report in Bugzilla (htt

domain, if configured).Before the service is added to the cluster configuration, ensure that the Apache HTTP Serverdirectories are not mounted. Then,

• Click Create a Service. Type a Name for the service in the Add a Service dialog.• In the Service Management dialog, select a Failover Domain from th

92

Appendix B. Fence DeviceParametersThis appendix provides tables with parameter descriptions of fence devices.NoteCertain fence devices have an optiona

Field DescriptionIP Address The IP address assigned to the PAP console.Login The login name used to access the PAP console.Password The password used

Table B.6. GNBD (Global Network Block Device)Field DescriptionName A name for the server with HP iLO support.Hostname The hostname assigned to the dev

Field DescriptionLogin The login name of a user capable of issuing power on/offcommands to the given IPMI port.Password The password used to authentic

Field DescriptionPort The switch outlet number.Table B.13. RPS-10 Power Switch (two-node clusters only)Field DescriptionName A name for the SANBox2 de

Field DescriptionName A name for the WTI power switch connected to the cluster.IP Address The IP address assigned to the device.Password The password

Appendix C. Upgrading A Red HatCluster from RHEL 4 to RHEL 5This appendix provides a procedure for upgrading a Red Hat cluster from RHEL 4 to RHEL 5.T

Red Hat Cluster Configuration andManagement OverviewRed Hat Cluster allows you to connect a group of computers (called nodes or members) to worktogeth

• GULM — Run service lock_gulmd stop.f. Run service ccsd stop.3. Disable cluster software from starting during reboot. At each node, run /sbin/chkconf

# gfs_tool sb /dev/my_vg/gfs1 proto lock_dlmYou shouldn't change any of these values if the filesystem is mounted.Are you sure? [y/n] ycurrent lo

102

IndexAACPIconfiguring, 17Apache HTTP Serverhttpd.conf, 88setting up service, 87Cclusteradministration, 13, 49, 79diagnosing and correcting problems, 5

Apache HTTP Serverhttpd.conf, 88setting up, 87Iintegrated fence devicesconfiguring ACPI, 17introduction, viiother Red Hat Enterprise Linux documents,v

• Fibre Channel switch — A Fibre Channel switch provides access to Fibre Channel storage.Other options are available for storage according to the type

relationship among the cluster components. Figure 1.2, “Cluster Configuration Structure” showsan example of the hierarchical relationship among cluste

A brief overview of each configuration tool is provided in the following sections:• Section 2, “Conga”• Section 3, “system-config-cluster Cluster Admi

can manage storage on computers whether they belong to a cluster or not.To administer a cluster or storage, an administrator adds (or registers) a clu

Figure 1.3. luci homebase TabFigure 1.4. luci cluster TabChapter 1. Red Hat Cluster Configuration and Management Overview6

Figure 1.5. luci storage Tab3. system-config-cluster Cluster Administration GUIThis section provides an overview of the cluster administration graphic

While system-config-cluster provides several convenient tools for configuringand managing a Red Hat Cluster, the newer, more comprehensive tool, Conga

The Cluster Configuration Tool represents cluster configuration components in theconfiguration file (/etc/cluster/cluster.conf) with a hierarchical gr

Configuring and Managing a Red Hat Cluster describes the configuration and management ofRed Hat cluster systems for Red Hat Enterprise Linux 5.1 It do

recovery policy for the service. Services are represented as subordinate elements underServices. Using configuration buttons at the bottom of the righ

The nodes and services displayed in the Cluster Status Tool are determined by the clusterconfiguration file (/etc/cluster/cluster.conf). You can use t

12

Before Configuring a Red HatClusterThis chapter describes tasks to perform and considerations to make before installing andconfiguring a Red Hat Clust

Cluster Nodes” lists the IP port numbers, their respective protocols, the components to whichthe port numbers are assigned, and references to iptables

If a cluster node is running luci, port 11111 should already have been enabled.IP PortNumberProtocol Component Reference to Example ofiptables Rules80

10.10.10.0/24 -d 10.10.10.0/24 --dports 11111 -j ACCEPTExample 2.3. Port 11111: ricci (Cluster Node and Computer Running luci)-A INPUT -i 10.10.10.200

10.10.10.0/24 -d 10.10.10.0/24 --dports 50007 -j ACCEPTExample 2.9. Port 50007: ccsd (UDP)3. Configuring ACPI For Use with Integrated FenceDevicesIf y

Soft-Off with one of the following alternate methods:• Changing the BIOS setting to "instant-off" or an equivalent setting that turns off th

• chkconfig --del acpid — This command removes acpid from chkconfigmanagement.— OR —• chkconfig --level 2345 acpid off — This command turns off acpid.

Configuring and Managing a Red Hat Cluster: Red Hat Clusterfor Red Hat Enterprise Linux 5.1Copyright © You need to override this in your local ent fil

NoteThe equivalents to ACPI Function, Soft-Off by PWR-BTTN, and Instant-Offmay vary among computers. However, the objective of this procedure is tocon

3.3. Disabling ACPI Completely in the grub.conf FileThe preferred method of disabling ACPI Soft-Off is with chkconfig management (Section 3.1,“Disabli

title Red Hat Enterprise Linux Server (2.6.18-36.el5)root (hd0,0)kernel /vmlinuz-2.6.18-36.el5 ro root=/dev/VolGroup00/LogVol00console=ttyS0,115200n8

ImportantOverall, heuristics and other qdiskd parameters for your Red Hat Clusterdepend on the site environment and special requirements needed. Tound

NoteUsing JBOD as a quorum disk is not recommended. A JBOD cannot providedependable performance and therefore may not allow a node to write to it quic

No-single-point-of-failure hardware configurationClusters can include a dual-controller RAID array, multiple bonded network channels,multiple paths be

26

Configuring Red Hat Cluster WithCongaThis chapter describes how to configure Red Hat Cluster software using Conga, and consists ofthe following sectio

9. Configuring storage. Refer to Section 10, “Configuring Cluster Storage”.2. Starting luci and ricciTo administer Red Hat Clusters with Conga, instal

Restart the Luci server for changes to take effecteg. service luci restart5. Start luci using service luci restart. For example:# service luci restart

Configuring and Managing a Red Hat Cluster

A progress page shows the progress of those actions for each node in the cluster.When the process of creating a new cluster is complete, a page is dis

NoteFor more information about Post-Join Delay and Post-Fail Delay, refer to thefenced(8) man page.3. Multicast tab — This tab provides an interface f

Parameter DescriptionUse a QuorumPartitionEnables quorum partition. Enables quorum-disk parameters in theQuorum Partition tab.Interval The frequency o

TipIf you are creating a new cluster, you can create fence devices when youconfigure cluster nodes. Refer to Section 6, “Configuring Cluster Members”.

• Creating shared fence devices — Refer to Section 5.1, “Creating a Shared Fence Device”.The procedures apply only to creating shared fence devices. Y

Figure 3.1. Fence Device Configuration3. At the Add a Sharable Fence Device page, click the drop-down box under Fencing Typeand select the type of fen

5.2. Modifying or Deleting a Fence DeviceTo modify or delete a fence device, follow these steps:1. At the detailed menu for the cluster (below the clu

Creating a cluster consists of selecting a set of nodes (or members) to be part of the cluster.Once you have completed the initial step of creating a

4. Click Submit. Clicking Submit causes the following actions:a. Cluster software packages to be downloaded onto the added node.b. Cluster software to

1. Click the link of the node to be deleted. Clicking the link of the node to be deleted causes apage to be displayed for that link showing how that n

Introduction ... vii1. Document Conventions

be started (either manually or by the cluster software).• Unordered — When a cluster service is assigned to an unordered failover domain, themember on

7.1. Adding a Failover DomainTo add a failover domain, follow the steps in this section. The starting point of the procedure isat the cluster-specific

displayed on the cluster tab.1. At the detailed menu for the cluster (below the clusters menu), click Failover Domains.Clicking Failover Domains cause

9. To make additional changes to the failover domain, continue modifications at the FailoverDomain Form page and click Submit when you are done.8. Add

File System ID — When creating a new file system resource, you can leave this field blank.Leaving the field blank causes a file system ID to be assign

Options — Additional client access rights. For more information, refer to the exports(5) manpage, General OptionsNFS ExportName — Enter a name for the

service must be started manually any time the cluster comes up from the stopped state.TipUse a descriptive name that clearly distinguishes the service

link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00inet 127.0.0.1/8 scope host loinet6 ::1/128 scope hostvalid_lft forever preferred_lft forever2: e

• Hard Drives• Partitions• Volume GroupsEach section is set up as an expandable tree, with links to property sheets for specific devices,partitions, a

Managing Red Hat Cluster WithCongaThis chapter describes various administrative tasks for managing a Red Hat Cluster andconsists of the following sect

4. Managing Red Hat Cluster With Conga ...491. Starting, Stopping, and Deleting Cluster

Selecting Start this cluster starts cluster software.• Delete this cluster — Selecting this action halts a running cluster, disables clustersoftware f

• Have node leave cluster/Have node join cluster — Have node leave cluster isavailable when a node has joined of a cluster. Have node join cluster is

2. At the right of each service listed on the page, click the Choose a task drop-down box.Clicking Choose a task drop-down box reveals the following s

Configuring Red Hat Cluster Withsystem-config-clusterThis chapter describes how to configure Red Hat Cluster software usingsystem-config-cluster, and

3. Creating fence devices. Refer to Section 4, “Configuring Fence Devices”.4. Creating cluster members. Refer to Section 5, “Adding and Deleting Membe

Figure 5.1. Starting a New Configuration FileNoteThe Cluster Management tab for the Red Hat Cluster Suite management GUI isavailable after you save th

dialog box if you enable Use a Quorum disk: Interval, TKO, Votes, Minimum Score,Device, Label, and Quorum Disk Heuristic. Table 5.1, “Quorum-Disk Para

Figure 5.2. Creating A New Configuration4. When you have completed entering the cluster name and other parameters in the NewConfiguration dialog box,

Figure 5.3. The Cluster Configuration ToolParameter DescriptionUse a Quorum Disk Enables quorum disk. Enables quorum-disk parameters in the NewConfigu

Parameter Descriptionsame on all nodes.Label Specifies the quorum disk label created by the mkqdisk utility. If thisfield contains an entry, the label

IntroductionThis document provides information about installing, configuring and managing Red Hat Clustercomponents. Red Hat Cluster components are pa

5. Specify the Fence Daemon Properties parameters: Post-Join Delay and Post-Fail Delay.a. The Post-Join Delay parameter is the number of seconds the f

Figure 5.4. Fence Device Configuration2. At the Fence Device Configuration dialog box, click the drop-down box under Add a NewFence Device and select

2. At the bottom of the right frame (labeled Properties), click the Add a Cluster Node button.Clicking that button causes a Node Properties dialog box

box to be displayed.c. At the Fence Configuration dialog box, bottom of the right frame (below Properties),click Add a New Fence Level. Clicking Add a

1. Add the node and configure fencing for it as inSection 5.1, “Adding a Member to a Cluster”.2. Click Send to Cluster to propagate the updated config

cluster.3. Use the scp command to send the updated /etc/cluster/cluster.conf file from one ofthe existing cluster nodes to the new node.4. Start clust

Figure 5.6. Confirm Deleting a Memberd. At that dialog box, click Yes to confirm deletion.e. Propagate the updated configuration by clicking the Send

• Unrestricted — Allows you to specify that a subset of members are preferred, but that acluster service assigned to this domain can run on any availa

• Section 6.1, “Adding a Failover Domain”• Section 6.2, “Removing a Failover Domain”• Section 6.3, “Removing a Member from a Failover Domain”6.1. Addi

Figure 5.7. Failover Domain Configuration: Configuring a FailoverDomain4. Click the Available Cluster Nodes drop-down box and select the members for t

environment.• Global File System: Configuration and Administration — Provides information about installing,configuring, and maintaining Red Hat GFS (R

Figure 5.8. Failover Domain Configuration: Adjusting Priorityb. For each node that requires a priority adjustment, click the node listed in the Member

To remove a failover domain, follow these steps:1. At the left frame of the Cluster Configuration Tool, click the failover domain that you wantto dele

• New cluster — If this is a new cluster, choose File => Save to save the changes to thecluster configuration.• Running cluster — If this cluster i

Options — Mount options.File System ID — When creating a new file system resource, you can leave this field blank.Leaving the field blank causes a fil

addresses (with wild-card support), and netgroups.Read-Write and Read Only options — Specify the type of access rights for this NFS clientresource:• R

2. At the bottom of the right frame (labeled Properties), click the Create a Service button.Clicking Create a Service causes the Add a Service dialog

a Failover Domain” for instructions on how to configure a failover domain.)5. Autostart This Service checkbox — This is checked by default. If Autosta

9. If needed, you may also create a private resource that you can create that becomes asubordinate resource by clicking on the Attach a new Private Re

Propagating the cluster configuration file this way is necessary for the first time acluster is created. Once a cluster is installed and running, the

Managing Red Hat Cluster Withsystem-config-clusterThis chapter describes various administrative tasks for managing a Red Hat Cluster andconsists of th

Italic Courier font represents a variable, such as an installation directory:install_dir/bin/bold fontBold font represents application programs and te

3. service clvmd stop, if CLVM has been used to create clustered volumes4. service cman stopStopping the cluster services on a member causes its servi

You can use the Cluster Status Tool to enable, disable, restart, or relocate a high-availabilityservice. The Cluster Status Tool displays the current

3. Modifying the Cluster ConfigurationTo modify the cluster configuration (the cluster configuration file(/etc/cluster/cluster.conf), use the Cluster

Configuring Red Hat Cluster With system-config-cluster.3. Clicking Send to Cluster causes a Warning dialog box to be displayed. Click Yes to saveand p

6. Clicking File => Save As causes the system-config-cluster dialog box to be displayed.7. At the the system-config-cluster dialog box, select /etc

# chkconfig --level 2345 gfs on# chkconfig --level 2345 clvmd on# chkconfig --level 2345 cman onYou can then reboot the member for the changes to take

86

Appendix A. Example of Setting UpApache HTTP ServerThis appendix provides an example of setting up a highly available Apache HTTP Server on aRed Hat C

systems from accessing the same data simultaneously, which may result in data corruption.Therefore, do not include the file systems in the /etc/fstab

1. Edit the /etc/httpd/conf/httpd.conf configuration file and customize the file according toyour configuration. For example:• Specify the directory t