A.
測試環境:
I.
TSMHA1
(172.20.144.135)
i. Quorum-manager:
Linux Server
II.
TSMHA2
(172.20.144.136)
i. Quorum-manager:
Linux Server
III. WINGPFS1
(172.20.144.137)
i. Nonquorum: Windows
Client
IV.
GPFS掛載點(Linux):/GPFSNSD
V.
GPFS掛載點(Windows):U:
B.
作業系統版本
I. Windows
Server 2008R2 SP1
C.
GPFS主程式及更新檔
I. gpfs-3.4.0.0-WindowsServer2008-x64.msi
II. gpfs-3.4.0.13-WindowsServer2008-x64-update.msi
D.
其他必要安裝程式
I. tracefmt.exe
II. Utilities
and SDK for UNIX-based Applications_AMD64
III.
pkg-current-bootstrap60x64.exe
E.
Windows環境前置設定
1. 新增root帳號,並加入Administrator群組。
Ø ID: root
Ø Group: Administrator
Ø Password: a (所有GPFS主機密碼需一致)
2. 在C:\Users\root\目錄底下新增home目錄
Ø C:\Users\root\home
3. 設定Computer Name
Ø WINGPFS1
4. 分配Static IP Address
Ø IP: 172.20.144.137
5. 修改Windows的hosts檔案,記錄所有nodes主機名稱及IP。
Ø PATH:
C:\Windows\system32\drivers\etc\hosts
6. 關閉User Account Control (UAC)
7. 關閉Firewall
Ø PATH: Server Manager
-> Configuration -> Windows firewall
Ø 如下圖,所有的Profile均需設定成off。
8. 複制TraceFmt.exe至C:\Windows\目錄底下。
9. 安裝Subsystem for UNIX-based
Applications (SUA)
Ø PATH: Server Manager
-> Features -> Add Features
10. 安裝Utilities and SDK for
UNIX-based Applications_AMD64
Ø 選擇Custom Installation
Ø 依下圖,勾選必要安裝套件。
2.
安裝pkg-current-bootstrap60x64.exe
3.
使用SUA Korn Shell window安裝OpenSSH套件
Ø 開啟Administrator:Korn
Shell
Ø 輸入pkg_update –L openssh
4.
設定各個Node主機SSH免密碼認證連線
Ø 在下列路徑新增 .ssh目錄
C:\Windows\SUA\.ssh\
Ø 確認各個Node主機 .ssh目錄底下的know_hosts檔案都有記錄每個Node主機連線資訊。
F.
Windows GPFS Client端安裝及設定
1.
安裝GPFS主程式及更新檔
I. 安裝GPFS主程式
Ø msiexec /package
gpfs-3.4.0.0-WindowsServer2008-x64.msi AgreeToLicense=yes RemoteShell=no
Property=Value IGNORESUA=yes
II.
安裝GPFS更新檔,在安裝更新檔之前,需先解除安裝主程式版本。
Ø msiexec /uninstall
gpfs-3.4.0.0-WindowsServer2008-x64.msi
Ø msiexec /package
gpfs-3.4.0.0-WindowsServer2008-x64.msi AgreeToLicense=yes RemoteShell=no
Property=Value IGNORESUA=yes
2.
修改下列GPFS服務啟動程式LogOn User為root
I. GPFS
Administrator
II.
GPFS
Startup
3.
開啟Korn Shell,輸入下列指令。
Ø mmwinservctl
set -N WINGPFS1 --account WINGPFS1/root --password a --remote-shell no
n -N:指定Windows Client主機名稱
n --account:指定root帳號名稱
n --password:root密碼
n --remote-shell:設定為NO;若Windows為Server node,則需改為YES。
G.
Linux GPFS Server端設定
1.
在Linux GPFS Server中將Windows Client加入到GPFS Cluster
//新增一個node,並給予Client的角色。
[root@TSMHA1 ~]# mmaddnode -N WINGPFS1:nonquorum
Wed May 30
15:03:48 CST 2012: mmaddnode: Processing node WINGPFS1
mmaddnode:
Command successfully completed
mmaddnode:
Warning: Not all nodes have proper GPFS license designations.
Use
the mmchlicense command to designate licenses as needed.
mmaddnode: Propagating
the cluster configuration data to all
affected nodes. This is an
asynchronous process.
//查詢nodes,確認是否有正確被新增。
[root@TSMHA1 ~]# mmlsnode
GPFS
nodeset Node list
------------- -------------------------------------------------------
TSMHA1 TSMHA1
TSMHA2 WINGPFS2 WINGPFS1
|
2.
賦予Client license到WINGPFS1
[root@TSMHA1 ~]# mmchlicense client --accept -N WINGPFS1
The following
nodes will be designated as possessing GPFS client licenses:
WINGPFS1
mmchlicense:
Command successfully completed
mmchlicense:
Propagating the cluster configuration data to all
affected nodes. This is an asynchronous process.
//查詢License分配狀況
[root@TSMHA1 ~]# mmlslicense -L
Node name Required license Designated license
------------------------------------------------------------------------------------------------------
TSMHA1 server server
TSMHA2 server server
WINGPFS2 client client
WINGPFS1 client client
Summary
information
-------------------------------------------------------------------------------------------------------
Number of nodes
defined in the cluster:
4
Number of
nodes with server license designation: 2
Number of
nodes with client license designation: 2
Number of
nodes still requiring server license designation: 0
Number of nodes still requiring client
license designation: 0
|
3.
在Cluster Configuration中加入Windows掛載磁碟機代號。
//將GPFS File system的Windows磁碟機代號設定為U槽。
[root@TSMHA1 ~]# mmchfs gpfsfs -t U
mmchfs: Propagating the cluster configuration data
to all
affected
nodes. This is an asynchronous
process.
//啟動GPFS服務
[root@TSMHA1 ~]# mmstartup -a
Wed
May 30 15:24:51 CST 2012: mmstartup: Starting GPFS ...
//查詢GPFS File system設定
[root@TSMHA1
~]# mmlsfs all
File system
attributes for /dev/gpfsfs:
=======================================
flag value description
-------------------
------------------------ -----------------------------------
-f 32768 Minimum fragment size in
bytes
-i 512 Inode size in bytes
-I 32768 Indirect block size in
bytes
-m 1 Default number of
metadata replicas
-M 2 Maximum number of metadata replicas
-r 1 Default number of
data replicas
-R 2 Maximum number of
data replicas
-j cluster Block allocation type
-D nfs4 File locking semantics
in effect
-k all ACL semantics in effect
-n 32 Estimated number of
nodes that will mount file system
-B 1048576 Block size
-Q none Quotas enforced
none Default quotas enabled
--filesetdf No Fileset df enabled?
-V
12.10 (3.4.0.7) File system version
--create-time Tue May 29 15:41:05 2012 File system
creation time
-u Yes Support for large LUNs?
-z No Is DMAPI enabled?
-L 4194304 Logfile size
-E Yes Exact mtime mount
option
-S No Suppress atime mount
option
-K whenpossible Strict replica allocation option
--fastea Yes Fast external
attributes enabled?
--inode-limit 67584 Maximum number of inodes
-P system Disk storage pools in file
system
-d mynsd1 Disks in file system
-A yes Automatic mount option
-o none Additional mount options
-T /GPFSNSD Default mount point
-t U Default Windows drive
letter
--mount-priority 0 Mount priority
|
4.
確認GPFS服務啟動及磁碟掛載狀態
[root@TSMHA1 ~]# mmgetstate -a
Node
number Node name GPFS state
---------------------------------------------------------------
1 TSMHA1 active
2 TSMHA2 active
3 WINGPFS2 active
4
WINGPFS1 active
[root@TSMHA1 ~]# mmlsmount all -L
File system gpfsfs is mounted on 4 nodes:
172.20.144.135 TSMHA1
172.20.144.136 TSMHA2
172.20.144.137 WINGPFS1
172.20.141.138 WINGPFS2
|
5.
Windows
Client磁碟機掛載狀態