This shows you the differences between two versions of the page.
Next revision | Previous revision | ||
gpfs:install_scale_linux [2021/03/19 18:52] manu created |
gpfs:install_scale_linux [2022/05/11 23:53] (current) manu |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Spectrum Scale installation ====== | ====== Spectrum Scale installation ====== | ||
+ | |||
+ | If you have a cluster still running, you can populate the config file used by the **spectrumscale** command | ||
+ | |||
+ | https://www.ibm.com/docs/en/spectrum-scale/5.1.0?topic=reference-spectrumscale-command | ||
+ | |||
+ | Definition file location (depend on version): | ||
+ | |||
+ | /usr/lpp/mmfs/5.1.3.1/ansible-toolkit/ansible/ibm-spectrum-scale-install-infra/vars/scale_clusterdefinition.json | ||
+ | |||
+ | |||
+ | **install** | ||
+ | Installs, creates a GPFS cluster, creates NSDs and adds nodes to an existing GPFS cluster. The installation toolkit will use the environment details in the cluster definition file to perform these tasks. If all configuration steps have been completed, this option can be run with no arguments (and pre-install and post-install checks will be performed automatically). | ||
+ | |||
+ | If you want to use only the file systems, or deploy protocols issue these commands: | ||
+ | |||
+ | **deploy** | ||
+ | Creates file systems, deploys protocols, and configures protocol authentication on an existing GPFS cluster. The installation toolkit will use the environment details in the cluster definition file to perform these tasks. If all configuration steps have been completed, this option can be run with no arguments (and pre-deploy and post-deploy checks will be performed automatically). | ||
+ | |||
+ | **upgrade** | ||
+ | Performs upgrade procedure, upgrade precheck, upgrade postcheck, and upgrade related configuration to add nodes as offline, or exclude nodes from the upgrade run. | ||
+ | |||
+ | <cli prompt='#'> | ||
+ | [root@prscale-a-01 ansible-toolkit]# pwd | ||
+ | /usr/lpp/mmfs/5.1.1.0/ansible-toolkit | ||
+ | [root@prscale-a-01 ansible-toolkit]# ./spectrumscale config populate -N prscale-a-01 | ||
+ | [ INFO ] Logging to file: /usr/lpp/mmfs/5.1.1.0/ansible-toolkit/logs/config-populate-02-06-2021_13:17:24.log | ||
+ | [ INFO ] Detected scale_clusterdefinition.json file present in directory /usr/lpp/mmfs/5.1.1.0/ansible-toolkit/ansible/ibm-spectrum-scale-install-infra/vars. | ||
+ | Installer will keep backup of existing scale_clusterdefinition.json file in /usr/lpp/mmfs/5.1.1.0/ansible-toolkit/ansible/ibm-spectrum-scale-install-infra/vars path and populate a new one. Do you want to continue [Y/n]: Y | ||
+ | [ INFO ] Updating existing configuration. It may take few moments .... | ||
+ | [ INFO ] Getting installer path | ||
+ | [ INFO ] Populating protocols detail | ||
+ | [ INFO ] Populating enabled protocols detail | ||
+ | [ INFO ] Populating export ip of ces nodes | ||
+ | [ INFO ] Populating interface details | ||
+ | [ INFO ] Adding admin node into configuration | ||
+ | ... | ||
+ | </cli> | ||
+ | |||
+ | Read the config: | ||
+ | <cli prompt='#'> | ||
+ | [root@prscale-a-01 ansible-toolkit]# ./spectrumscale node list | ||
+ | [ INFO ] List of nodes in current configuration: | ||
+ | [ INFO ] [Installer Node] | ||
+ | [ INFO ] 10.0.0.10 | ||
+ | [ INFO ] | ||
+ | [ INFO ] [Cluster Details] | ||
+ | [ INFO ] Name: scale_01.cluster | ||
+ | [ INFO ] Setup Type: Spectrum Scale | ||
+ | [ INFO ] | ||
+ | [ INFO ] [Protocols] | ||
+ | [ INFO ] Object : Disabled | ||
+ | [ INFO ] SMB : Enabled | ||
+ | [ INFO ] NFS : Enabled | ||
+ | [ INFO ] HDFS : Disabled | ||
+ | [ INFO ] | ||
+ | [ INFO ] [Extended Features] | ||
+ | [ INFO ] File Audit logging : Disabled | ||
+ | [ INFO ] Watch folder : Disabled | ||
+ | [ INFO ] Management GUI : Enabled | ||
+ | [ INFO ] Performance Monitoring : Enabled | ||
+ | [ INFO ] Callhome : Disabled | ||
+ | [ INFO ] | ||
+ | [ INFO ] GPFS Admin Quorum Manager NSD Protocol GUI Perf Mon OS Arch | ||
+ | [ INFO ] Node Node Node Node Server Node Server Collector | ||
+ | [ INFO ] prscale-a-01 X X X X X X X rhel8 x86_64 | ||
+ | [ INFO ] prscale-a-02 X X rhel8 x86_64 | ||
+ | [ INFO ] prscale-b-01 X X X X X X X rhel8 x86_64 | ||
+ | [ INFO ] | ||
+ | [ INFO ] [Export IP address] | ||
+ | [ INFO ] 10.0.0.14 (pool) | ||
+ | [ INFO ] 10.0.0.15 (pool) | ||
+ | </cli> | ||
+ | |||
<code> | <code> | ||
Line 160: | Line 233: | ||
Example of Upgrading protocol nodes / other nodes (not in an ESS) | Example of Upgrading protocol nodes / other nodes (not in an ESS) | ||
Pre-Upgrade planning: | Pre-Upgrade planning: | ||
- | - Refer to the Knowledge Center for supported upgrade paths of Spectrum Scale nodes | + | * Refer to the Knowledge Center for supported upgrade paths of Spectrum Scale nodes |
- | - Consider whether OS, FW, or drivers on the protocol node(s) should be upgraded and plan this either before or after the install toolkit upgrade | + | * Consider whether OS, FW, or drivers on the protocol node(s) should be upgraded and plan this either before or after the install toolkit upgrade |
- | - SMB: requires quiescing all I/O for the duration of the upgrade. Due to the SMB clustering functionality, differing SMB levels cannot co-exist | + | * SMB: requires quiescing all I/O for the duration of the upgrade. Due to the SMB clustering functionality, differing SMB levels cannot co-exist |
within a cluster at the same time. This requires a full outage of SMB during the upgrade. | within a cluster at the same time. This requires a full outage of SMB during the upgrade. | ||
- | - NFS: Recommended to quiesce all I/O for the duration of the upgrade. NFS experiences I/O pauses, and depending upon the client, mounts | + | * NFS: Recommended to quiesce all I/O for the duration of the upgrade. NFS experiences I/O pauses, and depending upon the client, mounts |
may disconnect during the upgrade. | may disconnect during the upgrade. | ||
- | - Object: Recommended to quiesce all I/O for the duration of the upgrade. Object service will be down or interrupted at multiple times during the | + | * Object: Recommended to quiesce all I/O for the duration of the upgrade. Object service will be down or interrupted at multiple times during the |
upgrade process. Clients may experience errors or they might be unable to connect during this time. They should retry as appropriate. | upgrade process. Clients may experience errors or they might be unable to connect during this time. They should retry as appropriate. | ||
- | - Performance Monitoring: Collector(s) may experience small durations in which no performance data is logged, as the nodes upgrade. | + | * Performance Monitoring: Collector(s) may experience small durations in which no performance data is logged, as the nodes upgrade. |
Install Toolkit commands: | Install Toolkit commands: | ||
- | ./spectrumscale setup -s 10.11.10.11 -st ss <- internal gpfs network IP on the current Installer node that can see all protocol nodes | + | ./spectrumscale setup -s 10.11.10.11 -st ss <- internal gpfs network IP on the current Installer node that can see all protocol nodes |
- | ./spectrumscale config populate -N <hostname_of_any_node_in_cluster> | + | ./spectrumscale config populate -N <hostname_of_any_node_in_cluster> |
** If config populate is incompatible with your configuration, add the nodes and CES configuration to the install toolkit manually ** | ** If config populate is incompatible with your configuration, add the nodes and CES configuration to the install toolkit manually ** | ||
- | ./spectrumscale node list <- This is the list of nodes the Install Toolkit will upgrade. Remove any non-CES nodes you would rather do manually | + | ./spectrumscale node list <- This is the list of nodes the Install Toolkit will upgrade. Remove any non-CES nodes you would rather do manually |
- | ./spectrumscale upgrade precheck | + | ./spectrumscale upgrade precheck |
- | ./spectrumscale upgrade run | + | ./spectrumscale upgrade run |
- | </cli> | + | </code> |