IBM ESS 5000 SC Series Installation instructions

IBM Elastic Storage System 5000
Version 6.0.1
Hardware Guide
IBM
SC28-3155-00

Note
Before using this guide and the product it supports, read the information in Chapter 1, “Notices,” on
page 1.
This edition applies to version 6 release 0 modication 1 of the following product and to all subsequent releases and
modications until otherwise indicated in new editions:
• IBM Spectrum® Scale Data Management Edition for IBM ESS (product number 5765-DME)
• IBM Spectrum Scale Data Access Edition for IBM ESS (product number 5765-DAE)
IBM welcomes your comments; see the topic “How to submit your comments” on page xi. When you send information
to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without
incurring any obligation to you.
© Copyright International Business Machines Corporation 2020.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with
IBM Corp.

Contents
Figures.................................................................................................................. v
Tables................................................................................................................. vii
About this information.......................................................................................... ix
Who should read this information...............................................................................................................ix
IBM Elastic Storage System information units...........................................................................................ix
Related information......................................................................................................................................x
Conventions used in this information.......................................................................................................... x
How to submit your comments...................................................................................................................xi
Chapter 1. Notices................................................................................................. 1
Trademarks.................................................................................................................................................. 2
Homologation statement.............................................................................................................................3
Safety and environmental notices...............................................................................................................3
Safety notices and labels....................................................................................................................... 3
Special caution and safety notices........................................................................................................ 8
Environmental notices......................................................................................................................... 10
Electromagnetic compatibility notices......................................................................................................11
Canada Notice...................................................................................................................................... 11
European Community and Morocco Notice.........................................................................................11
Germany Notice....................................................................................................................................11
Japan Electronics and Information Technology Industries Association (JEITA) Notice...................12
Japan Voluntary Control Council for Interference (VCCI) Notice ...................................................... 12
Korea Notice.........................................................................................................................................13
People's Republic of China Notice.......................................................................................................13
Russia Notice........................................................................................................................................13
Taiwan Notice.......................................................................................................................................13
United States Federal Communications Commission (FCC) Notice................................................... 13
Chapter 2. System overview.................................................................................15
High-level architecture.............................................................................................................................. 15
Servers....................................................................................................................................................... 16
ESS 5000 product line-up......................................................................................................................... 18
Enclosures..................................................................................................................................................22
Network topology.......................................................................................................................................23
Operating system and software levels......................................................................................................26
Reliability, availability, and serviceability features...................................................................................26
Warranty information.................................................................................................................................26
Chapter 3. Installing............................................................................................27
Installation prerequisites (SSR task)........................................................................................................ 28
Installation steps (SSR task)..................................................................................................................... 28
Node combination rules............................................................................................................................ 29
Mixing ESS 3000, ESS 5000, and/or legacy ESS................................................................................. 29
Checking I/O servers................................................................................................................................. 30
Checking ESS management server and protocol nodes...........................................................................39
Chapter 4. Troubleshooting (SSR tasks)................................................................41
iii

EMS issues................................................................................................................................................. 41
Network switch issues...............................................................................................................................43
SSR port login issues................................................................................................................................. 43
Assigning the management IP address.................................................................................................... 43
Appendix A. Planning worksheets (customer task)............................................... 45
Installation worksheet...............................................................................................................................45
Appendix B. 5105 22E: Reference information......................................................49
Accessibility features for the system....................................................................51
Accessibility features.................................................................................................................................51
Keyboard navigation.................................................................................................................................. 51
IBM and accessibility.................................................................................................................................51
Glossary..............................................................................................................53
Index.................................................................................................................. 61
Index.................................................................................................................. 61
iv

Figures
1. ESS 5000 high-level software architecture................................................................................................15
2. System management topology................................................................................................................... 16
3. Components of a management container.................................................................................................. 16
4. EMS in ESS 5000 environment................................................................................................................... 17
5. ESS 5000 system with Model 106 expansion enclosures......................................................................... 19
6. Raw capacity of ESS 5000 SC variants....................................................................................................... 20
7. ESS 5000 with Model 092 expansion enclosures......................................................................................21
8. Raw capacity of ESS 5000 SL variants........................................................................................................21
9. Model 106 expansion enclosure rear view.................................................................................................22
10. Model 106 expansion enclosure disk locations.......................................................................................22
11. Model 092 expansion enclosure rear view.............................................................................................. 23
12. Model 092 expansion enclosure disk locations.......................................................................................23
13. ESS 5000 network topology..................................................................................................................... 24
14. I/O node P2P cabling................................................................................................................................ 24
15. Protocol node P2P cabling........................................................................................................................25
16. EMS server P2P cabling............................................................................................................................ 25
17. SAS HBA port schema...............................................................................................................................25
18. ESS 5000 network.....................................................................................................................................27
19. PuTTY conguration example...................................................................................................................31
20. Connecting a laptop to the serial port in the EMS node...........................................................................41
v

vi

Tables
1. Conventions................................................................................................................................................... x
vii

viii

About this information
Who should read this information
This information is intended for administrators of IBM Elastic Storage® System (ESS) that includes IBM
Spectrum Scale RAID.
IBM Elastic Storage System information units
IBM Elastic Storage System (ESS) 5000 documentation consists of the following information units.
Information unit Type of information Intended users
Hardware Guide This unit provides ESS 5000 information
including system overview, installing, and
troubleshooting.
System administrators and IBM
support team
Quick Deployment
Guide
This unit provides ESS 5000 information
including the software stack, deploying,
upgrading, and best practices.
System administrators,
analysts, installers, planners,
and programmers of IBM
Spectrum Scale clusters who
are very experienced with the
operating systems on which
each IBM Spectrum Scale
cluster is based
Model 092 storage
enclosures
This unit provides information including initial
hardware installation and setup, and removal
and installation of eld-replaceable units
(FRUs), customer-replaceable units (CRUs) for
ESS 5000 Expansion – Model 092, 5147-092.
System administrators and IBM
support team
Model 106 storage
enclosures
This unit provides information including
hardware installation and maintenance for ESS
5000 Expansion – Model 106.
System administrators and IBM
support team
Problem
Determination Guide
This unit provides ESS 5000 information
including setting up call home, replacing
servers, issues, maintenance procedures, and
troubleshooting.
System administrators and IBM
support team
Command
Reference
This unit provides information about ESS
commands and scripts.
System administrators and IBM
support team
IBM Spectrum Scale
RAID:
Administration
This unit provides IBM Spectrum Scale RAID
information including administering, monitoring,
commands, and scripts.
• System administrators of IBM
Spectrum Scale systems
• Application programmers
who are experienced with
IBM Spectrum Scale systems
and familiar with the
terminology and concepts in
the XDSM standard
© Copyright IBM Corp. 2020 ix

Related information
Related information
For information about:
• IBM Spectrum Scale, see:
http://www.ibm.com/support/knowledgecenter/STXKQY/ibmspectrumscale_welcome.html
• mmvdisk command, see mmvdisk documentation.
• Mellanox OFED (MLNX_OFED v4.9-0.1.7.0) Release Notes, go to https://docs.mellanox.com/display/
OFEDv490170/Release%20Notes
Conventions used in this information
Table 1 on page x describes the typographic conventions used in this information. UNIX le name
conventions are used throughout this information.
Table 1. Conventions
Convention Usage
bold Bold words or characters represent system elements that you must use literally,
such as commands, flags, values, and selected menu options.
Depending on the context, bold typeface sometimes represents path names,
directories, or le names.
bold
underlined
bold underlined keywords are defaults. These take effect if you do not specify a
different keyword.
constant width Examples and information that the system displays appear in constant-width
typeface.
Depending on the context, constant-width typeface sometimes represents path
names, directories, or le names.
italic Italic words or characters represent variable values that you must supply.
Italics are also used for information unit titles, for the rst use of a glossary term,
and for general emphasis in text.
<key>Angle brackets (less-than and greater-than) enclose the name of a key on the
keyboard. For example, <Enter> refers to the key on your terminal or workstation
that is labeled with the word Enter.
\In command examples, a backslash indicates that the command or coding example
continues on the next line. For example:
mkcondition -r IBM.FileSystem -e "PercentTotUsed > 90" \
-E "PercentTotUsed < 85" -m p "FileSystem space used"
{item}Braces enclose a list from which you must choose an item in format and syntax
descriptions.
[item]Brackets enclose optional items in format and syntax descriptions.
<Ctrl-x>The notation <Ctrl-x> indicates a control character sequence. For example,
<Ctrl-c> means that you hold down the control key while pressing <c>.
item... Ellipses indicate that you can repeat the preceding item one or more times.
x About this information