Fujitsu PRIMEQUEST 2000 Series Instruction Manual

C122-E175-02EN
FUJITSU Server
PRIMEQUEST
2000 Series
Administration Manual

Preface
i
C122-E175-02EN
Preface
This manual describes the functions and features of the PRIMEQUEST 2000 series. The manual is intended for system
administrators.
For details on the regulatory compliance statements and safety precautions, see the PRIMEQUEST 2000 Series Safety
and Regulatory Information (C122-E171XA).
Errata and addenda for the manual
The PRIMEQUEST 2000 Series Errata and Addenda (C122-E182EN) provides errata and addenda for the manual.
Read the PRIMEQUEST 2000 Series Errata and Addenda (C122-E182EN) thoroughly in reference to the manual.
Organization of this manual
This manual is organized as follows.
CHAPTER 1Network Environment Setup and Tool Installation
CHAPTER 2 Operating System Installation
CHAPTER 3 Component Configuration and Replacement (Add, Remove)
CHAPTER 4 PCI Card Hot Maintenance in Red Hat Enterprise Linux 6
CHAPTER 5 PCI Card Hot Maintenance in SUSE Linux Enterprise Server 11
CHAPTER 6 Replacement of HDD/SSD
CHAPTER 7 PCI Express card Hot Maintenance inWindows
CHAPTER 8 Backup and Restore
CHAPTER 9 Chapter System Startup/Shutdown and Power Control
CHAPTER 10 Configuration and Status Checking (Contents, Methods, and Procedures)
CHAPTER 11 Error Notification and Maintenance (Contents, Methods, and Procedures)
Appendix AFunctions Provided by the PRIMEQUEST 2000 Series
Appendix BPhysical Mounting Locations and Port Numbers
Appendix CLists of External Interfaces Physical
Appendix DPhysical Locations and BUS Numbers of Built-in I/O, and PCI Slot Mounting Locations and Slot Numbers
Appendix EPRIMEQUEST 2000 Series Cabinets
Appendix FStatus Checks with LEDs
Appendix GComponent Mounting Conditions
Appendix HTree Structure of the MIB Provided with the PRIMEQUEST 2000 Series
Appendix IWindows Shutdown Settings
Appendix JSystemwalker Centric Manager Linkage
Appendix KHow to Confirm Firmware of SAS RAID Controller Card
Appendix LSoftware
Appendix MFailure Report Sheet
Appendix N Information of PCI Express card

Preface
ii
C122-E175-02EN
Revision History
Edition Date Revised location (type) (*1) Description
01
2014-02-18
-
-
02
2014-04-10
CHAPTER 1
Updated Network Environment
Setup and Tool Installation
CHAPTER 3
Updated Component
Configuration and Replacement
(Add, Remove)
CHAPTER 4 Updated PCI Card Hot
Maintenance in Red Hat
Enterprise Linux 6
CHAPTER 5 Added this chapter.
CHAPTER 6 Updated Replacement of
HDD/SSD
CHAPTER 7 Updated PCI Express card Hot
Maintenance inWindows
CHAPTER 9 Updated Chapter System
Startup/Shutdown and Power
Control
CHAPTER 11
Updated Error Notification and
Maintenance (Contents, Methods,
and Procedures)
*1: Chapter, section, and item numbers in the "Revised location" column refer to those in the latest edition of the
document. However, a number marked with an asterisk (*) denotes a chapter, section, or item in a previous
edition of the document.

Preface
iii
C122-E175-02EN
Product operating environment
This product is a computer intended for use in a computer room environment. For details on the product operating
environment, see the following manual:
PRIMEQUEST 2000 Series Hardware Installation Manual (C122-H007EN)
Safety Precautions
Alert messages
This manual uses the following alert messages to prevent users and bystanders from being injured and to prevent
property damage.
This indicates a hazardous (potentially dangerous) situation that is likely to result in death or serious
personal injury if the user does not perform the procedure correctly.
This indicates a hazardous situation that could result in minor or moderate personal injury if the user
does not perform the procedure correctly. This also indicates that damage to the product or other
property may occur if the user does not perform the procedure correctly.
This indicates information that could help the user use the product more efficiently.
Alert messages in the text
An alert statement follows an alert symbol. An alert statement is indented on both ends to distinguish it from regular text.
Similarly, one space line is inserted before and after the alert statement.
Only Fujitsu certified service engineers should perform the following tasks on this product and the
options provided by Fujitsu. Customers must not perform these tasks under any circumstances.
Otherwise, electric shock, injury, or fire may result.
- Newly installing or moving equipment
- Removing the front, rear, and side covers
- Installing and removing built-in options
- Connecting and disconnecting external interface cables
- Maintenance (repair and periodic diagnosis and maintenance)
The List of important alert items table lists important alert items.
List of important alert items
This manual does not contain important alert items.
Warning labels
Never remove the warning labels.
Warning label location (the main cabinet top)

Preface
iv
C122-E175-02EN

Preface
v
C122-E175-02EN
Warning label location (the main cabinet left)
Warning label location (PCI_Box)

Preface
vi
C122-E175-02EN
Notes on Handling the Product
About this product
This product is designed and manufactured for standard applications. Such applications include, but are not limited to,
general office work, personal and home use, and general industrial use. The product is not intended for applications that
require extremely high levels of safety tobe guaranteed (referred to below as "safety-critical" applications). Use of the
product for a safety-critical application may present a significant risk of personal injury and/or death. Such applications
include, but are not limited to, nuclear reactor control, aircraft flight control, air traffic control, mass transit control, medical
life support, and missile launch control. Customers shall not use the product for a safety-critical application without
guaranteeing the required level of safety. Customers who plan to use the product in a safety-critical system are requested
to consult the Fujitsu sales representatives in charge.
Storage of accessories
Keep the accessories in a safe place because they are required for server operation.
Adding optional products
For stable operation of the PRIMEQUEST 2000series server, use only a Fujitsu-certified optional product as an added
option.
Note that the PRIMEQUEST 2000 series server is not guaranteed to operate with any optional product not certified by
Fujitsu.
Exportation/release of this product
Exportation/release of this product may require necessary procedures in accordance with the regulations of the Foreign
Exchange and Foreign Trade Control Law of Japan and/or US export control laws.
Maintenance
Only Fujitsu certified service engineers should perform the following tasks on this product and the
options provided by Fujitsu. Customers must not perform these tasks under any circumstances.
Otherwise, electric shock, injury, or fire may result.
- Newlyinstalling or moving equipment
- Removing the front, rear, and side covers
- Installing and removing built-in options
- Connecting and disconnecting external interface cables
- Maintenance (repair and periodic diagnosis and maintenance)
Only Fujitsu certified service engineers should perform the following tasks on this product and the
options provided by Fujitsu. Customers must not perform these tasks under any circumstances.
Otherwise, product failure may result. PRIMEQUEST 2000 Series General Description
- Unpacking an optional Fujitsu product, such as an optional adapter, delivered to the customer
Modifying or recycling the product
Modifying this product or recycling a secondhand product by overhauling it without prior approval
may result in personal injury to users and/or bystanders or damage to the product and/orother
property.
Note on erasing data from hard disks when disposing of the product or transferring it
Disposing of this product or transferring it as is may enable third parties to access the data on the hard disk and use it for
unforeseen purposes. To prevent the leakage of confidential information and important data, all of the data on the hard
disk must be erased before disposal or transfer of the product.
However, it can be difficult to completely erase all of the data from the hard disk. Simply initializing (reformatting) the hard
disk or deleting files on the operating system is insufficient to erase the data, even though the data appears at a glance to
have been erased. This type of operation only makes it impossible to access the data from the operating system.
Malicious third parties can restore this data.

Preface
vii
C122-E175-02EN
If you save your confidential information or other important data on the hard disk, you should completely erase the data,
instead of simply carrying out the aforementioned operation, to prevent the data from being restored. To prevent important
data on the hard disk from being leaked when the product is disposed of or transferred, you will need to take care to erase
all the data recorded on the hard disk on your own responsibility.
Furthermore, if a software license agreement restricts the transfer of the software (operating system and application
software) on the hard disk in the server or other product to a third party, transferring the product without deleting the
software from the hard disk may violate the agreement. Adequate verification from this point of view isalso necessary.
Support and service
Product and service inquiries
For all product use and technical inquiries, contact the distributor where you purchased your product, or a Fujitsu sales
representative or systems engineer (SE). If you do not know the appropriate contact address for inquiries about the
PRIMEQUEST 2000 series, use the Fujitsu contact line.
Fujitsu contact line
We acceptWeb inquiries. For details, visit our website:
https://www-s.fujitsu.com/global/contact/computing/PRMQST_feedback.html
Warranty
If a component failure occurs during the warranty period, we will repair it free of charge in accordance with the terms of the
warranty agreement. For details, see the warranty.
Before requesting a repair
If a problem occurs with the product, confirm the problem by referring to 11.2 Troubleshooting in the PRIMEQUEST 2000
Series Administration Manual (C122-E175ENEN). If the error recurs, contact your sales representative or a field engineer.
Confirm the model name and serial number shown on the label affixed to the right front of the device and report it. Also
check any other required items beforehand according to 11.2 Troubleshooting in the PRIMEQUEST 2000 Series
Administration Manual (C122-E175ENEN).
The system settings saved by the customer will be used during maintenance.
Manual
How to use this manual
This manual contains important information about the safe use of this product. Read the manual thoroughly to understand
the information in it before using this product. Be sure to keep this manual in a safe and convenient location for quick
reference.
Fujitsu makes every effort to prevent users and bystanders from being injured and to prevent property damage. Be sure to
use the product according to the instructions in this manual.
Exportation/release of this document may require necessary procedures in accordance with the regulations of the Foreign
Exchange and Foreign Trade Control Law of Japan and/or US export control laws.
Manuals for the PRIMEQUEST 2000 series
The following manuals have been prepared to provide you with the information necessary to use the PRIMEQUEST 2000
series.
You can access HTML versions of these manuals at the following sites:
Japanese-language site: http://jp.fujitsu.com/platform/server/primequest/manual/2000/
Global site:
http://www.fujitsu.com/global/services/computing/server/primequest/
http://manuals.ts.fujitsu.com/
Title
Description Manual code

Preface
viii
C122-E175-02EN
Title Description Manual code
PRIMEQUEST 2000 Series
Getting Started Guide
Describes what manuals you should read and how to
access important information after unpacking the
PRIMEQUEST 2000 series server. (This manual comes
with the product.)
C122-E170XA
PRIMEQUEST 2000 Series
Safety and Regulatory
Information
Contains important information required for using the
PRIMEQUEST 2000 series safely. C122-E171XA
PRIMEQUEST 2000 Series
Errata and Addenda
Provides errata and addenda for the PRIMEQUEST 2000
series manuals. This manual will be updated as needed.
C122-E182EN
PRIMEQUEST 2000 Series
General Description
Describes the functions and features of the
PRIMEQUEST 2000 series.
C122-B025EN
SPARC Enterprise/
PRIMEQUEST Common
Installation Planning Manual
Provides the necessary information and concepts you
should understand for installation and facility planning for
SPARC Enterprise and PRIMEQUEST installations.
C120-H007EN
PRIMEQUEST 2000 Series
Hardware Installation Manual
Includes the specifications of and the installation location
requirements for the PRIMEQUEST 2000 series.
C122-H007EN
PRIMEQUEST 2000 Series
Installation Manual Describes how to set up the PRIMEQUEST 2000 series
server, including the steps for installation preparation,
initialization, and software installation.
C122-E174EN
PRIMEQUEST 2000 Series
User Interface Operating
Instructions
Describes how to use theWeb-UI and UEFI to assure
proper operation of the PRIMEQUEST 2000 series
server.
C122-E176EN
PRIMEQUEST 2000 Series
Administration Manual
Describes how to use tools and software for system
administration and how to maintain the system
(component replacement and error notification).
C122-E175ENEN
PRIMEQUEST 2000 Series
Tool Reference
Provides information on operation methods and settings,
including details on the MMB and UEFI functions.
C122-E177ENEN
PRIMEQUEST 2000 Series
Message Reference
Lists the messages that may be displayed when a
problem occurs during operation and describes how to
respond to them.
C122-E178EN
PRIMEQUEST 2000 Series
REMCS Installation Manual
Describes REMCS service installation and operation
C122-E180EN
PRIMEQUEST 2000 Series
Glossary
Defines the PRIMEQUEST 2000 series related terms and
abbreviations.
C122-E179EN
Related manuals
The following manuals relate to the PRIMEQUEST 2000 series.
You can access these manuals at the following site:
http://www.fujitsu.com/global/services/computing/server/primequest/
http://manuals.ts.fujitsu.com/
Contact your sales representative for inquiries about the ServerView manuals.
Title
Description Manual code
ServerView Suite ServerView
Operations Manager Quick
Installation (Windows)
Describes how to install and start ServerView Operations
Manager in a Windows environment.
None
ServerView Suite ServerView
Operations Manager Quick
Installation (Linux)
Describes how to install and start ServerView Operations
Manager in a Linux environment.
None
ServerView Suite ServerView
Installation Manager
Describes the installation procedure using ServerView
Installation Manager.
None

Preface
ix
C122-E175-02EN
Title Description Manual code
ServerView Suite ServerView
Operations Manager Server
Management
Provides an overview of server monitoring using
ServerView Operations Manager, and describes the user
interface of ServerView Operations Manager.
None
ServerView Suite ServerView
RAID Management User
Manual
Describes RAID management using ServerView RAID
Manager.
None
ServerView Suite Basic
Concepts
Describes basic concepts about ServerView Suite. None
ServerView Operations
Manager Installation
ServerView Agents for Linux
Describes installation and update installation of
ServerView Linux Agent. None
ServerView Operations
Manager Installation
ServerView Agents for
Windows
Describes installation and update installation of
ServerViewWindows Agent.
None
ServerView Mission Critical
Option User Manual Describes the necessary functions unique to
PRIMEQUEST (cluster linkage) and ServerView Mission
Critical Option (SVmco), which is required for supporting
these functions.
None
ServerView RAID Manager
VMware vSphere ESXi 5
Installation Guide
Describes the installation and settings required to use
ServerView RAID Manager on the VMware vSphere
ESXi 5 server.
None
MegaRAID SAS Software
Provides technical information on using array controllers.
Refer to the manual from the second DVD for ServerView
Suite which you can purchase optionally or from the
following URL:
The Fujitsu Technology Solutions manuals server
http://manuals.ts.fujitsu.com/
None
MegaRAID SAS Device
Driver Installation
Provides technical information on using array controllers.
Refer to the manual from the second DVD for ServerView
Suite which you can purchase optionally or from the
following URL:
The Fujitsu Technology Solutions manuals server
http://manuals.ts.fujitsu.com/
None
Modular RAID Controller
Installation Guide
Provides technical information on using array controllers.
Refer to the manual from the second DVD for ServerView
Suite which you can purchase optionally or from the
following URL:
The Fujitsu Technology Solutions manuals server
http://manuals.ts.fujitsu.com/
None
Abbreviations
This manual uses the following product name abbreviations.
Formal product name Abbreviation
Microsoft ®Windows Server ®2012 R2 Datacenter
Windows, Windows Server 2012
Microsoft ®Windows Server ®2012 R2 Standard
Microsoft ®Windows Server ®2012 Datacenter
Microsoft ®Windows Server ®2012 Standard
Microsoft ®Windows Server ® 2008 R2 Standard Windows, Windows Server 2008
Microsoft ®Windows Server ® 2008 R2 Enterprise
Microsoft ®Windows Server ® 2008 R2 Datacenter

Preface
x
C122-E175-02EN
Formal product name Abbreviation
Red Hat ® Enterprise Linux ® 6 (for Intel64)
Linux, RHEL6, RHEL
Oracle Linux 6 (x86_64)
Oracle Linux, Oracle Linux 6
VMware vSphere (R) 5 VMware, vSphere 5.x, VMware 5, VMware
5.x
VMware (R) ESXi (TM) 5 ESXi, ESXi 5, ESXi 5.x
Novell (R) SUSE(R) LINUX Enterprise Server 11 Service Pack 3
SLES11 SP3
Trademarks
- Microsoft,Windows, and Windows Server are trademarks or registered trademarks of Microsoft Corporation in the
United States and/or other countries.
- Linux is a registered trademark of Linus Torvalds.
- Red Hat, the Shadowman logo and JBoss are registered trademarks of Red Hat, Inc. in the U.S. and other countries.
- Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Atom, Intel Atom Inside, Intel Core, Core Inside, Intel vPro, vPro
Inside, Celeron, Celeron Inside, Itanium, Itanium Inside, Pentium, Pentium Inside, Xeon, Xeon Phi, Xeon Inside and
Ultrabook are trademarks or registered trademarks of Intel Corporation in the U.S. and other countries.
- Ethernet is a registered trademark of Fuji Xerox Co., Ltd. in Japan and is a registered trademark of Xerox Corp. in the
United States and other countries.
- VMware is a trademark or registered trademark of VMware, Inc. in the United States and other countries.
- Novell and SUSE Linux Enterprise Server are trademarks of Novell, Inc.
- Xen is a trademark or registered trademark of Citrix Systems, Inc. or its subsidiaries in the United States and other
countries.
- Other company names and product names are the trademarks or registered trademarks of their respective owners.
- Trademark indications are omitted for some system and product names in this manual.
Notation
This manual uses the following fonts and symbols to express specific types of information.
Font or symbols
Meaning
Example
italics
Title of a manual that you should refer to
See the PRIMEQUEST 2000 Series
Installation Manual (C122-E174EN).
[ ]
Window names as well as the names of
buttons, tabs, and drop-down menus in
windows are enclosed in brackets.
Click the [OK] button.
Notation for the CLI (command line interface)
The following notation is used for commands.
Command syntax
Command syntax is represented as follows.
- Variables requiring the entry of a value are enclosed in angle brackets < >.
- Optional elements are enclosed in brackets [ ].
- Options for optional keywords are grouped in | (stroke) separated lists enclosed in brackets [ ].
- Options for required keywords are grouped in | (stroke) separated lists enclosed in braces { }.
Command syntax is written in a box.
Remarks

Preface
xi
C122-E175-02EN
The command output shown in the PDF manuals may include line feeds at places where there is no line feed symbol
(¥at the end of the line).
Notes on notations
- If you have a comment or request regarding this manual, or if you find any part of this manual unclear, please take a
moment to share it with us by filling in the form at the following webpage, stating your points specifically, and sending
the form to us:
https://www-s.fujitsu.com/global/contact/computing/PRMQST_feedback.html
- The contents of this manual may be revised without prior notice.
- In this manual, the Management Board and MMB firmware are abbreviated as "MMB."
- In this manual, IOU_10GbE and IOU_1GbE are collectively referred to as IO Units.
- Screenshots contained in this manual may differ from the actual product screen displays.
- The IP addresses, configuration information, and other such information contained in this manual are display
examples and differ from that for actual operation.
- The PDF file of this manual is intended for display using Adobe® Reader® in single page viewing mode at 100%
zoom.
This manual shall not be reproduced or copied without the permission of Fujitsu Limited.
Copyright 2014 FUJITSU LIMITED

Preface
xii
C122-E175-02EN
Contents
Preface................................................................................................................................................................................................................i
Network Environment Setup and Tool Installation.............................................................................................................1CHAPTER 1
1.1 External Network Configuration....................................................................................................................................................1
1.2 How to Configure the External Networks (Management LAN/ Maintenance LAN/Production LAN)........................................3
1.2.1 IP addresses used in the PRIMEQUEST 2000 series server................................................................................................3
1.3 Management LAN.........................................................................................................................................................................5
1.3.1 Overview of the management LAN .........................................................................................................................................5
1.3.2 How to configure the management LAN.................................................................................................................................7
1.3.3 Redundant configuration of the management LAN................................................................................................................9
1.4 Maintenance LAN/REMCS LAN............................................................................................................................................... 11
1.5 Production LAN........................................................................................................................................................................... 11
1.5.1 Overview of the production LAN........................................................................................................................................... 11
1.5.2 Redundancy of the production LAN...................................................................................................................................... 12
1.6 Management Tool Operating Conditions and Use................................................................................................................... 12
1.6.1 MMB....................................................................................................................................................................................... 12
1.6.2 Remote operation (BMC)...................................................................................................................................................... 12
1.6.3 ServerView Suite ................................................................................................................................................................... 26
Operating System Installation........................................................................................................................................... 27CHAPTER 2 Component Configuration and Replacement (Add, Remove)....................................................................................... 28CHAPTER 3
3.1 Partition Configuration................................................................................................................................................................ 28
3.1.1 Partition Configuration (PPAR).............................................................................................................................................. 28
3.1.2 Setting procedure of partition in MMB Web-UI..................................................................................................................... 31
3.2 High availability configuration..................................................................................................................................................... 31
3.2.1 Dynamic Reconfiguration (DR)............................................................................................................................................. 31
3.2.2 Reserved SB.......................................................................................................................................................................... 36
3.2.3 Memory Operation Mode...................................................................................................................................................... 44
3.2.4 Memory Mirror........................................................................................................................................................................ 45
3.2.5 Hardware RAID...................................................................................................................................................................... 48
3.2.6 Server View RAID.................................................................................................................................................................. 48
3.2.7 Cluster configuration.............................................................................................................................................................. 48
3.3 Replacing components............................................................................................................................................................... 48
3.3.1Replaceable components ..................................................................................................................................................... 49
3.3.2 Component replacement conditions..................................................................................................................................... 49
3.3.3 Replacement procedures in hot maintenance ..................................................................................................................... 50
3.3.4 Replacement procedures in cold maintenance.................................................................................................................... 50
3.3.5 Replacing the battery backup unit of the uninterrupted power supply unit (UPS).............................................................. 50
3.3.6 Replacing the PCI SSD card................................................................................................................................................. 50
3.4 Expansion of components.......................................................................................................................................................... 52
3.4.1 Procedure of expansion in hot maintenance........................................................................................................................ 53
3.4.2 Procedure of expansion in cold maintenance...................................................................................................................... 54
3.4.3 Expansion of PCI SSD card.................................................................................................................................................. 54
3.5 Process after switching to the Reserved SB and Automatic Partition Reboot ........................................................................ 55
3.5.1 Checking the status after switching to a Reserved SB and automatic rebooting............................................................... 55
3.5.2 Processing after replacement of a faulty SB ........................................................................................................................ 55
3.5.3 Checking the source partition configuration information when switching to a Reserved SB............................................. 56
3.6 Replacing the Home SB No....................................................................................................................................................... 57
PCI Card Hot Maintenance in Red Hat Enterprise Linux 6............................................................................................. 59CHAPTER 4
4.1Dynamic Reconfiguration (DR).................................................................................................................................................. 59
4.1.1 DR function configuration setting .......................................................................................................................................... 59
4.1.2 dr Command Package Install/ Uninstall................................................................................................................................ 60
4.2 Hot add of SB.............................................................................................................................................................................. 61

Preface
xiii
C122-E175-02EN
4.2.1 Preparing for SB hot add....................................................................................................................................................... 61
4.2.2 Confirming the status of SB before SB hot add.................................................................................................................... 62
4.2.3 DR operation in SB hot add................................................................................................................................................... 62
4.2.4 How to deal with when timeout occurs while OS is processing SB hot add....................................................................... 63
4.2.5 Operation after SB hot add.................................................................................................................................................... 64
4.3 Hot replacement of IOU.............................................................................................................................................................. 65
4.3.1 Preparation for IOU hot replacement.................................................................................................................................... 66
4.3.2 DR operation of IOU hot replacement.................................................................................................................................. 71
4.3.3 Operation after IOU hot replacement.................................................................................................................................... 72
4.4 Hot add of IOU............................................................................................................................................................................ 75
4.4.1 Preparation for IOU hot add .................................................................................................................................................. 76
4.4.2 DR operation of IOU hot add................................................................................................................................................. 76
4.4.3 Operation after IOU hot add.................................................................................................................................................. 76
4.5 IOU hot remove .......................................................................................................................................................................... 78
4.5.1 Preparation for IOU hot remove............................................................................................................................................ 78
4.5.2 DR operation of IOU hot remove.......................................................................................................................................... 84
4.5.3 Operation after IOU hot remove............................................................................................................................................ 84
4.6 Hot Replacement of PCI Express Cards................................................................................................................................... 85
4.6.1 Overview of common replacement procedures for PCI Express cards.............................................................................. 85
4.6.2 PCI Express card replacement procedure in detail.............................................................................................................. 85
4.6.3 FC card (Fibre Channel card) replacement procedure........................................................................................................ 92
4.6.4 Network card replacement procedure.................................................................................................................................. 94
4.6.5 Hot replacement procedure for iSCSI (NIC).......................................................................................................................102
4.7 Hot Addition of PCI Express cards...........................................................................................................................................104
4.7.1 Common addition procedures for all PCI Express cards...................................................................................................104
4.7.2 PCI Express card addition procedure in detail ...................................................................................................................104
4.7.3 FC card (Fibre Channel card) addition procedure .............................................................................................................109
4.7.4 Network card addition procedure........................................................................................................................................110
4.8 Removing PCI Express cards..................................................................................................................................................113
4.8.1 Common removal procedures for all PCI Express cards..................................................................................................114
4.8.2 PCI Express card removal procedure in detail...................................................................................................................114
4.8.3 FC card (Fibre Channel card) removal procedure.............................................................................................................114
4.8.4 Network card removal procedure........................................................................................................................................115
4.8.5 Hot removal procedure for iSCSI (NIC)..............................................................................................................................117
PCI Card Hot Maintenance in SUSE Linux Enterprise Server 11................................................................................120CHAPTER 5
5.1 Hot Replacement of PCI Express Cards.................................................................................................................................120
5.1.1 Overview of common replacement procedures for PCI Express cards............................................................................120
5.1.2 PCI Express card replacement procedure in detail............................................................................................................ 120
5.1.3 FC card (Fibre Channel card) replacement procedure......................................................................................................126
5.1.4 Network card replacement procedure................................................................................................................................129
5.1.5 Hot replacement procedure for iSCSI (NIC).......................................................................................................................136
5.2 Hot Addition of PCI Express cards...........................................................................................................................................138
5.2.1 Common addition procedures for all PCI Express cards...................................................................................................138
5.2.2 PCI Express card addition procedure in detail ...................................................................................................................139
5.2.3 FC card (Fibre Channel card) addition procedure .............................................................................................................144
5.2.4 Network card addition procedure........................................................................................................................................145
5.3 Removing PCI Express cards..................................................................................................................................................148
5.3.1 Common removal procedures for all PCI Express cards..................................................................................................148
5.3.2 PCI Express card removal procedure in detail...................................................................................................................148
5.3.3 FC card (Fibre Channel card) removal procedure.............................................................................................................149
5.3.4 Network card removal procedure........................................................................................................................................149
5.3.5 Hot removal procedure for iSCSI (NIC)..............................................................................................................................152
Replacement of HDD/SSD.............................................................................................................................................154CHAPTER 6
6.1 Hot replacement of HDD/SSD with Hardware RAID configuration........................................................................................154
6.1.1 Hot replacement of failed HDD/SSD with RAID0 configuration........................................................................................154

Preface
xiv
C122-E175-02EN
6.1.2 Hot replacement of failed HDD/SSD with RAID 1, RAID 1E, RAID 5, RAID 6, or RAID 10 configuration......................154
6.2 Preventive replacement of HDD/SSD with Hardware RAID configuration............................................................................155
6.2.1 Preventive replacement of failed HDD/SSD with RAID0 configuration ............................................................................155
6.2.2 Preventive replacement of failed HDD/SSD with RAID 1, RAID 1E, RAID 5, RAID 6, or RAID 10 configuration..........156
6.3 Replacement of HDD/SSD in case hot replacement cannot be performed..........................................................................157
PCI Express card Hot Maintenance inWindows..........................................................................................................159CHAPTER 7
7.1 Overview of Hot Maintenance..................................................................................................................................................159
7.1.1 Overall flow...........................................................................................................................................................................159
7.2 Common Hot Plugging Procedure for PCI Express cards.....................................................................................................160
7.2.1 Replacement procedure......................................................................................................................................................160
7.2.2 Addition procedure...............................................................................................................................................................168
7.2.3 About removal......................................................................................................................................................................173
7.3 NIC Hot Plugging......................................................................................................................................................................173
7.3.1 Hot plugging a NIC incorporated into teaming...................................................................................................................173
7.3.2 Hot plugging a non-redundant NIC.....................................................................................................................................177
7.3.3 NIC addition procedure........................................................................................................................................................177
7.4 FC Card Hot Plugging..............................................................................................................................................................177
7.4.1 Hot plugging an FC card incorporated with the ETERNUS multipath driver.................................................................... 178
7.4.2 FC card addition procedure.................................................................................................................................................184
7.5 Hot Replacement Procedure for iSCSI....................................................................................................................................184
7.5.1 Confirming the incorporation of a card with MPD...............................................................................................................185
7.5.2 Disconnecting MPD.............................................................................................................................................................189
Backup and Restore.......................................................................................................................................................191CHAPTER 8
8.1 Backing Up and Restoring Configuration Information ............................................................................................................191
8.1.1 Backing up and restoring UEFI configuration information.................................................................................................191
8.1.2 Backing up and restoring MMB configuration information.................................................................................................193
Chapter System Startup/Shutdown and Power Control...............................................................................................195CHAPTER 9
9.1 Power On and Power Off the Whole System .........................................................................................................................195
9.2 Partition Power on and Power off ............................................................................................................................................195
9.2.1 Various Methods for Powering On the Partition.................................................................................................................195
9.2.2 Partition Power on unit.........................................................................................................................................................196
9.2.3 Types of Power off Method of Partition...............................................................................................................................196
9.2.4 Powering Off Partition Units.................................................................................................................................................196
9.2.5 Procedure for Partition Power On and Power Off..............................................................................................................197
9.2.6 Partition Power on by MMB.................................................................................................................................................197
9.2.7 Controlling Partition Startup by using the MMB..................................................................................................................198
9.2.8 Checking the Partition Power status by using the MMB....................................................................................................199
9.3 Scheduled operations...............................................................................................................................................................201
9.3.1 Powering on a partition by scheduled operation................................................................................................................201
9.3.2 Power off a Partition by scheduled operation.....................................................................................................................202
9.3.3 Relation of scheduled operation and power restoration function ......................................................................................202
9.3.4 Scheduled operation support conditions ............................................................................................................................202
9.4 Automatic Partition Restart Conditions....................................................................................................................................203
9.4.1 Setting automatic partition restart conditions......................................................................................................................203
9.5 Power Restoration....................................................................................................................................................................205
9.5.1 Settings for Power Restoration............................................................................................................................................205
9.6 Remote shutdown (Windows).................................................................................................................................................. 206
9.6.1 Prerequisites for remote shutdown.....................................................................................................................................206
9.6.2 How to use remote shutdown............................................................................................................................................. 206
Configuration and Status Checking (Contents, Methods, and Procedures)...........................................................208CHAPTER 10
10.1 MMB Web-UI............................................................................................................................................................................208
10.2 MMB CLI...................................................................................................................................................................................209
10.3 UEFI ..........................................................................................................................................................................................210
10.4 ServerView Suite......................................................................................................................................................................210
Error Notification and Maintenance (Contents, Methods, and Procedures)...........................................................211CHAPTER 11

Preface
xv
C122-E175-02EN
11.1 Maintenance .............................................................................................................................................................................211
11.1.1 Maintenance using the MMB.........................................................................................................................................211
11.1.2 Maintenance method......................................................................................................................................................211
11.1.3 Maintenance modes.......................................................................................................................................................211
11.1.4 Maintenance of the MMB...............................................................................................................................................212
11.1.5 Maintenance of the PCI_BOX (PEXU)..........................................................................................................................212
11.1.6 Maintenance policy/preventive maintenance ................................................................................................................213
11.1.7 REMCS service overview...............................................................................................................................................213
11.1.8 REMCS linkage...............................................................................................................................................................213
11.2 Troubleshooting........................................................................................................................................................................214
11.2.1 Troubleshooting overview...............................................................................................................................................214
11.2.2 Items to confirm before contacting a sales representative............................................................................................216
11.2.3 Sales representative (contact)........................................................................................................................................216
11.2.4 Finding out about abnormal conditions.......................................................................................................................... 217
11.2.5 Investigating abnormal conditions..................................................................................................................................219
11.2.6 Checking into errors in detail ..........................................................................................................................................222
11.2.7 Problems related to the main unit or a PCI_Box........................................................................................................... 222
11.2.8 MMB-related problems...................................................................................................................................................223
11.2.9 Problems with partition operations.................................................................................................................................223
11.3 Notes on Troubleshooting........................................................................................................................................................224
11.4 Collecting Maintenance Data...................................................................................................................................................224
11.4.1 Logs that can be collected by the MMB.........................................................................................................................224
11.4.2 Collecting data for investigation (Windows)...................................................................................................................229
11.4.3 Setting up the dump environment (Windows)...............................................................................................................230
11.4.4 Acquiring data for investigation (RHEL).........................................................................................................................236
11.4.5 sadump............................................................................................................................................................................ 237
11.5 Configuring and Checking Log Information.............................................................................................................................237
11.5.1 List of log information ......................................................................................................................................................237
11.6 Firmware Updates....................................................................................................................................................................238
11.6.1 Notes on updating firmware............................................................................................................................................238
Appendix A Functions Provided by the PRIMEQUEST 2000 Series.......................................................................................................239
A.1 Function List..............................................................................................................................................................................239
A.1.1 Action....................................................................................................................................................................................239
A.1.2 Operation..............................................................................................................................................................................239
A.1.3 Monitoring and reporting functions......................................................................................................................................240
A.1.4 Maintenance.........................................................................................................................................................................241
A.1.5 Redundancy functions......................................................................................................................................................... 242
A.1.6 External linkage functions....................................................................................................................................................242
A.1.7 Security functions.................................................................................................................................................................242
A.2 Correspondence between Functions and Interfaces..............................................................................................................243
A.2.1 System information display..................................................................................................................................................243
A.2.2 System settings....................................................................................................................................................................243
A.2.3 System operation.................................................................................................................................................................243
A.2.4 Hardware status display...................................................................................................................................................... 243
A.2.5 Display of partition configuration information and partition status......................................................................................244
A.2.6 Partition configuration and operation setting.................................................................................................................................244
A.2.7 Partition operation...........................................................................................................................................................................244
A.2.8 Partition power control....................................................................................................................................................................245
A.2.9 OS boot settings.............................................................................................................................................................................245
A.2.10 MMB user account control...........................................................................................................................................................245
A.2.11 Server management network settings........................................................................................................................................245
A.2.12 Maintenance.................................................................................................................................................................................246
A.3 Management Network Specifications......................................................................................................................................246
Appendix B Physical Mounting Locations and Port Numbers................................................................................................................... 248
B.1 Physical Mounting Locations of Components.........................................................................................................................248

Preface
xvi
C122-E175-02EN
B.2 Port Numbers............................................................................................................................................................................250
Appendix C Lists of External Interfaces Physical .......................................................................................................................................252
C.1 List of External System Interfaces............................................................................................................................................252
C.2 List of External MMB Interfaces...............................................................................................................................................252
Appendix D Physical Locations and BUS Numbers of Built-in I/O, and PCI Slot Mounting Locations and Slot Numbers....................253
D.1 Physical Locations and BUS Numbers of Internal I/O Controllers of the PRIMEQUEST 2000 Series...............................253
D.2 Correspondence between PCI Slot Mounting Locations and Slot Numbers........................................................................253
Appendix E PRIMEQUEST 2000 Series Cabinets....................................................................................................................................256
Appendix F Status Checks with LEDs........................................................................................................................................................257
F.1. LED Type..................................................................................................................................................................................257
F1.1 Power LED, Alarm LED, and Location LED...............................................................................................................................257
F.1.2 PSU......................................................................................................................................................................................257
F.1.3 FANU....................................................................................................................................................................................258
F.1.4 SB.........................................................................................................................................................................................258
F.1.5 IOU .......................................................................................................................................................................................258
F.1.6 PCI Express slot of IOU.......................................................................................................................................................259
F.1.7 DU.........................................................................................................................................................................................259
F.1.8 HDD/SSD.............................................................................................................................................................................259
F.1.9 MMB.....................................................................................................................................................................................260
F.1.10 LAN..................................................................................................................................................................................260
F.1.11 OPL..................................................................................................................................................................................261
F.1.12 PCI_Box..........................................................................................................................................................................261
F.1.13 PCI Express slot in PCI_Box..........................................................................................................................................261
F.1.14 IO_PSU...........................................................................................................................................................................262
F.1.15 IO_FAN............................................................................................................................................................................262
F.2 LED Mounting Locations..........................................................................................................................................................262
F.3 LED list ......................................................................................................................................................................................264
F.4 Button and switch......................................................................................................................................................................267
Appendix G Component Mounting Conditions...........................................................................................................................................268
G.1 CPU...........................................................................................................................................................................................268
G.2 DIMM.........................................................................................................................................................................................268
G.3 Configuration when using 100 V PSU.....................................................................................................................................276
G.4 Available internal I/O ports........................................................................................................................................................276
G.5 Legacy BIOS Compatibility (CSM)..........................................................................................................................................276
G.6 Rack Mounting..........................................................................................................................................................................276
G.7 Installation Environment...........................................................................................................................................................276
G.8 NIC (Network Interface Card)...................................................................................................................................................276
Appendix H Tree Structure of the MIB Provided with the PRIMEQUEST 2000 Series...........................................................................278
H.1 MIB Tree Structure ...................................................................................................................................................................278
H.2 MIB File Contents.....................................................................................................................................................................279
Appendix I Windows Shutdown Settings....................................................................................................................................................280
I.1 Shutdown From MMB Web-UI.....................................................................................................................................................280
Appendix J Systemwalker Centric Manager Linkage................................................................................................................................ 281
J.1 Preparation for Systemwalker Centric Manager Linkage.......................................................................................................281
J.2 Configuring Systemwalker Centric Manager Linkage ............................................................................................................281
J.2.1 MMB node registration ........................................................................................................................................................281
J.2.2 SNMP trap linkage...............................................................................................................................................................282
J.2.3Event monitoring linkage.....................................................................................................................................................283
J.2.4 GUI linkage...........................................................................................................................................................................283
J.2.5 Rack grouping function linkage........................................................................................................................................... 283
J.2.6 Linkage with ServerView.....................................................................................................................................................283
Appendix K How to Confirm Firmware of SAS RAID Controller Card......................................................................................................285
K.1 How to confirm firmware version of SAS RAID controller card ..............................................................................................285
K.2 How to confirm firmware version of SAS card.........................................................................................................................290
K.3 How to confirm firmware version and UEFI driver version of FC card...................................................................................293

Preface
xvii
C122-E175-02EN
K.3.1 How to confirm firmware version for FCcard made by Qlogic.....................................................................................294
K.3.2 How to confirm firmware version for FC card made by Emulex...................................................................................297
Appendix L Software....................................................................................................................................................................................302
Appendix M Failure Report Sheet...............................................................................................................................................................303
M.1 Failure Report Sheet.................................................................................................................................................................303
Appendix N Information of PCI Express card.............................................................................................................................................304

Preface
xviii
C122-E175-02EN
Figures
FIGURE 1.1 External network configuration............................................................................................................................................1
FIGURE 1.2 External network functions..................................................................................................................................................2
FIGURE 1.3 Management LAN configuration.........................................................................................................................................6
FIGURE 1.4 Maintenance LAN and REMCS LAN of the MMB ......................................................................................................... 11
FIGURE 1.5 Connection configuration for video redirection................................................................................................................ 14
FIGURE 1.6 Operating sequence of video redirection......................................................................................................................... 15
FIGURE 1.7 [Video Redirection] window.............................................................................................................................................. 15
FIGURE 1.8 Message of requesting access to Virtual Console in second terminal PC.................................................................... 19
FIGURE 1.9 Popup window of [Virtual Console Sharing Privileges]................................................................................................... 19
FIGURE 1.10 Popup for [Allow Virtual Console] in first terminal PC................................................................................................... 19
FIGURE 1.11 Popup for TIMEOUT in first terminal PC....................................................................................................................... 19
FIGURE 1.12 Popup for [Allow Virtual Console] in second terminal PC............................................................................................. 20
FIGURE 1.13 Popup for [Allow only video] in second terminal PC..................................................................................................... 20
FIGURE 1.14 Popup for [Deny Access] in second terminal PC.......................................................................................................... 20
FIGURE 1.15 Popup for TIMEOUT in first terminal PC....................................................................................................................... 20
FIGURE 1.16 Popup for reaching maximum number of connection in second terminal PC............................................................. 20
FIGURE 1.17 Example of setting partition #3 (1).................................................................................................................................21
FIGURE 1.18 Example of setting partition #3 (2).................................................................................................................................21
FIGURE 1.19 Forced disconnection of console redirection (1)........................................................................................................... 22
FIGURE 1.20 Forced disconnection of console redirection (2)........................................................................................................... 22
FIGURE 1.21 Configuration of virtual media connection..................................................................................................................... 23
FIGURE 1.22 [Virtual Media] window (1).............................................................................................................................................. 24
FIGURE 1.23 Image file selection window........................................................................................................................................... 25
FIGURE 1.24 [Virtual Media] window (2).............................................................................................................................................. 26
FIGURE 3.1 Conceptual diagram of the partitioning function (PRIMEQUEST 2400E)..................................................................... 29
FIGURE 3.2 Conceptual diagram of the partitioning function (PRIMEQUEST 2800E)..................................................................... 30
FIGURE 3.3 SB hotadd......................................................................................................................................................................... 32
FIGURE 3.4 SB Hot remove (Disconnecting a faulty SB)................................................................................................................... 32
FIGURE 3.5 IOU Hot add...................................................................................................................................................................... 33
FIGURE 3.6 IOU hot remove (removal of failed IOU).......................................................................................................................... 33
FIGURE 3.7 Example 1-a. Example where two SBs are set as Reserved SBs in two partitions (when SB #0 and SB #1 have
simultaneously failed)..................................................................................................................................................................... 39
FIGURE 3.8 Example 1-b.Example when one SB is set as the Reserved SB in two partitions (SB #0 and SB #2 have
simultaneously failed)..................................................................................................................................................................... 40
FIGURE 3.9 Example 3. Example when multiple free SB (#2,#3) is set as Reserved SBs in Partition #0..................................... 40
FIGURE 3.10 Example 4. where Reserved SBs (#1, #2, #3) of Partition #0 belong to other partitions............................................ 41
FIGURE 3.11 Example 5. Example where the Reserved SBs (#1，#2，#3) of Partition #0 belong to other partitions................... 41
FIGURE 3.12 Example 6. Example where a Reserved SB has been set in SB #0 (When the Home SB has failed)..................... 42
FIGURE 3.13 Example 7. Example when SB #0 is set as the Reserved SB (when an SB other than the Home SB fails)........... 42
FIGURE 3.14 Status when there is an error in the memory (mirror maintenance mode).................................................................. 46
FIGURE 3.15 Status when the error had occurred in the system was restarted (mirror maintenance mode).................................46
FIGURE 3.16 Status when there error has occurred in the memory (memory capacity maintenance mode).................................47
FIGURE 3.17 Status when an error has occurred in the memory (memory capacity maintenance mode)..................................... 47
FIGURE 4.1 [Mode] window (Dynamic Reconfiguration).................................................................................................................... 60
FIGURE 4.2 Single NIC interface and bonding configuration interface............................................................................................... 95
FIGURE 4.3 Example of single NIC interface.....................................................................................................................................102
FIGURE 4.4 Single NIC interface and bonding configuration interface.............................................................................................111
FIGURE 4.5 Single NIC interface and bonding configuration interface.............................................................................................115
FIGURE 5.1 Single NIC interface and bonding configuration interface.............................................................................................129
FIGURE 5.2 Example of single NIC interface.....................................................................................................................................136

Preface
xix
C122-E175-02EN
FIGURE 5.3 Single NIC interface and bonding configuration interface.............................................................................................145
FIGURE 5.4 Single NIC interface and bonding configuration interface.............................................................................................149
FIGURE 8.1 [Backup BIOS Configuration] window...........................................................................................................................192
FIGURE 8.2 [Restore BIOS Configuration] window...........................................................................................................................193
FIGURE 8.3 [Restore BIOS Configuration] window (partition selection)...........................................................................................193
FIGURE 8.4 [Backup/Restore MMB Configuration] window............................................................................................................. 194
FIGURE 8.5 Restore confirmation dialog box....................................................................................................................................194
FIGURE 9.1 [System Power Control] window....................................................................................................................................195
FIGURE 9.2 [Power Control] window.................................................................................................................................................198
FIGURE 9.3 [Power Control]Window.................................................................................................................................................199
FIGURE 9.4 [Information] window.......................................................................................................................................................200
FIGURE 9.5 [Power Control] window.................................................................................................................................................201
FIGURE 9.6 [ASR (Automatic Server Restart) Control] window.......................................................................................................204
Figure 9.7 Simplified help for the shutdown command......................................................................................................................207
FIGURE 11.1 REMCS linkage............................................................................................................................................................214
FIGURE 11.2 Troubleshooting overview............................................................................................................................................215
FIGURE 11.3 Label location................................................................................................................................................................216
FIGURE 11.4 Alarm LED on the front panel of the device................................................................................................................217
FIGURE 11.5 System status display in the MMBWeb-UI window...................................................................................................218
FIGURE 11.6 Alarm E-Mail settings window......................................................................................................................................219
FIGURE 11.7 System status display...................................................................................................................................................220
FIGURE 11.8 System event log display.............................................................................................................................................221
FIGURE 11.9 [Partition Configuration] window ..................................................................................................................................221
FIGURE 11.10 [Partition Event Log] window......................................................................................................................................222
FIGURE 11.11 [System Event Log] window in PRIMEQUEST 2400E and 2800E.........................................................................225
FIGURE 11.12 [System Event log] window in PRIMEQUEST 2800B .............................................................................................225
FIGURE 11.13 [System Event Log Filtering Condition] window in PRIMEQUEST 2400E and 2800E..........................................226
FIGURE 11.14 [System Event Log Filtering Condition] window in PRIMEQUEST 2800B.............................................................227
FIGURE 11.15 [System Event Log (Detail)] window..........................................................................................................................228
FIGURE 11.16 [Startup and Recovery] dialog box............................................................................................................................232
FIGURE 11.17 [Advanced] tab of the dialog box...............................................................................................................................233
FIGURE 11.18 [Virtual Memory] dialog box.......................................................................................................................................234
FIGURE 11.19 Advanced options dialog box.....................................................................................................................................235
FIGURE 11.20 [Virtual Memory] dialog box.......................................................................................................................................236
FIGURE B.1 Physical mounting locations in the PRIMEQUEST 2400E..........................................................................................248
FIGURE B.2 Physical mounting locations in the PRIMEQUEST 2800E/2800B..............................................................................249
FIGURE B.3 Physical mounting locations in the DU..........................................................................................................................249
FIGURE B.4 Physical mounting locations in the PCI_Box................................................................................................................ 250
FIGURE B.5 MMB port numbers........................................................................................................................................................250
FIGURE B.6 IOU_1GbE port numbers ..............................................................................................................................................251
FIGURE B.7 IOU_10GbE port numbers............................................................................................................................................251
FIGURE F.1 LED mounting locations on components equipped with LAN ports............................................................................262
FIGURE F.2 Mounting locations of PSU and FANU..........................................................................................................................263
FIGURE F.3 MMB LED mounting locations.......................................................................................................................................263
FIGURE F.4 DU LED mounting locations..........................................................................................................................................263
FIGURE F.5 System LED mounting locations...................................................................................................................................263
FIGURE F.6 PCI_Box LED mounting locations.................................................................................................................................263
FIGURE H.1 MIB tree structure...........................................................................................................................................................279
FIGURE K.1 Boot Manager front page (1) .........................................................................................................................................285
FIGURE K.2 Boot Manager front page (2) .........................................................................................................................................286
FIGURE K.3 Boot Manager menu......................................................................................................................................................286
FIGURE K.4 Driver list.........................................................................................................................................................................287
FIGURE K.5 drivers command of UEFI Shell ....................................................................................................................................287
FIGURE K.6 dh command of UEFI Shell...........................................................................................................................................288
FIGURE K.7 selection of EFI WebBIOS / EFI CLI.............................................................................................................................288