Lenovo ThinkAgile CP Use and care manual

Lenovo ThinkAgile CP
Hardware Part Replacement
and Component Maintenance Procedures
Models: CP4000, CP 000

Note
Before using this information and the product it supports, be sure to read and understand the safety
information and the safety instructions, which are available at the following address:
http://thinksystem.lenovofiles.com/help/topic/safety_documentation/pdf_files.html
In addition, be sure that you are familiar with the terms and conditions of the Lenovo warranty for your
solution, which can be found at the following address:
http://datacentersupport.lenovo.com/warrantylookup
Second Edition (March 2020)
© Copyright Lenovo 2018 2020.
LIMITED AND RESTRICTED RIGHTS NOTICE: If data or software is delivered pursuant to a General Services
Administration “GSA” contract use reproduction or disclosure is subject to restrictions set forth in Contract No.
GS-35F-05925.

Contents
Figures . . . . . . . . . . . . . . . . . . iii
Tables . . . . . . . . . . . . . . . . . . v
Chapter 1. ThinkAgile CP Overview . . . 1
ThinkAgile CP4000 series overview . . . . . . . . 4
ThinkAgile CP 000 series overview . . . . . . . . 7
ThinkAgile CP solution components . . . . . . . 10
Storage block parts list . . . . . . . . . . 10
Compute block parts list . . . . . . . . . 12
Power cords . . . . . . . . . . . . . . 14
Chapter 2. Roles and
responsibilities . . . . . . . . . . . . . 15
Chapter 3. Installation Guidelines. . . 19
System reliability guidelines . . . . . . . . . . 20
Working inside the solution with the power on . . . 20
Handling static-sensitive devices . . . . . . . . 21
Chapter 4. Managing Support
Mode . . . . . . . . . . . . . . . . . . 23
Enable Support Mode in the Cloud Controller . . . 23
Access the customer's system via Support
Mode . . . . . . . . . . . . . . . . . . . 24
Place a support file on the storage or compute
node . . . . . . . . . . . . . . . . . . . 2
Disable Support Mode in the Cloud Controller . . . 28
Chapter 5. Part replacement and
maintenance procedures . . . . . . . 29
Storage block maintenance procedures . . . . . 29
Storage block component indicators . . . . . 29
Shutting off a storage controller. . . . . . . 34
Trigger manual storage HA. . . . . . . . . 34
Shutting down the storage block . . . . . . 35
Replacing storage block hardware . . . . . . . 3
Replacing storage network cables or
transceivers . . . . . . . . . . . . . . 3
Hot-swap drive replacement . . . . . . . . 3
Hot-swap power supply replacement . . . . 2
Hot-swap storage controller replacement . . . 70
Enclosure replacement . . . . . . . . . . 78
Complete the parts replacement . . . . . . 84
Compute block maintenance procedures . . . . . 85
Shutting off a compute node . . . . . . . . 85
Migrating VMs from a compute node. . . . . 85
Migrate a VM between compute nodes . . . . 8
Replacing compute block hardware . . . . . . . 87
Hardware replacement procedures . . . . . 87
Replace compute network cables . . . . . . 87
Enable or Disable Maintenance Mode . . . . 88
Hot-swap drive replacement . . . . . . . . 91
Hot-swap power supply replacement . . . . 94
Fan replacement . . . . . . . . . . . . 99
EIOM replacement . . . . . . . . . . . . 107
DIMM replacement. . . . . . . . . . . . 110
Compute node replacement . . . . . . . . 118
Replace the SD530 system board . . . . . . 120
Replace the compute enclosure. . . . . . . 120
Interconnect switch maintenance procedures . . . 121
Power off the interconnect switch in an SS-V3
environment . . . . . . . . . . . . . . 121
Make the secondary interconnect switch the
primary interconnect . . . . . . . . . . . 121
Recovering from DNS misconfiguration. . . . 124
Interconnect parts replacement procedures . . . . 12
Replace the interconnect switch . . . . . . 12
Cabling a single-interconnect
configuration . . . . . . . . . . . . . . 134
Cabling a dual-interconnect configuration . . . 138
Replacing a cable between two interconnect
switches . . . . . . . . . . . . . . . . 142
Hardware management network cable
replacement . . . . . . . . . . . . . . 142
Management switch maintenance procedures
(optional) . . . . . . . . . . . . . . . . . 143
Replacing the management switch
(optional). . . . . . . . . . . . . . . . 143
Hardware management network cable
replacement . . . . . . . . . . . . . . 149
Chapter 6. Licensing
considerations . . . . . . . . . . . . . 151
© Copyright Lenovo 2018, 2020 i

ii Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Figures
1. Storage block . . . . . . . . . . . . . . 2
2. Compute block. . . . . . . . . . . . . . 2
3. CP Interconnect . . . . . . . . . . . . . 3
4. Management switch . . . . . . . . . . . . 3
5. Storage block components . . . . . . . . 11
. Compute block components . . . . . . . 13
7. Cloud Controller Support Mode menu
item . . . . . . . . . . . . . . . . . 23
8. Turn On Support Mode dialog box . . . . . 24
9. Port number and password for Support
Mode connection . . . . . . . . . . . . 24
10. Virtual Office sign-in page . . . . . . . . 24
11. Command to connect to customer’s
interconnect . . . . . . . . . . . . . . 2
12. Cloud Controller Support Mode menu
item . . . . . . . . . . . . . . . . . 28
13. Turn Off Support Mode dialog box . . . . . 28
14. Enclosure indicators. . . . . . . . . . . 30
15. Drive indicators. . . . . . . . . . . . . 31
1 . Storage controller indicators . . . . . . . 32
17. Storage controller port indicators. . . . . . 33
18. Hot-swap drive removal . . . . . . . . . 52
19. Hot-swap drive removal . . . . . . . . . 53
20. Opening the drive tray handle . . . . . . . 5
21. Sliding the drive into the drive bay . . . . . 57
22. Hot-swap power supply removal (1/2) . . . . 4
23. Hot-swap power supply removal (2/2) . . . . 5
24. Hot-swap power supply installation (1/
2) . . . . . . . . . . . . . . . . . . 8
25. Hot-swap power supply installation (2/
2) . . . . . . . . . . . . . . . . . . 9
2 . Hot-swap storage controller removal . . . . 70
27. Hot-swap storage controller installation . . . 71
28. SSH sign-in to proxy server . . . . . . . . 75
29. Entering the proxy server port . . . . . . . 7
30. Entering the proxy server password. . . . . 7
31. Side cover removal . . . . . . . . . . . 78
32. Screws removal . . . . . . . . . . . . 79
33. Enclosure removal from rack . . . . . . . 79
34. Removal of side cover . . . . . . . . . . 81
35. Installing the enclosure into the rack . . . . 82
3 . Installing screws on front of enclosure . . . . 82
37. Reinstalling the side cover . . . . . . . . 83
38. Enable Maintenance Mode for a Node . . . . 88
39. Maintenance Mode dialog box . . . . . . . 89
40. Disable Maintenance Mode for a Node . . . 90
41. Drive removal . . . . . . . . . . . . . 92
42. Drive installation . . . . . . . . . . . . 93
43. Hot-swap power supply removal . . . . . . 9
44. Hot-swap power supply installation . . . . . 99
45. Fan fault LEDs . . . . . . . . . . . . . 101
4 . 0x 0x5 mm fan removal . . . . . . . . 102
47. 80x80x80mm fan removal . . . . . . . . 103
48. 0x 0x5 mm fan installation . . . . . . . 105
49. 80x80x80mm fan installation . . . . . . . 10
50. EIOM ports and corresponding node
number . . . . . . . . . . . . . . . . 107
51. EIOM removal . . . . . . . . . . . . . 108
52. EIOM installation . . . . . . . . . . . . 109
53. DIMM removal . . . . . . . . . . . . . 111
54. Location of the DIMM connectors on the
system board . . . . . . . . . . . . . 113
55. Location of the DIMM connectors on the
system board . . . . . . . . . . . . . 115
5 . DIMM installation . . . . . . . . . . . . 11
57. Recabling management switch from primary
to secondary interconnect . . . . . . . . 123
58. Removing the interconnect from the
rack . . . . . . . . . . . . . . . . . 127
59. Hardware management network connectivity
in a single interconnect configuration . . . . 134
0. Single—interconnect configuration —
compute node and network interconnect
connections . . . . . . . . . . . . . . 13
1. Single—interconnect configuration —
storage block and network interconnect
connections . . . . . . . . . . . . . . 137
2. Hardware management network connectivity
in a dual—interconnect configuration . . . . 138
3. Dual—interconnect configuration —
compute node and network interconnect
connections . . . . . . . . . . . . . . 140
4. Dual—interconnect configuration — storage
block and network interconnect
connections . . . . . . . . . . . . . . 141
5. Dual-interconnect configuration — inter-
interconnect link network connectivity . . . . 141
. Power-cord retention clip removal . . . . . 144
7. Releasing switch unit from the rack . . . . . 145
8. Removing mounting brackets from
switch . . . . . . . . . . . . . . . . 145
9. Attaching mounting brackets to switch . . . 147
70. Securing switch to rack posts . . . . . . . 147
71. Installing power cord retention clip . . . . . 148
© Copyright Lenovo 2018, 2020 iii

iv Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Tables
1. Storage block parts listing . . . . . . . . 10
2. Compute block part listing . . . . . . . . 12
3. Fan fault LEDs . . . . . . . . . . . . . 101
4. EIOM port corresponding node
number . . . . . . . . . . . . . . . . 107
5. DIMM installation sequence (Independent
mode/normal mode) . . . . . . . . . . . 114
. DIMM installation sequence (mirror mode/lockstep
mode) . . . . . . . . . . . . . . . . 114
7. DIMM installation sequence (mirror mode/
lockstep mode for 3, , 9 and 12 identical
DIMMs) . . . . . . . . . . . . . . . . 114
8. DIMM installation sequence (sparing
mode) . . . . . . . . . . . . . . . . 114
© Copyright Lenovo 2018, 2020 v

vi Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Chapter 1. ThinkAgile CP Overview
This product overview provides technical information on the Lenovo ThinkAgile CP Series cloud platform, its
key features and specifications, components and options, and configuration guidelines.
Lenovo ThinkAgile CP Series is an all-in-one, composable cloud with an integrated application marketplace
(Lenovo Cloud Marketplace) and end-to-end automation, delivering a turn-key cloud experience in your own
data center. The ThinkAgile CP Series uses modular compute, storage, and networking components paired
with the cloud virtualization software to create pools of IT resources, independently scaling and allocating
capacity, and automatically configuring resources to fulfill application requirements.
Due to its software-defined modular architecture, the ThinkAgile CP Series platform can be scaled easily by
adding more compute and storage resources independently of each other as your needs grow. Suggested
workloads for the ThinkAgile CP Series include web services, virtual desktop infrastructure (VDI), enterprise
applications, OLTP and OLAP databases, data analytics, application development, cost-optimized
virtualization, containers, and other back-office applications.
Key Features
Lenovo ThinkAgile CP Series offers the following key features:
• Modular and scalable ThinkAgile CP Series configurations of an on-premises cloud platform featuring the
second generation of the Intel Xeon Processor Scalable Family that are designed to optimize your
workload’s performance and provide the IT agility for your business demands.
• Factory-preloaded ready-to-go cloud platform that is delivered with all the infrastructure you need for your
workloads: Modular and scalable physical and virtual compute, network, and storage resources, and the
cloud software.
• Lenovo deployment services that are included with the platform help get customers up and running
quickly.
• The cloud software provides a scalable software-defined infrastructure (SDI) that simplifies cloud
deployments with integrated compute, storage, networking, security, and management services that
manage application infrastructure and automate and orchestrate workload provisioning.
• Extensive security features, such as data at rest encryption, virtualized network and VM-level firewalls,
and two-factor authentication help customers meet the most stringent security requirements.
• Centralized cloud-based management automates discovery, deployment, and configuration of cloud
resources, and provides automated, non-disruptive software updates.
• Lenovo ThinkAgile Advantage provides a single point of contact for all support issues and integrates
support chat and virtual technical assistance into your management interface.
© Copyright Lenovo 2018, 2020 1

Components
The ThinkAgile CP Series consists of the following components:
• Storage Blocks
A Storage Block is a 2U storage enclosure with up to 24 PCIe NVMe SSDs and two controllers for high
availability and redundancy. A storage block runs the cloud software that delivers data storage layer to the
cloud. It simplifies storage management, provides enterprise-class storage functionality, and enables
linear performance and capacity scaling.
Figure 1. Storage block
• Compute Blocks
A Compute Block is a modular 2U enclosure that contains up to four nodes, and it delivers processor and
memory resources to the cloud. The compute nodes run the cloud hypervisor that combines open KVM-
based virtualization software, hardware integration, and automation to orchestrate and deliver an end-to-
end compute platform.
Figure 2. Compute block
2Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

• CP Interconnect
The Interconnect centralizes connectivity of your on-premises infrastructure to the Cloud Controller and
acts as the entry point into your existing network, which connects the Cloud Controller to your
environment. The CP Interconnect consists of one or two high-density, ultra-low-latency 10/40 GbE
network devices and use specialized cloud software which provides the fabric for your composable
environment, automating discovery, onboarding, and device management. Integrated network
virtualization secures virtual data center and applications.
Figure 3. CP Interconnect
• Management Switch
The 1 GbE management switch is required to provide out-of-band (OOB) management for the
Interconnect, Compute Blocks, and Storage Blocks. The switch can be supplied by Lenovo (ThinkSystem
NE0152T RackSwitch), or customers may provide their own switch.
Figure 4. Management switch
• Cloud Controller
Cloud Controller orchestrates and manages the on-premises infrastructure and workloads; however, it
resides in the cloud. It automates and orchestrates infrastructure provisioning in real time to achieve
complete and secure vertical hardware, software and workload integration. It federates and abstracts all
physical hardware into a private cloud service.
Cloud Controller provides a single point of management across an unlimited number of ThinkAgile CP
stacks with role-based access control, two-factor authentication, and secure HTML and RESTful API
interfaces.
Chapter 1.ThinkAgile CP Overview 3

ThinkAgile CP4000 series overview
The Lenovo ThinkAgile CP4000 series scales as an initial data-management footprint for managed service
provider and cloud service provider environments that start on a smaller scale but are poised for growth. The
CP4000 series also supports business continuity when deployed remotely as an off-site backup for disaster
recovery.
The Lenovo ThinkAgile CP4000 series consists of the following components:
• “Storage block” on page 4
• “Compute block” on page 5
• “Interconnect switch” on page 5
• “Management switch” on page 5
• “Services” on page
• “Software” on page
Storage block
• 1 Storage Block (SB-S10)
• Dual controller - single CPU per controller
• 8x SFP Base-T SFP+ transceivers
• 8x CAT cables, 1.5m and other lengths permitted
• 2x CAT5e cables, 1.5m and other lengths permitted
• 32 GB RAM per controller
• 8, 1 , 24 drives (8 drives per drive pack)
• 800 GB, 1. TB NVMe drives per controller
• Drives must be consistent within a storage block
• Dimensions: 87. x 44 .4 x 857.2 mm (3.4 x 17. x 33.7 inches)
• Maximum weight: 42.0 kg (92. lb)
4Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Compute block
• 1 D2 enclosure, fully populated PSU, fan, 220V with 10Gb SFP+ network module
• Minimum 2 SD530 nodes, maximum 4 nodes
• 128 GB, 25 GB RAM per node
• 8+ cores per CPU, 1-2 sockets filled AXQT, and others
• 2x SFP+ DAC cables per node, 1.5m and other lengths permitted
• Boot: 1x SATA 240 GB
• Dimensions: 41.0 x 5 2.0 x 222.0 mm (1.7 x 22.2 x 8.8 inches)
• Maximum weight: 55 kg (121.2 lb)
Interconnect switch
• 1 or 2 CP-I-10 interconnect switches
• 48x 10 Gb SFP+ fabric ports
• x 40 Gb QSFP+ fabric ports
• Dimensions: 438.4 x 473 x 43.4 mm (17.2 x 18. 2 x 1.71 inches)
• Maximum weight: 8.95 kg (19.73 lb), with two installed PSUs
Management switch
Lenovo ThinkSystem NE0152T RackSwitch
Chapter 1.ThinkAgile CP Overview 5

Note: A dedicated out-of-band (OOB) management switch is required for this solution. If the Lenovo
NE0152T is not used, you must provide an OOB management switch with the correct configuration.
Services
Lenovo Deployment Services are mandatory
Lenovo Hardware Installation Service is optional
Software
Software is preloaded on compute, storage, and switch.
6Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

ThinkAgile CP6000 series overview
The Lenovo ThinkAgile CP 000 series offering can be scaled up to 40 compute nodes to support
mainstream enterprise workloads and mixed-workload environments.
The Lenovo ThinkAgile CP 000 series consists of the following components:
• “Storage block” on page 7
• “Compute block” on page 8
• “Interconnect switch” on page 8
• “Management switch” on page 8
• “Services” on page 9
• “Software” on page 9
Storage block
• 1 Storage Block - a maximum 5 blocks (SB-D20)
• Dual controller - 2CPU per controller
• 8x SFP Base-T SFP+ adapters
• 8x CAT cables per storage block, 1.5m and other lengths permitted
• 4 GB RAM per controller
• 8, 1 , 24 drives (8 drives per drive pack)
• 1. TB, 3.2 TB, .4 TB NVMe drives per controller
• Drives must be consistent within a controller
• Dimensions: 87. x 44 .4 x 857.2 mm (3.4 x 17. x 33.7 inches)
• Maximum weight: 42.0 kg (92. lb)
Chapter 1.ThinkAgile CP Overview 7

Compute block
• 1 D2 enclosure, fully populated PSU, fan, 220V with 10Gb SFP+ network module — maximum 10
enclosure
• Minimum 2 SD530 nodes, default 4, maximum 40 nodes
• 128 GB, 25 GB, 384 GB, 512 GB, 7 8 GB, 1024 GB RAM
• 8+ cores per CPU, 1-2 sockets filled AXQT, and others
• 2x SFP+ DAC cables per node, 1.5m and other lengths permitted
• Boot: 1x SATA 240 GB
• Dimensions: 41.0 x 5 2.0 x 222.0 mm (1.7 x 22.2 x 8.8 inches)
• Maximum weight: 55 kg (121.2 lbs)
Interconnect switch
• 2 CP-I-10 Interconnect switches
• 48x 10 Gb SFP+ fabric ports
• x 40 Gb QSFP+ fabric ports
• Dimensions: 438.4 x 473 x 43.4 mm (17.2 x 18. 2 x 1.71 inches)
• Maximum weight: 8.95 kg (19.73 lb), with two installed PSUs
Management switch
Lenovo ThinkSystem NE0152T RackSwitch
8Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Note: A dedicated out-of-band (OOB) management switch is required for this solution. If the Lenovo
NE0152T is not used, you must provide an OOB management switch with the correct configuration.
Services
Lenovo Deployment Services are mandatory
Lenovo Hardware Installation Service is optional
Software
Software is preloaded on compute, storage, and switch.
Chapter 1.ThinkAgile CP Overview 9

ThinkAgile CP solution components
This section describes the storage and compute blocks components, and information about the available
power cords.
Storage block parts list
This section describes the components of the ThinkAgile CP storage block.
The parts listed in the table below fall into these categories:
• Tier 1 customer replaceable unit (CRU): Replacing Tier 1 CRUs is your responsibility. If Lenovo installs a
Tier 1 CRU at your request with no service agreement, you will be charged for the installation.
• Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request Lenovo to install it, at
no additional charge, under the warranty service type designated for your storage.
• Field replaceable unit (FRU): FRUs must be installed only by trained service technicians.
• Consumable and structural parts: Purchase and replacement of consumable and structural parts
(components such as a cover or bezel) is your responsibility. If Lenovo acquires or installs a structural
component at your request, you will be charged for the service.
Table 1. Storage block parts listing
Index Description Tier 1 CRU Tier 2 CRU FRU Consumable and
structural parts
12 Storage controllers ✓
2Enclosure ✓
3Power supplies ✓
4Rail kit ✓
52.5-inch drive fillers ✓
62.5-inch hot swap drives ✓
10 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures

Figure . Storage block components
For more information about ordering the parts shown here, see the following website:
Lenovo Data Center Support page (7Y )
Chapter 1.ThinkAgile CP Overview 11

Compute block parts list
This section describes the components of the ThinkAgile CP compute block.
The parts listed in the table below fall into these categories:
• Tier 1 customer replaceable unit (CRU): Replacing Tier 1 CRUs is your responsibility. If Lenovo installs a
Tier 1 CRU at your request with no service agreement, you will be charged for the installation.
• Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request Lenovo to install it, at
no additional charge, under the warranty service type designated for your compute.
• Field replaceable unit (FRU): FRUs must be installed only by trained service technicians.
• Consumable and structural parts: Purchase and replacement of consumable and structural parts
(components such as a cover or bezel) is your responsibility. If Lenovo acquires or installs a structural
component at your request, you will be charged for the service.
Table 2. Compute block part listing
Index Description Tier 1 CRU Tier 2
CRU
FRU Consuma-
ble and
Structural
part
1 PCIe adapter ✓
2Air baffle ✓
3Processor and heat sink assembly (85mm heat sink) ✓
4Processor and heat sink assembly (108mm heat
sink)
✓
5Processor and heat sink assembly (108mm heat
sink)
✓
6Processor and heat sink assembly (T-shaped heat
sink)
✓
7Trusted Cryptographic Module ✓
8M.2 backplane ✓
9DIMM ✓
10 2.5-inch drive bay blank (for empty bays next to the
backplane)
✓
11 2.5-inch drive bay blank panel (for drive bays on the
backplane)
✓
12 2.5-inch hot-swap drive ✓
13 Compute node tray ✓
14 KVM breakout module ✓
15 2.5-inch -drive hot-swap SAS/SATA backplane ✓
16 2.5-inch -drive hot-swap SAS/SATA/NVMe
backplane
✓
17 2.5-inch 4-drive hot-swap SAS/SATA backplane ✓
18 2.5-inch 4-drive hot-swap NVMe backplane ✓
19 Compute block cover ✓
12 Lenovo ThinkAgile CP Hardware Part Replacement and Component Maintenance Procedures