IBM Power 775 User manual

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 1 of 42
Power775
CEC Drawer Rails Service Procedure
Last Modified 2/27/2012

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 2 of 42
CONTENTS
1GENERAL ....................................................................................................................................................................4
1.1 R ELEASE / R EVISION H ISTORY .................................................................................................................................4
1.2 W HERE TO FIND THIS DOCUMENT , AND CONTENTS OF THE PARENT PDF................................................................4
1.3 R EQUIRED D OCUMENTS ...........................................................................................................................................4
1.4 R ELATED D OCUMENTS ............................................................................................................................................4
1.5 A BBREVIATIONS ......................................................................................................................................................5
2OVERVIEW .................................................................................................................................................................6
2.1 S AFETY N OTICES .....................................................................................................................................................6
2.2 F ILE S YSTEM R ISK S TATEMENT ...............................................................................................................................8
2.3 C ONFIRM HOW YOU GOT TO THIS P OWER 775 CEC D RAWER S LIDES /R AILS S ERVICE P ROCEDURE .......................8
2.4 CEC D RAWER S LIDES /R AILS D ESCRIPTION ............................................................................................................9
2.5 B ACKGROUND ........................................................................................................................................................10
2.6 C ONCURRENCY ......................................................................................................................................................10
2.7 CEC D RAWER S LIDES /R AILS W EIGHT ..................................................................................................................10
2.8 R EQUIRED SSR S AND R OLES .................................................................................................................................10
2.9 E STIMATED S ERVICE T IME ....................................................................................................................................10
2.10 P7IH H AND T OOL K IT R EQUIRED T OOLS ..............................................................................................................10
2.11 P REREQUISITES FOR THIS P ROCEDURE ..................................................................................................................11
2.12 O VERVIEW OF P ROCEDURE ....................................................................................................................................11
3SERVICE PROCEDURE..........................................................................................................................................12
3.1 P REPARE CEC D RAWER FOR S ERVICE TO S LIDES /R AILS <= SSR TASK.............................................................12
3.2 H AVE CUSTOMER CHECK FOR GPFS NODE AND SHUTDOWN CEC D RAWER <= CUSTOMER TASK.................14
3.3 S TART FRU R EPLACEMENT P ROCEDURE <= SSR TASK .....................................................................................15
3.4 F RONT M ECHANICAL P REPARATIONS FOR CEC S LIDES /R AILS S ERVICE <= SSR TASK .....................................18
3.5 A TTACH L IFT T OOL TO RACK <= SSR TASK........................................................................................................20
3.6 R EAR M ECHANICAL P REPARATIONS FOR CEC S LIDES /R AILS S ERVICE <= SSR TASK .......................................26
3.7 T EMPORARILY REMOVE CEC D RAWER <= SSR TASK.........................................................................................32
3.8 R E - INSTALL CEC D RAWER TO ORIGINAL POSITION <= SSR TASK......................................................................37
3.9 V ERIFY ALL D-L INKS AND L-L INKS ARE OPERATIONAL <= C USTOMER TASK....................................................41
3.10 C ONFIRM WITH CUSTOMER THAT CEC IS OPERATIONAL <= SSR TASK ..............................................................41
4END OF POWER775 CEC DRAWER RAILS SERVICE PROCEDURE ..........................................................42
Figure List
Figure 1 CEC Drawer locations ..............................................................................................................................................................9
Figure 2 CEC Slides/Rails in rack...........................................................................................................................................................9
Figure 3 CEC Rail photo.......................................................................................................................................................................10
Figure 4 Service Node configuration ....................................................................................................................................................13
Figure 5 HMC CEC Drawer Selection..................................................................................................................................................15
Figure 6 Exchange FRU Panel ..............................................................................................................................................................15
Figure 7 CEC Drawer Selection............................................................................................................................................................16
Figure 8 FRU Location Code selection.................................................................................................................................................17
Figure 9 Pending Actions Panel ............................................................................................................................................................18
Figure 10 Removal of Front Door.........................................................................................................................................................19
Figure 11 CAM Follower Removal.......................................................................................................................................................19
Figure 12 Position Lift Tool at front side of rack..................................................................................................................................20
Figure 13 Lift Tool front mounting bracket ..........................................................................................................................................21
Figure 14 Safety gate positioning..........................................................................................................................................................21
Figure 15 Slide mid and rear tables out by pressing the release latches................................................................................................22

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 3 of 42
Figure 16 Lift Tool Platform Position...................................................................................................................................................22
Figure 17 Lift table movement path......................................................................................................................................................23
Figure 18 Secure cables.........................................................................................................................................................................23
Figure 19 Power Drill Operation – Correct Technique .........................................................................................................................24
Figure 20 Power Drill Operation – Correct Settings for Use ................................................................................................................25
Figure 21 CEC Drawer rear view..........................................................................................................................................................26
Figure 22 Location Codes for D-Link and L-Link assemblies..............................................................................................................26
Figure 23 Optical Backplane Enclosure................................................................................................................................................27
Figure 24 OBE Sidewall Assembly.......................................................................................................................................................28
Figure 25 D-Link Grouper ....................................................................................................................................................................29
Figure 26 D-Link Grouper assembly detail...........................................................................................................................................29
Figure 27 CEC Drawer rear water connections.....................................................................................................................................30
Figure 28 CEC Drawer retaining ring image ........................................................................................................................................31
Figure 29 Rear CEC Rail mounting bracket..........................................................................................................................................31
Figure 30 Safety Latch actuation...........................................................................................................................................................33
Figure 31 CEC Rail Details...................................................................................................................................................................35
Figure 32 Rack features for Slide/Rail installation ...............................................................................................................................35
Figure 33 Guide pin vs rack keyhole alignment....................................................................................................................................36
Figure 34 Guidepin location in rack after installation...........................................................................................................................36
Figure 35 Rail mounting screw location ...............................................................................................................................................37
Figure 36 CEC Drawer lined up with Slide/Rail...................................................................................................................................38
Figure 37 OBE Installation ...................................................................................................................................................................40
Figure 38 D-Link Grouper Installation .................................................................................................................................................41
Table List
Table 1 Release / Revision History .........................................................................................................................................................4
Table 2 Required Documents..................................................................................................................................................................4
Table 3 Related Documents ....................................................................................................................................................................4

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 4 of 42
1 GENERAL
1.1 Release / Revision History
Document Name Date PDF name Description
Power775 CEC Drawer Rails Service Procedure 2/27/2012
“p775_cec_rails.pdf” Initial Release
Table 1 Release / Revision History
1.2 Where to find this document, and contents of the parent PDF
The current Power775 CEC Drawer Rails Service Procedure document is “p775_cec_rails.pdf” which is to be downloaded from:
InfoCenter Website: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7ee2/p7ee2kickoff.htm
Click “PDF files for the IBM Power 775 (9125-F2C) removing and replacing parts”
Under “CEC Drawer”, click “Power775 CEC Drawer Rails Service Procedure” to download PDF “p775_cec_rails.pdf”
This is the only valid source for the latest Power775 CEC Drawer Rails Service Procedure.
1.3 Required Documents
Document Doc Number Location
Safety Notices
http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/top
ic/p7hdx/G229-9054.pdf
Doc# G229-9054 InfoCenter *
Table 2 Required Documents
*InfoCenter Website: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7ee2/p7ee2kickoff.htm
1.4 Related Documents
Document Doc Number Location
“GPFS Native RAID Administration and Programming Reference" SA23-1354 InfoCenter *
Table 3 Related Documents
*InfoCenter Website: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7ee2/p7ee2kickoff.htm

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 5 of 42
1.5 Abbreviations
Abbreviation Definition Details
CEC Central Electronic Complex Also referred to as the node.
DCCA Distributed Conversion and Control
Assembly
The power supplies for the CEC and DE are called the
CEC DCCA and DE DCCA respectively.
DE Disk Enclosure
GPFS Global Parallel File System IBM’s file system utilizing software RAID
HDD Hard Disk Drive This also means hard drive
HPIC High Power Interface Cable DCCA Power Cable
LED Light Emitting Diode
PCB Printed Circuit Board
RAID Redundant Array of Inexpensive Disks
SAS Serial Attached SCSI Protocol used for direct attached storage
SSR System Service Representative IBM Service personnel
SSD Solid State Drive
UEPO Unit Emergency Power Off
UNVSA Utility Non-Volatile Storage Assembly Harddrive function in PCIe cassette

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 6 of 42
2 OVERVIEW
This section is an overview only. Do not start the service procedure until Section 3 which contains the detailed steps.
2.1 Safety Notices
Read “Safety_Notices “ available from InfoCenter at this link:
http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hdx/G229-9054.pdf
The following cautions apply to all Power775 service procedures:
CAUTION:
Energy hazard present. Shorting might result in system outage and possible physical injury.
Remove all metallic jewelry before servicing. (C001)
CAUTION:
The doors and covers to the product are to be closed at all times except for service by trained
service personnel. All covers must be replaced and doors locked at the conclusion of the service
operation. (C013)
CAUTION:
Servicing of this product or unit is to be performed by trained service personnel only. (C032)
The following notices specifically pertain to this Power775 service procedure.
CAUTION:
This part or unit is heavy but has a weight smaller than 18 kg (39.7 lb). Use care when lifting, removing, or installing
this part or unit. (C008)
CAUTION: Do not remove or install this unit without using the provided lift tool. (C017)
CAUTION:
This product contains a Class 1M laser. Do not view directly with optical instruments. (C028)
CAUTION:
The water-based coolant solution may contain an additive intended to inhibit corrosion (or provide other functions).
The solution may cause irritation to the skin or eyes. Avoid direct contact with the solution. Employ appropriate
Personal Protective Equipment when performing operations involving the coolant or which may potentially expose
you to the coolant. Refer to the MSDS for more information. (C037)
CAUTION:
Following the service procedure assures power is removed from 350 VDC power distribution connectors before they
are unplugged. However, unplugging 350 VDC power distribution connectors while powered on, should not be done
because it can cause connector damage and could result in burn and/or shock injury from electrical arcing. (C039)
DANGER: Rack-mounted devices are not to be used as shelves or work spaces. (L002)

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 7 of 42
CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which
might result in splattered metal, burns, or both. (L005)
CAUTION: Hazardous moving parts nearby. (L008)
CAUTION: System or part is heavy. The label is accompanied by a specific weight range. (L009)
CAUTION: Protective eyewear is needed for the procedure. (L011)
CAUTION: Pinch hazard. (L012)
ATTENTION: Small gaps exist that could pinch body parts if care is not exercised.
CAUTION: Chemical resistant gloves are needed for this procedure. (L014)
DANGER: Risk of electric shock due to water or a water solution which is present in this product.
Avoid working on or near energized equipment with wet hands or when spilled water is present.
(L016)
DANGER: Risk of injury due to heavy components falling from rack if the supplemental
supports are not installed. (L019)
ATTENTION: The supplemental supports (Cam Followers) must be installed for the CEC or DE slide out service.

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 8 of 42
CAUTION: Do not pull out more than one drawer at a time. The rack might become unstable if you
pull out more than one drawer at a time. (L024)
2.2 File System Risk Statement
The Global Parallel File System (GPFS) implementation of software RAID stripes data across all the Disk Enclosures in the
cluster. If servicing a CEC Drawer supporting a Service Node, then all Disk Enclosures running off of this service
node will go into panic and become unavailable. If servicing a CEC Drawer supporting a GPFS node then the file
system will go into panic and become unavailable. To avoid this situation you must migrate the drawers to be served
by other nodes/CEC Drawers.
2.3 Confirm how you got to this Power 775 CEC Drawer Slides/Rails
Service Procedure
You should be performing this procedure if
An SRC directed you to complete a CEC Slide/Rail replacement
You should have downloaded this procedure from:
InfoCenter Website: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7ee2/p7ee2kickoff.htm
This is the only valid source for the latest Power775 CEC Drawer Slides/Rails Service Procedure

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 9 of 42
2.4 CEC Drawer Slides/Rails Description
Referring to Figure 1 below, the CEC Rails support the weight of each CEC Drawer. There is one set of CEC Rails per
CEC Drawer. The CEC Rails are located along the left and right sides of the frame.
Figure 1 CEC Drawer locations
Figure 2 shows a CEC Drawer partially installed in the system. One CEC Slides/Rails is shown in the left portion
of the image.
Figure 2 CEC Slides/Rails in rack
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer
CEC Drawer

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 10 of 42
2.5 Background
The CEC Rails support and retain the CEC drawer in the frame. Figure 3 shows a photo of one CEC Rail, note that two are
required per CEC Drawer. Note: the A and B designation in this image are not important for background understanding.
Figure 3 CEC Rail photo
2.6 Concurrency
The CEC Rails are not concurrently maintainable. The CEC drawer that is supported by the CEC Rails being serviced must
be powered down completely and 350 volts should be off. The CEC drawer that is supported by the set of CEC Rails being
serviced must be temporarily removed from the frame to a lift tool. All other Drawers in the system can remain powered on.
2.7 CEC Drawer Slides/Rails Weight
Each CEC Rail weighs 3.9 lbs (1.7 kg), a complete set weighs 7.8 lbs (3.4 kg). The CEC Drawer will also need to be
serviced as part of this procedure, a CEC drawer can weigh up to 350 lbs (160 kg) depending on configuration.
2.8 Required SSRs and Roles
This service procedure requires 1 SSR.
This service procedure contains steps to be performed by a customer system administrator and an IBM System Service
Representative (SSR)
•The customer system administrator and SSR tasks are separately called out in the procedure.
2.9 Estimated Service Time
3 hours
2.10 P7IH Hand Tool Kit Required Tools
2mm Hex Driver (0.07Nm Torque setting), PN 74Y0983, HPIC Jackscrews
4mm Hex Driver (41V1059)
3/8" Ratchet, PN 6428140, CEC Drawer Mounting
3/8" Torque Clutch - (23 - 31 Nm torque setting), PN 74Y0985, CEC Drawer Mounting
3/8" Extension - 18", PN 46K2707, CEC Drawer Mounting
3/8" Socket Bit, 5mm Hex, PN 74Y0986, CEC Drawer Mounting
Flat Blade Screw Driver - 1/8" X 4", PN 73G5367, to remove CEC Drawer top cover

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 11 of 42
2.11 Prerequisites for this Procedure
In order to perform this procedure, you will need the following information:
1) The location code of the FRU to be serviced
2) The cage location of the FRU to be serviced
3) The frame number of the FRU to be serviced
2.12 Overview of Procedure
This is an overview of the tasks to be performed. Read this overview but do not perform any of the tasks yet.
PREPARE CEC DRAWER FOR SERVICE TO SLIDES/RAILS
HAVE CUSTOMER CHECK FOR GPFS NODE AND SHUTDOWN CEC DRAWER
START FRU REPLACEMENT PROCEDURE
FRONT MECHANICAL PREPARATIONS FOR CEC SLIDES/RAILS SERVICE
ATTACH LIFT TOOL TO RACK
REAR MECHANICAL PREPARATIONS FOR CEC SLIDES/RAILS SERVICE
TEMPORARILY REMOVE CEC DRAWER
RE-INSTALL CEC DRAWER TO ORIGINAL POSITION
VERIFY ALL D-LINKS AND L-LINKS ARE OPERATIONAL
CONFIRM WITH CUSTOMER THAT CEC IS OPERATIONAL

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 12 of 42
3SERVICE PROCEDURE
STOP – Do not proceed unless you have read “G229-9054.pdf”
which is available from InfoCenter; see Section 1.3.
3.1 Prepare CEC Drawer for Service to Slides/Rails <= SSR TASK
STEP 1 The HMC can be accessed via the keyboard/display that resides in the management rack or by
plugging a laptop into the BPCH of the rack where the service will be performed.
STEP 2 Logon to the HMC.
STEP 3 Determine if the CEC Drawer contains the Service node, see Figure 4 . If it does, have the
system administrator reassign the nodes supported by the Service Node to the backup service node.
(A CEC Drawer with a Service node will have a UNVSA card (usually 2 as shown below) and a 2 port SAS
card plugged its PCI slot(s) (the UNVSAs are normally plugged into PCI slots 14 & 16, the SAS card in slot 15,
but may be in any 3 locations in the CEC Drawer) . If the CEC Drawer has one of its octants functioning as a
Service node, all the CEC Drawers being supported by the Service node must be reassigned to the backup
Service node in the building block before powering the CEC off.)

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 13 of 42
Figure 4 Service Node configuration

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 14 of 42
3.2 Have customer check for GPFS node and shutdown CEC Drawer <=
CUSTOMER TASK
STEP 4 Check for GPFS node in CEC Drawer to be serviced
•Have the customer determine if there is a GPFS node in the CEC drawer to be shut down.
•If the CEC drawer contains a GPFS node, verify that there is an active backup GPFS node for the GPFS
node that will be shut down during this service action. If there is no active backup, the filesystem will
go down when this CEC drawer is shut down.
•If there is an active backup GPFS node, proceed to STEP 5 .
•If there is no active backup GPFS node, perform the following:
•If you can activate the backup GPFS node, activate it before proceeding with this service action.
After the backup GPFS is active, you may proceed to STEP 5 .
•If you cannot activate the backup GPFS node because it requires service, service the backup GPFS
node first. Then activate it, and confirm that it is acting as a backup for the GPFS node that is in this
CEC drawer. After the backup GPFS is active, you may proceed to STEP 5 .
•If you cannot activate the backup GPFS node and you cannot service it before proceeding, prepare
the cluster for the filesystem to come down before proceeding. After the filesystem has come down
gracefully, you may proceed to STEP 5 .
STEP 5 Have the system administrator to ensure that the CEC Drawer has no active partitions running.
(This procedure is not a concurrent process from the point of view of the CEC Drawer whose Rails are being
serviced. It should be noted that this procedure is concurrent from the point of view of the other CEC Drawers in
the rack. The procedure does not affect the other CEC Drawers in the rack from continuing to be used.)
STEP 6 Have customer shutdown the CEC Drawer being serviced.

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 15 of 42
3.3 Start FRU Replacement Procedure <= SSR TASK
STEP 7 Initiate the procedure by using CEC Drawer FRU exchange as described below:
STEP 8 In the HMC left Navigation pane, expand Systems Management then click Servers.
STEP 9 Place a checkmark in the Select column for the Server with the CEC Drawer to be serviced.
See Figure 5 .
Figure 5 HMC CEC Drawer Selection
STEP 10 From the Tasks menu select Serviceability -> Hardware -> Exchange FRU. See Figure 6.
Figure 6 Exchange FRU Panel

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 16 of 42
STEP 11 In the Replace Hardware – Replace FRU, Select FRU Type window select CEC Drawer
then click the Next button. See Figure 7 . Note: This CEC Drawer procedure is being used to Power off the CEC
Drawer being serviced(removing 350V)
Figure 7 CEC Drawer Selection

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 17 of 42
STEP 12 In the Replace Hardware – Replace FRU, Select Location window select the FRU Location
code (CEC Drawer) to be serviced then click the Add button. See Figure 8.
a. Select the FRU Location Code that contains the Serial Number of the CEC Drawer to be
serviced.
Only one location code should be displayed similar to: U78A9.001.[CEC Serial Number]-
P1
b. Click the Add button.
STEP 13 The selected Location Code will be added to the Pending Actions list.
Figure 8 FRU Location Code selection

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 18 of 42
STEP 14 In the Pending Actions list, place a checkmark in the Select column for the CEC Drawer to be
serviced then click the Launch Procedure button. See Figure 9.
Figure 9 Pending Actions Panel
STEP 15 Follow the R&V Panels until you arrive at the panel instructing you to open the rear door.
Before opening the rear door you must return to this paper procedure and follow the instructions in the paper
procedure. The paper procedure will take you through removal of the CEC Drawer using the lift tool, replacing
the CEC Rails and then reinstalling the CEC Drawer. After these steps are complete you will return to the R&V
panels as directed in STEP 71 to complete the final steps in the CEC Drawer reinstallation.
3.4 Front Mechanical Preparations for CEC Slides/Rails Service <= SSR
TASK
CAUTION:
This part or unit is heavy but has a weight smaller than 18 kg (39.7 lb). Use care when lifting, removing, or installing this
part or unit. (C008)
STEP 16 Open and remove the front door, See Figure 10. The front door weights 37lbs (16.8 kg)
Push in the door lock latch to release and open the door.
Face the inside of the door and place hands on the cross bars.
Lift upwards.

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 19 of 42
Figure 10 Removal of Front Door
STEP 17 If servicing the CEC Drawer Slides/Rails of the lowest CEC Drawer in the rack, locate and
remove the CAM Followers from their storage location as they are shipped in the lowest slot in the frame. The
CAM Followers can be removed by pulling out the plunger and sliding the CAM Follower up to remove it from
its storage location. See Figure 11.
Figure 11 CAM Follower Removal

Power775 CEC Drawer Rails Service Procedure
PN: 41U8495, EC N44172
Page 20 of 42
3.5 Attach Lift Tool to rack <= SSR TASK
CAUTION: System or part is heavy. The label is accompanied by a specific weight range. (L009)
CAUTION: Do not remove or install this unit without using the provided lift tool. (C017)
Lift tool 74Y1087 is required for this service procedure due to the high weight of the CEC Drawer.
STEP 18 Position the Lift Tool to the front side of the rack as shown in Figure 12.
Figure 12 Position Lift Tool at front side of rack
STEP 19 Attach Lift Tool via the two “Frame Front Mounting Brackets”.
Tool-set: [3/8in-ratchet handle, 230in-lb torque clutch (PN 74Y0985), 30cm (12in) socket
extension, 5mm hex socket bit (PN 74Y0986) ]
STEP 20 Flip the two Rack mounting brackets out (A) towards the slots on the Rack. See Figure 13.