IBM zEnterprise EC12 User manual

zEnterprise EC12
Installation Manual for Physical Planning
2827
All Models
GC28-6914-01

Level 01f

zEnterprise EC12
Installation Manual for Physical Planning
2827
All Models
GC28-6914-01

Level 01f

Note:
Before using this information and the product it supports, read the information in “Safety” on
page v, Appendix G, “Notices,” on page 147, and IBM Systems Environmental Notices and User
Guide, Z125–5823.
This edition, GC28-6914-01, applies to the IBM zEnterprise EC12 (zEC12). This edition replaces GC28-6914-00.
There may be a newer version of this document in a PDF file available on Resource Link.Goto
http://www.ibm.com/servers/resourcelink and click Library on the navigation bar. A newer version is indicated by a
lowercase, alphabetic letter following the form number suffix (for example: 00a, 00b, 01a, 01b).
© Copyright IBM Corporation 2012, 2014.
US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract
with IBM Corp.
Level 01f

Contents
Safety ...............v
Safety notices ..............v
Danger notices ............v
World trade safety information .......v
Laser safety information ..........v
Laser compliance ............v
About this publication ........vii
Revisions ...............vii
Related publications ...........vii
Licensed Machine Code ..........viii
Accessibility ..............viii
Accessibility features ..........viii
Keyboard navigation ..........viii
IBM and accessibility ..........viii
How to send your comments ........ix
Summary of changes.........xi
Chapter 1. Introduction ........1
System planning .............1
Planning for a new computer room.......1
Planning checklist ............2
Customized planning aid ..........6
ASHRAE declarations - radiator-cooled .....7
ASHRAE declarations - water-cooled ......9
Chapter 2. Environmental
specifications ............11
Conductive contamination .........15
Chapter 3. Models and physical
specifications............17
Physical dimensions ...........19
Shipping specifications .........20
zEnterprise zEC12 models ........22
I/O cages, I/O drawers, and PCIe I/O drawers 28
System upgrades ...........29
Differences between IBM servers .......30
Plan views...............31
Weight distribution ............33
System weight examples .........37
Weight distribution and multiple systems . . . 38
Machine and service clearance areas ......40
Cooling recommendations for the room .....42
Special cooling recommendations for water-cooled
machine ...............48
Water supply .............48
Supply hoses .............48
Materials used in the water cooling units . . . 53
Water specifications...........54
Considerations for multiple system installations . . 57
Chapter 4. Guide for raised floor
preparation .............59
Casters ................60
Procedure for cutting and placement of floor panels 61
Raised floor with 610 mm (24 in) or 600 mm
(23.5 in) floor panels ..........62
Chapter 5. Power requirements ....65
Power installation considerations .......66
I/O units ...............67
Line cord/bulk power regulator (BPR) specifications 68
Power specifications ...........70
Power estimation tool ...........72
Power capping .............72
Customer circuit breakers (CBs) .......73
Internal battery feature (FC 3213) .......74
Unit emergency power off (UEPO) .....75
Computer room emergency power off (EPO) . . 76
Power plugs and receptacles.........77
Grounding specifications ..........80
Top exit power cords ...........81
Line cord wire specifications.........83
Wire colors for cut-end three-phase alternating
current cords .............85
Wire colors for cut-end direct current cords. . . 85
Line physical protection .........85
Service outlet (customer-supplied) .......85
Chapter 6. Hardware Management
Console and Support Element
communications ..........87
Support Element.............87
Hardware Management Console .......87
Ethernet LAN switch support ........88
Ethernet network connection requirements ....88
Hardware Management Console and Support
Element wiring options ..........90
Trusted Key Entry (TKE) ..........90
LAN connections ...........91
Planning for an ensemble..........92
Chapter 7. Remote Support Facility
(RSF) installation planning ......93
Choosing a communications method for remote
support................93
Using the internet for remote support ....93
Server address lists and host names .....94
Chapter 8. I/O cabling and connectivity 95
Top exit I/O cabling ...........95
IBM Site and Facilities Services ........97
Customer fiber optic cabling responsibilities . . . 98
FICON channel features ..........99
Configuration information ........99
© Copyright IBM Corp. 2012, 2014 iii
Level 01f

FICON references ...........101
ISC-3 link feature ............102
Configuration information ........102
OSA-Express features...........104
Configuration information ........104
OSA-Express references .........108
I/O interconnect links ..........108
InfiniBand fiber optic link features ......109
Flash Express (FC 0402) ..........110
Native PCIe adapters ...........110
10GbE RoCE Express (FC 0411) ......111
zEnterprise Data Compression (zEDC) Express
(FC 0420) ..............111
Time synchronization...........113
Server Time Protocol (STP) ........113
Pulse per second ...........113
Connectivity information ........113
PPS/FSP location ...........113
Ordering PPS cables ..........114
Fiber Quick Connect (FQC) for FICON cabling . . 115
Preparing configuration definitions .....119
Chapter 9. Parallel sysplex planning 121
Appendix A. IBM standard symbols 125
Appendix B. Hardware Management
Console physical specifications . . . 127
Appendix C. Acoustics .......131
Acoustical noise emission levels .......131
Relevant international standards .......131
Appendix D. 3-phase dual power
installation ............133
Appendix E. Balancing power panel
loads ...............139
Appendix F. Frame tie-down .....141
Raised floor frame tie-down ........142
Installing the eyebolts .........142
Nonraised floor frame tie-down .......145
Appendix G. Notices ........147
Trademarks ..............148
Class A Notices.............148
iv zEC12 IMPP
||
||
||
|
||
Level 01f

Safety
Safety notices
Safety notices may be printed throughout this guide. DANGER notices warn you of conditions or
procedures that can result in death or severe personal injury. CAUTION notices warn you of conditions
or procedures that can cause personal injury that is neither lethal nor extremely hazardous. Attention
notices warn you of conditions or procedures that can cause damage to machines, equipment, or
programs.
Danger notices
DANGER: Heavy equipment — personal injury or equipment damage might result if mishandled.
(D006)
World trade safety information
Several countries require the safety information contained in product publications to be presented in their
translation. If this requirement applies to your country, a safety information booklet is included in the
publications package shipped with the product. The booklet contains the translated safety information
with references to the US English source. Before using a US English publication to install, operate, or
service this IBM®product, you must first become familiar with the related safety information in the
Systems Safety Notices, G229-9054. You should also refer to the booklet any time you do not clearly
understand any safety information in the US English publications.
Laser safety information
All System z®models can use I/O cards such as FICON®, Open Systems Adapter (OSA), InterSystem
Channel-3 (ISC-3), or other I/O features which are fiber optic based and utilize lasers (short wavelength
or long wavelength lasers).
Laser compliance
All lasers are certified in the US to conform to the requirements of DHHS 21 CFR Subchapter J for Class
1 or Class 1M laser products. Outside the US, they are certified to be in compliance with IEC 60825 as a
Class 1 or Class 1M laser product. Consult the label on each part for laser certification numbers and
approval information.
CAUTION: Data processing environments can contain equipment transmitting on system links with
laser modules that operate at greater than Class 1 power levels. For this reason, never look into the
end of an optical fiber cable or open receptacle. (C027)
CAUTION: This product contains a Class 1M laser. Do not view directly with optical instruments.
(C028)
© Copyright IBM Corp. 2012, 2014 v
Level 01f

vi zEC12 IMPP
Level 01f

About this publication
This publication contains information necessary for planning the physical installation of the IBM
zEnterprise®EC12 (zEC12).
Figures included in this document illustrate concepts and are not necessarily accurate in content,
appearance, or specific behavior.
vChapter 1, “Introduction,” on page 1 provides an introduction to planning for your system and a
planning checklist.
vChapter 2, “Environmental specifications,” on page 11 contains important computer room
environmental information.
vChapter 3, “Models and physical specifications,” on page 17 gives plan views, service clearances,
weight distribution, and cooling information for the system.
vChapter 4, “Guide for raised floor preparation,” on page 59 contains information on preparation of the
raised floor.
vChapter 5, “Power requirements,” on page 65 provides power and internal battery feature information.
vChapter 6, “Hardware Management Console and Support Element communications,” on page 87
includes information on hardware management console and support element communications.
vChapter 7, “Remote Support Facility (RSF) installation planning,” on page 93 contains Remote Support
Facility installation planning.
vChapter 8, “I/O cabling and connectivity,” on page 95 discusses cable connectivity information.
vChapter 9, “Parallel sysplex planning,” on page 121 provides information to build a Parallel Sysplex®.
vThe Appendices provide IBM standard symbols, environmental specifications, acoustics, power
installation and power loads, a sample cabling schematic and upgrade paths.
Revisions
A technical change to the text is indicated by a vertical line to the left of the change.
Related publications
IBM publications that you will find helpful and that you should use along with this publication are in the
following list. You can access these books from Resource Link®at http://www.ibm.com/servers/resourcelink,
and click Library from the navigation bar on the left. Then select the server product.
vSystems Safety Notices, G229-9054
vIBM Systems Environmental Notices and User Guide, Z125-5823
vzEnterprise EC12 Installation Manual, GC28-6913
vSystem z Planning for Fiber Optic Links (FICON/FCP, Coupling Links, and Open System Adapters),
GA23-1406
vSystem z FICON Channel-to-Channel Reference, SB10-7157
vOpen System Adapter-Express Integrated Console Controller User’s Guide , SA22-7990
vzEnterprise, System z10, System z9 and zSeries Open Systems Adapter-Express Customer's Guide and
Reference, SA22-7935
In addition to these references, there is also general computer room planning information on IBM's
Resource Link (http://www.ibm.com/servers/resourcelink).
© Copyright IBM Corp. 2012, 2014 vii
Level 01f

Licensed Machine Code
Licensed Machine Code is provided in accordance with the terms and conditions of the applicable IBM
Customer Agreement or other applicable written agreement between the customer and IBM.
Licensed Machine Code (LMC) is a fundamental component of the zEC12 and is copyrighted and
licensed by IBM. Each zEC12 is delivered with Licensed Machine Code that is customized to the specific
machine ordered. The Licensed Machine Code enables the server to operate in accordance with its Official
Published Specifications.
Model upgrades, feature additions, and system engineering changes may require updated Licensed
Machine Code for the system. Updated Licensed Machine Code replaces the existing Licensed Machine
Code.
Relocation of a zEC12 requires that the Licensed Machine Code be reinstalled in the server at the new
location. Refer to the “Discontinuing the System” section of the zEnterprise EC12 Installation Manual for
the procedure for relocating a zEC12.
Accessibility
IBM strives to provide products with usable access for everyone, regardless of age or ability.
Accessible publications for this product are offered in HTML format and can be downloaded from
Resource Link at http://www.ibm.com/servers/resourcelink.
If you experience any difficulty with the accessibility of any System z information, go to Resource Link at
http://www.ibm.com/servers/resourcelink and click Feedback from the navigation bar on the left. In the
Comments input area, state your question or comment, the publication title and number, choose General
comment as the category and click Submit. You can also send an email to [email protected] providing
the same information.
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the
information in any way it believes appropriate without incurring any obligation to you.
Accessibility features
The following list includes the major accessibility features in System z documentation:
vKeyboard-only operation
vInterfaces that are commonly used by screen readers
vCustomizable display attributes such as color, contrast, and font size
vCommunication of information independent of color
vInterfaces commonly used by screen magnifiers
vInterfaces that are free of flashing lights that could induce seizures due to photosensitivity
Keyboard navigation
This product uses standard Microsoft Windows navigation keys.
IBM and accessibility
See the IBM Human Ability and Accessibility Center for more information about the commitment that
IBM has to accessibility.
viii zEC12 IMPP
Level 01f

How to send your comments
Your feedback is important in helping to provide the most accurate and high-quality information. Send
your comments by using Resource Link at http://www.ibm.com/servers/resourcelink. Click Feedback
on the navigation bar on the left. You can also send an email to [email protected]. Be sure to include
the name of the book, the form number of the book, the version of the book, if applicable, and the
specific location of the text you are commenting on (for example, a page number, table number, or a
heading).
About this publication ix
Level 01f

xzEC12 IMPP
Level 01f

Summary of changes
Summary of changes for the zEnterprise EC12 Installation Manual for Physical Planning, GC28-6914.
Table 1. Summary of changes
Release Level Date Changes in Level
01f 10/2014 This revision contains editorial changes and the following technical changes:
vUpdated the weight values on pages 7-10, 20, 30, 33, and 37.
01e 06/2014 This revision contains editorial changes and the following technical changes:
vUpdated the height of the top exit I/O cable towers to include the optional
cable management brackets
vUpdated the weight of the top exit I/O cable towers
vUpdated the location of the installed Fiber Quick Connection mounting
brackets.
01d 04/2014 This revision contains editorial changes and the following technical changes:
vAdded a note to “Procedure for cutting and placement of floor panels” on
page 61.
01c 01/2014 This revision contains editorial changes and the following technical changes:
vCorrected the host name URL. See“Host names” on page 94.
01b 01/2014 This revision contains editorial changes and the following technical changes:
vUpdated the watertight receptacle information for the 415 VAC power cords.
See Table 32 on page 78 in “Power plugs and receptacles” on page 77.
01a 10/2013 This revision contains editorial changes and the following technical changes:
vIn Chapter 5, “Power requirements,” on page 65, added information about
not allowing a mix of AC and DC power and reorganized information.
01 07/2013 This revision contains editorial changes and the following technical changes:
vUpdated environmental specifications information
vAdded information about the 9" minimum requirement for a raised floor for
the zEC12 water-cooled models
vAdded IFP (Integrated Firmware Processor) information
vAdded HMC 7382 (FC 0092) information
vAdded TKE 7.3 (FC 0842) information
vAdded OSA-Express5S information
vUpdated the Remote Support Facility (RSF) information
vAdded Flash Express (FC 0402), 10GbE RoCE Express (FC 0411), and zEDC
Express (FC 0420) information
vUpdated Appendix D, “3-phase dual power installation,” on page 133.
00e 03/2013 This revision contains editorial changes and the following technical changes:
vAdded information about customer cabling responsibilities. See “Customer
fiber optic cabling responsibilities” on page 98
00d 01/2013 This revision contains editorial changes and the following technical changes:
vCorrected information about the frame tie-down feature codes. See
Appendix F, “Frame tie-down,” on page 141.
00c 12/2012 This revision contains editorial changes and the following technical changes:
vAdded information about Ethernet switch 1 Gb speed in sections “Hardware
Management Console” on page 87 and “Ethernet LAN switch support” on
page 88.
© Copyright IBM Corp. 2012, 2014 xi
Level 01f

Table 1. Summary of changes (continued)
Release Level Date Changes in Level
00b 10/2012 This revision contains editorial changes and the following technical changes:
vChanged the order number for the System z Planning for Fiber Optic Links
(FICON/FCP, Coupling Links, and Open System Adapters) document from
GA23-1353 to GA23-1406.
vAdded relative humidity information to Table 2 on page 12.
vUpdated the BTA information in “Water specifications” on page 54.
vRemoved feature codes 4022, 4024, 4025, and 4026 from the Table 19 on page
67.
00a 09/2012 This revision contains editorial changes and the following technical changes:
vIn the “Weight distribution” on page 33 section:
– Updated the weight values in Table 7 on page 33 and Table 8 on page 33.
– Updated the floor loading data in four tables.
vIn the “System weight examples” on page 37 section, updated the values in
Table 9 on page 37.
vIn the “Customer circuit breakers (CBs)” on page 73 section, corrected the
circuit breaker value for 380-415 VAC.
vIn the “Power plugs and receptacles” on page 77 section, added supported
power cord feature codes to the table.
xii zEC12 IMPP
Level 01f

Chapter 1. Introduction
This chapter is intended to help you prepare your physical site for the installation of a zEC12. Marketing
and installation planning representatives are also available to help you with installation planning. Proper
planning for your new system will facilitate a smooth installation and fast system startup.
The use of the terms, “server”, “processor”, “system” and “all models” in this publication refer to the
IBM zEC12.
System planning
As part of your system planning activity, you will make decisions about where to locate your equipment,
who will operate the system, and so on. A good plan ensures that the equipment and materials are ready
to use when the zEC12 arrives.
The type of software (operating system and application programs) that you intend to use must support
the features and devices on the system. You should already be familiar with your software requirements,
but may want to contact your IBM marketing representative for information on planning for the software.
Planning for a new computer room
A detailed step-by-step procedure for physically planning a computer room installation is located on the
General Information for Planning a Physical Site page on Resource Link (http://www.ibm.com/
servers/resourcelink). On the left navigation pane, click Planning,Physical Planning, and General
information for planning a physical site (located under zSeries & S/390®).
© Copyright IBM Corp. 2012, 2014 1
Level 01f

Planning checklist
The following checklist identifies installation tasks and responsibilities sequentially, and is designed for
new installations. If you have to renovate your site, you may need a longer planning cycle.
CHECKPOINT 1
,
,
:
Designate a person in your organization with the responsibility
for all phases of site preparation for this system installation
Review all site planning information with the designated person
Determine who will actually perform each site preparation task
and who will control the marking of this checklist
Identify communication needs, including Remote Support Facility
cables, switches, telephones, connection panels, etc
In the Chapter titled, “I/O cabling and connectivity” (in this document)
read the information about planning now for future cabling needs.
In the same chapter, also read “IBM Site and Facilities Services”
Identify channel needs including
cables, directors, switches, patch panels, etc
Identify other machine/device needs including:
changes to any existing equipment
Determine the schedule with your IBM marketing representative
and fill in the target dates on this checklist
Site Preparation Checklist
Task/Consideration Task Assigned Target Date Completed
( )
If the level of acoustical noise is a concern, consider arranging the floor layout to
avoid areas of excessive noise exposure to employees, and possibly utilize noise
control screens or other treatments to reduce noise levels. Some IBM servers
have available acoustic doors to reduce noise. Check with your marketing
representative to see if your server has such options.
If this is a new computer room, see the course,
under “Planning / Physical Planning / zSeries”
on Resource Link ( )
communication equipment cables, modems, switches,
telephones, connection panels, etc
Order channel equipment cables, directors, switches, patch panels, etc.
In the Chapter titled, “I/O cabling and Connectivity” (in this document)
read the information about “IBM Site and Facilities Services”
and “Customer fiber optic cabling responsibilities” to
determine your cabling requirements and responsibilities. Your IBM
marketing representative can assist you with this task. Other parts
of this chapter include fiber optic channel and adapter descriptions
and information about the Fiber Quick Connect feature for FICON
channels.
If you are planning for a system that will use FICON channels,
InfiniBand, coupling links, or Open System Adapters (OSA),
contact your IBM marketing representative to obtain the document,
, GA23-1406
Order other machines/devices, including changes to any existing
equipment
CHECKPOINT 2
,
Lay out the floor plan. Include stationary obstacles, walls, all computer
equipment, locations for power, lighting, heating and cooling, water and
fire detection and extinguishing equipment
Order
General information
for planning the physical site
http://www.ibm.com/servers/resourcelink
System z Planning for Fiber Optic Links (FICON/FCP, Coupling Links,
and Open System Adapters)
2zEC12 IMPP
Level 01f

Site Preparation Checklist
Task/Consideration Task Assigned Target Date Completed
( )
The c
CHECKPOINT 3
omputer room is prepared for computer equipment service clearance
and floor loading, physical placement based on logical priority, cabling
restrictions, and shock and vibration considerations, and electromagnetic
compatibility/interference
Emergency and backup operations planning includes provisions for
fire detection, prevention, extinguishing, and control equipment, and
storm protection and damage recovery procedures
There is workspace around equipment, including passageways for
movement of people and machines, and includes consideration for
lighting and possible areas of high acoustic noise
Office equipment and space, including furniture, vending, meeting, and
entrance/exit areas have adequate lighting, heating/cooling, and
acoustics
Material and data storage provisions have been satisfied
Schedule and make changes to existing programs as required
Schedule and make changes to existing machines/devices as required
Arrange for installation of cables between work stations, controllers,
modems, switches, etc
Arrange for installation of new power receptacles and wiring
Define a training program for employees
Computer room power should be completed.
electrically clean, dedicated circuits for all computer equipment
sufficient power provided to avoid outages caused by power transients
protection from lightning damage
Backup power batteries or generators, if required
Branch circuits, grounding, conduits, phase rotation, emergency controls,
to local electrical code and equipment guidelines
An adequate number of computer equipment and convenience outlets have
been provided in the locations where they are to be used
Computer room personnel are adequately trained in power procedures,
including emergency situations
Review the progress of the communications, channel, and adapter
cabling. Identify and resolve problems and schedule conflicts
Review the system configuration to make sure there are no physical
problems and that the configuration meets your needs.
CHECKPOINT 4
Chapter 1. Introduction 3
Level 01f

Site Preparation Checklist
Task/Consideration Task Assigned Target Date Completed
( )
Air conditioning installation is complete
capacity and controls provided for automatic temperature and humidity levels
filtration system is adequate and maintenance plan established
regular monitoring and testing
Training for computer room personnel
If you have elected to do your own I/O cabling, as cables begin to
arrive, start installing and labeling them. Label power receptacles
as they are installed
Complete the Systems Assurance Product Review with your IBM
marketing representative or Business Partner and the system installers
Carefully measure the delivery path from the shipper drop-off point
to the raised floor install location. Accurate measurements now may
prevent installation delays later
CHECKPOINT 5
CHECKPOINT 6
Complete communication equipment installation,
cables, modems, switches, telephones, connection panels, etc
Complete the Remote Support Facility installation
LAN and communication cables, switches, patch panels, etc
Prepare IOCP input statements or HCD definitions
Use the CHPID Mapping Tool on Resource Link to help assign
PCHIDs to CHPIDs
If you have elected to do your own I/O cabling, complete the checkout
of system cables as much as possible. Verify that the cables are
properly routed, protective end caps are in place, that the processor
ends of the cables are safely out of the way for system installation,
and that cable safety procedures are followed
Complete the checkout of the power cables. Test for continuity and
polarity, proper grounding, correct phase wiring, and general power
safety considerations
Complete the required changes to the existing programs and data
processing units
Install communication facilities, such as telephone lines
4zEC12 IMPP
Level 01f

Site Preparation Checklist
Task/Consideration Task Assigned Target Date Completed
( )
CHECKPOINT 7
Are there any new applications that must be installed/ tested before the
new system arrives?
Do you need to conduct training with computer room personnel:
- Safety?
- Security?
- Operations?
- Other?
Are there any outstanding hardware changes that need to be made
to existing:
- Computer equipment?
- Communications equipment?
- Site facilities?
Is the system configuration ready for installation:
- IOCP input?
- CHPIDs?
Do you have a comprehensive channel cabling plan in place:
- Are all cables either ordered or on hand?
- Do you have a reliable installer ready to go?
- Are plans in place for cable connection at remote devices?
- Is there a system test plan?
- Are you prepared to provide cable labels or labeling information?
- Are protective end cap devices in place on all cable connectors?
- Are cables routed and coiled out of the way for installation?
Is the path for moving the new equipment:
- Wide enough?
- High enough?
- Free of obstructions?
- Ramps ready, if necessary?
Are floor panels ready?
Is all furniture and miscellaneous equipment in place or out of the
way for installation?
Is your setup team trained and ready for the arrival of the new equipment?
Complete the site preparation
Move unit(s) to installation location.
Place the units according to machine clearance dimensions provided in
“Machine and service clearance areas” (in this document).
Unpack unit(s) according to instructions.
Call your service provider to install the unit(s).
ARRIVAL OF NEW EQUIPMENT
Chapter 1. Introduction 5
Level 01f

Customized planning aid
A customized planning aid will be available for your system one day after receipt of your order in
manufacturing. You may obtain access to this aid by registering on Resource Link. This planning aid will
include unique physical planning requirements based on your system’s specific configuration.
It is important to note here that the planning aid is not intended to replace this manual. You should be
familiar with the contents of this document before you attempt to use the planning aid.
6zEC12 IMPP
Level 01f