Sun Microsystems Sun Netra CP3250 User manual

Sun Microsystems, Inc.
www.sun.com
Submit comments about this document at: http://www.sun.com/hwdocs/feedback
Sun Netra™CP3250
Blade Server User’s Guide
Part No. 820-5195-11
April 2009, Revision 01

Please
Recycle
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved.
This distribution may include materials developed by third parties.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in
the U.S. and in other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, Netra, Sun Ray, the Netra logo and the Solaris logo are trademarks or registered trademarks of Sun
Microsystems, Inc., or its subsidiaries, in the U.S. and other countries.
All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other
countries. Products bearing SPARC trademarks are based upon architecture developed by Sun Microsystems, Inc.
Use of any spare or replacement CPUs is limited to repair or one-for-one replacement of CPUs in products exported in compliance with U.S.
export laws. Use of CPUs as product upgrades unless authorized by the U.S. Government is strictly prohibited.
DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright © 2009 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, Etats-Unis. Tous droits réservés.
Cette distribution peut comprendre des composants développés par des tierces parties.
Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque
déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.
Sun, Sun Microsystems, le logo Sun, Netra, Sun Ray, le logo Netra et le logo Solaris sont des marques de fabrique ou des marques déposées de
Sun Microsystems, Inc., ou ses filiales, aux Etats-Unis et dans d’autres pays.
Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc.
aux Etats-Unis et dans d’autres pays. Les produits portant les marques SPARC sont basés sur une architecture développée par Sun
Microsystems, Inc.
L’utilisation de pieces detachees ou d’unites centrales de remplacement est limitee aux reparations ou a l’echange standard d’unites centrales
pour les produits exportes, conformement a la legislation americaine en matiere d’exportation. Sauf autorisation par les autorites des Etats-
Unis, l’utilisation d’unites centrales pour proceder a des mises a jour de produits est rigoureusement interdite.
LA DOCUMENTATION EST FOURNIE "EN L’ETAT" ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFACON.

iii
Contents
Preface xiii
1. Overview 1–1
1.1 Overview 1–2
1.2 Features 1–2
1.3 Physical Description 1–4
1.3.1 Front Panel Components 1–4
1.3.2 Blade Server Diagram 1–6
1.4 System Configurations 1–7
1.4.1 AMC 1–8
1.4.2 Advanced Rear Transition Module 1–8
1.5 Hot-Swap Support 1–11
1.6 System Components 1–11
1.6.1 Required Hardware Components 1–11
1.6.2 Optional Hardware Components 1–12
1.6.3 Software Components 1–12
1.7 Technical Support and Warranty 1–13
1.7.1 Locating the Part Number and Serial Number Information 1–13
1.7.2 Viewing the Electronic Blade Server ID Information 1–14

iv Sun Netra CP3250 Blade Server User’s Guide • April 2009
2. Hardware Installation and Service 2–1
2.1 Safety and Tool Requirements 2–2
2.1.1 Equipment and Operator Safety 2–2
2.1.2 Materials and Tools Required 2–3
2.2 Installing the Blade Server 2–4
2.2.1 Preparing for the Installation 2–4
2.2.1.1 Check Power, Thermal, Environmental, and Space
Requirements 2–4
2.2.1.2 Local Network IP Addresses and Host Names
Worksheet 2–5
2.2.1.3 Installation Procedure Summary 2–6
2.2.2 Configuring the Hardware 2–6
2.2.2.1 Verify Chassis Fan Tray Upgrade 2–6
2.2.2.2 Installing Optional Components 2–7
2.2.2.3 Configuring the Advanced Rear Transition Module
(ARTM) 2–7
2.2.3 Installing the Netra CP3250 Blade Server in an ATCA Shelf 2–8
2.2.3.1 Installing an Advanced Rear Transition Module
(ARTM) 2–8
2.2.3.2 Installing the Blade Server Into the Shelf 2–11
2.2.4 Connecting External I/O Cables 2–13
2.2.4.1 Connecting Cables to a System Console Running the
Solaris OS 2–13
2.2.4.2 Connecting Cables to the System Console Not Running
the Solaris OS 2–15
2.2.4.3 Netinstall Boot Device Map 2–15
2.3 Service Procedures 2–17
2.3.1 Hot-Swapping the Netra CP3250 Blade Server 2–17
2.3.2 Powering Off the Netra CP3250 Blade Server 2–17
2.3.3 Removing the Netra CP3250 Blade Server 2–18
2.3.4 Powering On the System 2–18

Contents v
2.3.5 Automatic Power-Off Events 2–18
2.3.6 Servicing DIMMs 2–19
2.3.6.1 DIMM Requirements 2–19
2.3.6.2 Installing a DDR2 DIMM 2–21
2.3.6.3 Removing a DDR2 DIMM 2–23
2.3.7 Installing the Optional Compact Flash Card 2–24
2.3.8 Installing Optional AMC 2–27
2.3.9 Adding or Replacing the Battery 2–30
2.3.10 Changing Jumper Settings 2–31
2.3.10.1 Clearing the CMOS Setting Using Jumper 2 2–31
2.3.10.2 Changing the OOS LED Color Using Jumper 13 2–32
2.3.11 Checking DIP Switch Settings 2–33
2.3.12 Resetting the Netra CP3250 Blade Server 2–34
3. Hardware Architecture 3–1
3.1 Block Diagram 3–2
3.2 Intel Processors 3–3
3.3 Intel San Clemente MCH 3–3
3.4 Memory 3–4
3.5 Networking and I/O 3–5
3.5.1 ICH9 I/O Controller Hub 3–5
3.5.2 PCI Express Bus 3–5
3.5.3 LPC Bus Interface 3–6
3.5.4 Redundant BIOS 3–6
3.5.5 Trusted Platform Module (TPM) 3–7
3.5.6 IPMC 3–7
3.5.7 RS-232 Serial Ports 3–7
3.5.8 Broadcom 5715C Gigabit Ethernet 3–8

vi Sun Netra CP3250 Blade Server User’s Guide • April 2009
3.5.9 Sun Dual 10-Gbit Ethernet/Quad 1-Gbit RGMII Network Interface
Chip 3–8
3.6 I/O Components 3–8
3.6.1 AMC Slot 3–8
3.6.2 EIDE/ATA for Compact Flash 3–9
3.6.3 SAS/SATA 3–9
4. Software Configuration 4–1
4.1 Operating Systems 4–2
4.2 Software Updates 4–2
4.3 SunVTS Software 4–3
4.4 Configuring Sun Netra CP3250 blade server For 1 GbE or 10 GbE
Switches 4–4
5. Configuring and Using BIOS Firmware 5–1
5.1 About BIOS Settings 5–2
5.1.1 Navigating BIOS Screens 5–2
5.1.2 BIOS Option ROMs 5–2
5.1.3 Description of the BIOS Screens 5–3
5.2 Changing the Configuration of a BIOS Menu Item 5–3
5.3 Setting the Boot Device Using BIOS Setup Screens 5–4
5.4 Setting Supervisor and User Passwords 5–5
5.5 Resetting the System Time and System Date 5–6
5.6 Updating the BIOS 5–6
5.7 Secondary BIOS Image 5–7
5.8 Perform a Live Firmware Upgrade 5–8
5.9 Power-On Self-Test 5–8
5.10 Changing POST Options 5–9
A. BIOS Screens A–1

Contents vii
B. Physical Characteristics B–1
B.1 Form Factor B–2
B.2 Power and Thermal Metrics B–2
B.3 Connectors and Pinouts B–2
B.3.1 Front Panel Connectors B–2
B.3.1.1 Ethernet Port B–3
B.3.1.2 USB Ports B–4
B.3.1.3 Serial Port B–5
B.3.2 AMC Connector B–5
B.3.3 Power Connector (Zone 1) B–6
B.3.4 Data Transport Connector (Zone 2) B–8
B.3.5 Advanced Rear Transition Module (ARTM) Connector (Zone 3)
B–9
B.3.5.1 Zone 3 (J30) Connector Pin Assignments B–10
B.3.5.2 Zone 3 (J31) Connector PIN Assignments B–11
B.3.5.3 Zone 3 (J32) Connector PIN Assignments B–12
B.3.5.4 Zone 3 (J33) Connector PIN Assignments B–13
B.3.5.5 Zone 3 Signal Descriptions B–14
C. ShMM CLI and Commands C–1
C.1 Shelf Manager Command-Line Interface C–2
C.2 Shelf Manager CLI Commands C–3
Index Index–1

viii Sun Netra CP3250 Blade Server User’s Guide • April 2009

ix
Figures
FIGURE 1-1 Netra CP3250 Blade Server (Front View) 1–4
FIGURE 1-2 Netra CP3250 Blade Server (Component Side View) 1–6
FIGURE 1-3 Netra CP3250 Blade Server in Shelf Enclosure 1–7
FIGURE 1-4 Netra CP3250 Blade Server, Backplane, and Relationship to ARTM 1–9
FIGURE 1-5 Netra CP3250 Blade Server Barcode Labeling 1–14
FIGURE 2-1 Installing a Netra CP32x0 ARTM 2–9
FIGURE 2-2 Injector/Ejector Latch and Locking Screw on the ARTM 2–10
FIGURE 2-3 Engaging the Netra CP3250 Blade Server Latch 2–12
FIGURE 2-4 Serial Port on the Netra CP3250 Blade Server 2–14
FIGURE 2-5 Locating DIMM Slots 2–20
FIGURE 2-6 Installing a DIMM 2–22
FIGURE 2-7 Removing a DIMM 2–24
FIGURE 2-8 Opening the Door to Access Compact Flash 2–25
FIGURE 2-9 Compact Flash Location 2–26
FIGURE 2-10 Removing an AMC Filler Panel 2–28
FIGURE 2-11 Installing an AMC 2–29
FIGURE 2-12 Jumper 2 in the Default Run Position 2–31
FIGURE 2-13 SW1 Default DIP Switch Settings 2–33
FIGURE 2-14 SW4 Default DIP Switch Settings 2–33
FIGURE 2-15 SW5 Default DIP Switch Settings 2–34

xSun Netra CP3250 Blade Server User’s Guide • April 2009
FIGURE 2-16 Netra CP3250 Blade Server Front Panel 2–35
FIGURE A-1 BIOS Main Menu A–2
FIGURE A-2 Advanced Configuration Menu A–3
FIGURE A-3 CPU Configuration Menu A–4
FIGURE A-4 IDE Configuration Menu A–5
FIGURE A-5 USB Configuration Menu A–6
FIGURE A-6 Event Log Control Menu A–7
FIGURE A-7 IPMI 2.0 Configuration Menu A–8
FIGURE A-8 Remote Access Configuration Menu A–9
FIGURE A-9 PCI Option ROM Configuration Menu A–10
FIGURE A-10 Trusted Computing Menu A–11
FIGURE A-11 Boot Settings Menu A–12
FIGURE A-12 Boot Device Priority Configuration Menu A–13
FIGURE A-13 Security Settings Menu A–14
FIGURE A-14 Exit Menu A–15
FIGURE B-1 Ethernet RJ-45 Connector B–3
FIGURE B-2 Front Panel USB Connector B–4
FIGURE B-3 Front Panel Serial RJ-45 Connector B–5
FIGURE B-4 Power Distribution Connector (Zone 1) P10 B–6
FIGURE B-5 Zone 2 Connector B–8
FIGURE B-6 Zone 3 Connector B–10

xi
Tables
TABLE 1-1 I/O Configurations 1–10
TABLE 1-2 FRU ID Areas 1–15
TABLE 2-1 Local Area Network Information 2–5
TABLE 2-2 Netinstall Boot Device Table 2–15
TABLE 2-3 Extra MAC Addresses for Virtual LAN Configuration 2–16
TABLE 2-4 Pin Functions on Jumper 2 2–31
TABLE 5-1 BIOS Setup Screens Summary 5–3
TABLE 5-2 POST Options 5–9
TABLE B-1 Ethernet Port Connector Pin Assignments B–3
TABLE B-2 USB Port Pin Assignments B–4
TABLE B-3 Serial Port Mini DIN 8-pin Connector Pinouts B–5
TABLE B-4 Power Distribution Connector Pin Assignments B–6
TABLE B-5 Zone 2 Connector Pin Assignments B–8
TABLE B-6 J30 Pin Connector Assignments B–10
TABLE B-7 J31 Connector Pin Assignments B–11
TABLE B-8 J32 Connector Pin Assignments B–12
TABLE B-9 J33 Connector Pin Assignments B–13
TABLE B-10 Zone 3 Signal Descriptions B–14
TABLE C-1 Shelf Manager CLI Command Summary C–3

xii Sun Netra CP3250 Blade Server User’s Guide • April 2009

xiii
Preface
The Sun Netra CP3250 Blade Server User’s Guide describes the hardware specifications,
function, and physical properties of the Sun Netra™ CP3250 blade server. It also
provides detailed information on the system firmware.
The Sun Netra CP3250 Blade Server User’s Guide is written for system integration
engineers, field applications and service engineers, and others involved in the
integration of this blade server into systems. This guide is written for personnel who
are familiar with the Solaris™ Operating System, the Linux operating systems and
Advanced Telecommunications Computing Architecture (ATCA) computing
environment.
How This Document Is Organized
Chapter 1 provides an overview of the Sun Netra CP3250 blade server.
Chapter 2 provides instructions on hardware installation.
Chapter 3 provides information on hardware architecture.
Chapter 4 provides information on the supported operating systems and on the Sun
Validation Test Suite (SunVTS™) software.
Chapter 5 provides information on the BIOS (Basic Input Output System).
Appendix A provides first-level and second-level BIOS menu illustrations.
Appendix B provides information on the Sun Netra CP3250 blade server physical
characteristics.
Appendix C provides a list of the most commonly used ShMM commands.

xiv Sun Netra CP3250 Blade Server User’s Guide • April 2009
Using UNIX Commands
This document might not contain information about basic UNIX®commands and
procedures such as shutting down the system, booting the system, and configuring
devices. Refer to the following for this information:
■Software documentation that you received with your system
■Solaris™ Operating System documentation, which is at:
http://docs.sun.com/app/docs/prod/solaris
Shell Prompts
Shell Prompt
C shell machine-name%
C shell superuser machine-name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #

Preface xv
Typographic Conventions
Related Documentation
For additional information about the Sun Netra CP3250 blade server or the Netra
CP32x0 advanced rear transition module (ARTM), refer to the following documents
The following table lists the documentation for this product. The online
documentation is available at:
http://docs.sun.com/app/docs/prod/cp3250.brd#hic
Typeface*
* The settings on your browser might differ from these settings.
Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your.login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when contrasted
with on-screen computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized.
Replace command-line variables
with real names or values.
Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
To delete a file, type rm filename.
Application Title Part Number Format Location
Installation
and Service
Sun Netra CP3250 Blade Server
User’s Guide (this manual)
820-5195 PDF,
HTML
Online
Pointer
Doclette
Netra CP3250 Blade Server Getting
Started Guide
820-5197 Printed,
PDF,
HTML
Shipkit

xvi Sun Netra CP3250 Blade Server User’s Guide • April 2009
The following table lists the documentation that is related to this product.
.
Documentation, Support, and Training
Late-breaking
Information
Netra CP3250 Blade Server Product
Notes
820-5194 PDF,
HTML
Online
Safety
Information
Netra CP3250 Blade Server Safety
and Compliance Guide
820-5198 PDF,
HTML
Online
Safety
Information
Important Safety Information for
Sun Hardware Systems
816-7190 Printed Shipkit
Application Title Part Number Format Location
Installation and
Configuration
Sun Netra CP32x0 SAS Storage
Advanced Rear Transition Module,
Dual HD User’s Guide
820-3147 PDF,
HTML
Online
http://docs.sun.com/app/docs/prod/cp32x0.sas#hic
Installation and
Configuration
Sun Netra™ CP32x0 Quad GbE,
Dual Fibre Channel, Advanced Rear
Transition Module, User’s Guide
820-3148 PDF,
HTML
Online
http://docs.sun.com/app/docs/prod/cp32x0.4gbefc?l=en#hic
Installation and
Configuration
Sun Netra™ CP32x0 10GbE
Advanced Rear Transition Module,
Dual Port User’s Guide
820-3150 PDF,
HTML
Online
http://docs.sun.com/app/docs/prod/cp32x0.10gbee?l=en#hic
Sun Function URL
Documentation http://docs.sun.com/
Support http://www.sun.com/support/
Training http://www.sun.com/training/
Application Title Part Number Format Location

Preface xvii
Third-Party Web Sites
Sun is not responsible for the availability of third-party web sites mentioned in this
document. Sun does not endorse and is not responsible or liable for any content,
advertising, products, or other materials that are available on or through such sites
or resources. Sun will not be responsible or liable for any actual or alleged damage
or loss caused by or in connection with the use of or reliance on any such content,
goods, or services that are available on or through such sites or resources.
Sun Welcomes Your Comments
Sun is interested in improving its documentation and welcomes your comments and
suggestions. You can submit your comments by going to:
http://www.sun.com/hwdocs/feedback
Please include the title and part number of your document with your feedback:
Sun Netra CP3250 Blade Server User’s Guide, part number 820-5195.

xviii Sun Netra CP3250 Blade Server User’s Guide • April 2009

1-1
CHAPTER 1
Overview
This chapter provides an overview of the features, configurations, and system
requirements of the Sun Netra CP3250 blade server.
This chapter contains the following sections:
■Section 1.1, “Overview” on page 1-2
■Section 1.2, “Features” on page 1-2
■Section 1.3, “Physical Description” on page 1-4
■Section 1.4, “System Configurations” on page 1-7
■Section 1.5, “Hot-Swap Support” on page 1-11
■Section 1.6, “System Components” on page 1-11
■Section 1.7, “Technical Support and Warranty” on page 1-13

1-2 Sun Netra CP3250 Blade Server User’s Guide • April 2009
1.1 Overview
The Sun Netra CP3250 blade server is a dual-socket quad-core Intel-based ATCA
blade for high performance ATCA x86 applications in wireless infrastructure and
central office consolidation.
This blade server complies with the AdvancedTCA specification and is a new
addition to SUN's ATCA product family.
The ATCA standard comprises the PICMG 3.0, 3.1, 3.2, and 3.3 versions of the
standard. The Sun Netra CP3250 blade server complies with the following
specifications:
■PICMG 3.0, the base specification that defines the mechanical, power distribution,
system management, data transport, and regulatory guidelines.
■PICMG 3.1, which builds on the PICMG 3.0 base specification and on IEEE
802.3-2003.
1.2 Features
The blade server’s primary features are as follows:
■ATCA card 322.25 mm x280 mm, 1.2 inch slot height
■Two Harpertown Processor Sockets, QuadCore version @2.135 GHz and up to
40W per CPU
■Intel San Clemente North Bridge and Intel ICH9R I/O controller hub
■DDR2 (registered, with ECC) at 667 MHz, up to six modules/cards, up to 4 GB
per DIMM, in very-low-profile design (0.72 inch height)
■Two 1000MBASE-T Ethernet base fabric (PICMG 3.0) interface ports (using
BCM5715C) from PCIe x4
■Two 10 Gb XAUI Ethernet extended fabric (PICMG 3.1) interface ports (using Sun
Neptune) from PCIe x8
■One AMC.1 Type 8S2E2 expansion slot (PCIe x8) supporting I/O expansion with
signaling to the advanced rear transition module (ARTM)
■One Asynchronous serial port routed to front panel and ARTM from SuperIO