Sun Microsystems Fire 6800 Instruction Manual

Sun Microsystems, Inc.
901 San Antonio Road
Palo Alto, CA 94303 U.S.A.
650-960-1300
Send comments about this document to: [email protected]
Sun Fire™6800/4810/4800/3800
Systems Platform
Administration Manual
Part No. 816-2970-10
May 2002, Revision A

Please
Recycle
Copyright 2002 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, CA 95054 U.S.A. All rights reserved.
This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation.
No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors,
if any. Third-party software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in
the U.S. and other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, docs.sun.com, Sun Fire, OpenBoot, Sun StorEdge, and Solaris are trademarks, registered trademarks, or
service marks of Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or
registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an
architecture developed by Sun Microsystems, Inc.
Federal Acquisitions Commercial Software-Government Users Subject to Standard License Terms and Conditions.
DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-
INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright 2002 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, CA 95054 Etats-Unis. Tous droits réservés.
Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la
décompilation. Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans
l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a. Le logiciel détenu par des tiers, et qui comprend la technologie
relative aux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun.
Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque
déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, docs.sun.com, Sun Fire, OpenBoot, Sun StorEdge, et Solaris sont des marques de fabrique ou des marques
déposées, ou marques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutes les marques SPARC sont utilisées sous
licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc. aux Etats-Unis et dans d’autres pays. Les
produits portant les marques SPARC sont basés sur une architecture développée par Sun Microsystems, Inc.
L’interface d’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun
reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelle ou graphique
pour l’industrie de l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence
couvrant également les licenciés de Sun qui mettent en place l’interface d’utilisation graphique OPEN LOOK et qui en outre se conforment aux
licences écrites de Sun.
LA DOCUMENTATION EST FOURNIE “EN L’ETAT” ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES
EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS
NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION
PARTICULIERE OU A L’ABSENCE DE CONTREFAÇON.

i
Contents
Preface xv
1. Introduction 1
Domains 2
System Components 3
Partitions 3
System Controller 8
Serial and Ethernet Ports 9
System Controller Logical Connection Limits 9
System Controller Software 10
Redundant Components and Minimum Configurations 13
Redundant System Controller Boards 13
CPU/Memory Boards 14
I/O Assemblies 15
Redundant Cooling 16
Redundant Power 17
Repeater Boards 18
Redundant System Clocks 19
Reliability, Availability, and Serviceability (RAS) 20

ii Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
Reliability 20
Availability 22
Serviceability 23
Dynamic Reconfiguration Software 24
Sun Management Center Software for the Sun Fire 6800/4810/4800/3800 Systems
Software 25
FrameManager 25
2. System Controller Navigation Procedures 27
Connection to the System Controller 28
Obtaining the Platform Shell 28
▼To Obtain the Platform Shell Using telnet 28
Obtaining a Domain Shell or Console 30
System Controller Navigation 32
▼To Enter the Domain Console From the Domain Shell If the Domain Is
Inactive 35
▼To Enter the Domain Shell From the Domain Console 36
▼To Get Back to the Domain Console From the Domain Shell 36
▼To Enter a Domain From the Platform Shell 37
Terminating Sessions 37
▼To Terminate an Ethernet Connection With telnet 37
▼To Terminate a Serial Connection With tip 38
3. System Power On and Setup 41
Installing, Cabling, and Powering on the Hardware 43
Setting Up Additional Services Before System Power On 43
Powering On the Hardware 45
Powering On the Power Grids 45
Setting Up the Platform 46
▼To Set the Date and Time for the Platform 46

Contents iii
▼To Set a Password for the Platform 47
▼To Configure Platform Parameters 47
Setting Up Domain A 48
▼To Access the Domain 48
▼To Set the Date and Time for Domain A 48
▼To Set a Password for Domain A 48
▼To Configure Domain-Specific Parameters 49
Saving the Current Configuration to a Server 50
▼To Use dumpconfig to Save Platform and Domain Configurations 50
Installing and Booting the Solaris Operating Environment 51
▼To Install and Boot the Solaris Operating Environment 51
4. Creating and Starting Multiple Domains 53
Creating and Starting Domains 53
Before Creating Multiple Domains 53
▼To Create A Second Domain 55
Special Considerations When Creating a Third Domain on the Sun Fire 6800
System 56
▼To Start the Domain 57
5. Security 59
Security Threats 59
System Controller Security 60
setupplatform and setupdomain Parameter Settings 61
Changing Passwords for the Platform and the Domain 61
Domains 62
Domain Separation 62
setkeyswitch Command 64
Solaris Operating Environment Security 64

iv Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
SNMP 64
6. Maintenance 65
Powering Off and On the System 65
Powering Off the System 65
▼To Power Off the System 66
▼To Power On the System 68
Keyswitch Positions 69
▼To Power On a Domain 70
Shutting Down Domains 70
▼To Shut Down a Domain 70
Assigning and Unassigning Boards 71
▼To Assign a Board to a Domain 72
▼To Unassign a Board From a Domain 74
Upgrading the Firmware 75
Saving and Restoring Configurations 76
Using dumpconfig 76
Using restoreconfig 76
7. System Controller Failover 77
How SC Failover Works 77
What Triggers an Automatic Failover 78
What Happens During a Failover 78
SC Failover Prerequisites 80
Conditions That Affect Your SC Failover Configuration 81
How to Manage SC Failover 81
▼To Disable SC Failover 82
▼To Enable SC Failover 82
▼To Perform a Manual SC Failover 82

Contents v
▼To Obtain Failover Status Information 83
How to Recover After an SC Failover 84
8. Testing System Boards 85
Testing a CPU/Memory Board 85
Requirements 85
▼To Test a CPU/Memory Board 86
Testing an I/O Assembly 86
▼To Test an I/O Assembly 87
9. Removing and Replacing Boards 91
CPU/Memory Boards and I/O Assemblies 92
▼To Remove and Replace a System Board 92
▼To Unassign a Board From a Domain or Disable a System Board 95
▼To Hot-Swap a CPU/Memory Board 95
▼To Hot-Swap an I/O Assembly 96
CompactPCI and PCI Cards 98
▼To Remove and Replace a PCI Card 98
▼To Remove and Replace a CompactPCI Card 99
Repeater Board 99
▼To Remove and Replace a Repeater Board 99
System Controller Board 101
▼To Remove and Replace the System Controller Board in a Single SC
Configuration 101
▼To Remove and Replace a System Controller Board in a Redundant SC
Configuration 103
ID Board and Centerplane 104
▼To Remove and Replace ID Board and Centerplane 104
10. Troubleshooting 107

vi Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
System Faults 107
Displaying Diagnostic Information 107
Displaying System Configuration Information 108
Assisting Sun Service Personnel 108
▼To Determine the Cause of Your Failure 108
Domain Not Responding 109
Hung Domain 109
▼To Recover a Hard Hung or Paused Domain 110
Board and Component Failures 112
CPU/Memory Board Failure 112
I/O Assembly Failure 113
System Controller Board Failure 113
Collecting Platform and Domain Status Information 114
Repeater Board Failure 117
Power Supply Failure 121
Fan Tray Failure 121
FrameManager Failure 121
Disabling Components 122
A. Mapping Device Path Names 125
Device Mapping 125
CPU/Memory Mapping 125
I/O Assembly Mapping 127
B. Setting Up an http or ftp Server 139
Setting Up the Firmware Server 139
▼To Set Up an http Server 140
▼To Set Up an ftp Server 142

Contents vii
Glossary 145
Index 147

viii Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002

ix
Figures
FIGURE 1-1 Sun Fire 6800 System in Single-Partition Mode 5
FIGURE 1-2 Sun Fire 6800 System in Dual-Partition Mode 5
FIGURE 1-3 Sun Fire 4810/4800 Systems in Single-Partition Mode 6
FIGURE 1-4 Sun Fire 4810/4800 Systems in Dual-Partition Mode 6
FIGURE 1-5 Sun Fire 3800 System in Single-Partition Mode 7
FIGURE 1-6 Sun Fire 3800 System in Dual-Partition Mode 7
FIGURE 2-1 Navigating Between the Platform Shell and the Domain Shell 33
FIGURE 2-2 Navigating Between the Domain Shell, the OpenBoot PROM, and the Solaris Operating
Environment 34
FIGURE 2-3 Navigating Between the OpenBoot PROM and the Domain Shell 35
FIGURE 3-1 Flowchart of Power On and System Setup Steps 42
FIGURE 5-1 System With Domain Separation 63
FIGURE 10-1 Resetting the System Controller 114
FIGURE A-1 Sun Fire 6800 System PCI Physical Slot Designations for IB6 Through IB9 131
FIGURE A-2 Sun Fire 4810/4800 Systems PCI Physical Slot Designations for IB6 and IB8 132
FIGURE A-3 Sun Fire 3800 System 6-Slot CompactPCI Physical Slot Designations 135
FIGURE A-4 Sun Fire 4810/4800 Systems 4-Slot CompactPCI Physical Slot Designations 137
FIGURE A-5 Sun Fire 6800 System 4-Slot CompactPCI Physical Slot Designations for IB6 through
IB9 138

xSun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002

xi
Tables
TABLE 1-1 Repeater Boards in the Sun Fire 6800/4810/4800/3800 Systems 3
TABLE 1-2 Maximum Number of Partitions and Domains Per System 4
TABLE 1-3 Board Name Descriptions 4
TABLE 1-4 Functions of System Controller Boards 8
TABLE 1-5 Serial Port and Ethernet Port Features on the System Controller Board 9
TABLE 1-6 Maximum Number of CPU/Memory Boards in Each System 14
TABLE 1-7 Maximum Number of I/O Assemblies and I/O Slots per I/O Assembly 15
TABLE 1-8 Configuring for I/O Redundancy 15
TABLE 1-9 Minimum and Maximum Number of Fan Trays 16
TABLE 1-10 Minimum and Redundant Power Supply Requirements 17
TABLE 1-11 Sun Fire 6800 System Components in Each Power Grid 18
TABLE 1-12 Repeater Board Assignments by Domains in the Sun Fire 6800 System 18
TABLE 1-13 Repeater Board Assignments by Domains in the Sun Fire 4810/4800/3800 Systems 19
TABLE 1-14 Sun Fire 6800 Domain and Repeater Board Configurations for Single- and Dual-Partitioned
Systems 19
TABLE 1-15 Sun Fire 4810/4800/3800 Domain and Repeater Board Configurations for Single- and Dual-
Partitioned Systems 19
TABLE 1-16 Results of setkeyswitch Settings During a Power Failure 23
TABLE 3-1 Services That Should Be Set Up Before System Power On 43
TABLE 3-2 Steps in Setting up Domains Including the dumpconfig Command 49
TABLE 4-1 Guidelines for Creating Three Domains on the Sun Fire 6800 System 57

xii Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
TABLE 6-1 Displaying the Status of All Domains With the showplatform -p status Command 66
TABLE 6-2 Overview of Steps to Assign a Board To a Domain 71
TABLE 6-3 Overview of Steps to Unassign a Board From a Domain 71
TABLE 9-1 Repeater Boards and Domains 99
TABLE 10-1 OpenBoot PROM error-reset-recovery Configuration Variable Settings 111
TABLE 10-2 Solaris Operating Environment and System Controller Software Commands for Collecting
Status Information 115
TABLE 10-3 Repeater Board Failure 117
TABLE 10-4 Blacklisting Component Names 122
TABLE A-1 CPU and Memory Agent ID Assignment 126
TABLE A-2 I/O Assembly Type and Number of Slots per I/O Assembly by System Type 127
TABLE A-3 Number and Name of I/O Assemblies per System 127
TABLE A-4 I/O Controller Agent ID Assignments 128
TABLE A-5 8-Slot PCI I/O Assembly Device Map for the Sun Fire 6800/4810/4810 Systems 129
TABLE A-6 Mapping Device Path to I/O Assembly Slot Numbers for Sun Fire 3800 Systems 134
TABLE A-7 Mapping Device Path to I/O Assembly Slot Numbers for Sun Fire 6800/4810/4800
Systems 135

xiii
Code Samples
CODE EXAMPLE 2-1 Obtaining the Platform Shell With telnet 29
CODE EXAMPLE 2-2 Obtaining a Domain Shell With telnet 31
CODE EXAMPLE 2-3 Obtaining a Domain Shell From the Domain Console 32
CODE EXAMPLE 2-4 Obtaining a Domain Shell From the Domain Console 32
CODE EXAMPLE 2-5 Obtaining a Domain Shell From the Domain Console 36
CODE EXAMPLE 2-6 Ending a tip Session 39
CODE EXAMPLE 3-1 password Command Example For a Domain With No Password Set 49
CODE EXAMPLE 3-2 Sample Boot Error Message When the auto-boot? Parameter Is Set To true 51
CODE EXAMPLE 6-1 showboards -a Example Before Assigning a Board to a Domain 72
CODE EXAMPLE 7-1 Messages Displayed During an Automatic Failover 78
CODE EXAMPLE 9-1 Confirming Board ID Information 105
CODE EXAMPLE 9-2 ID Information To Enter Manually 105
CODE EXAMPLE B-1 Locating the Port 80 Value in httpd.conf 140
CODE EXAMPLE B-2 Locating the ServerAdmin Value in httpd.conf 141
CODE EXAMPLE B-3 Locating the ServerName Value in httpd.conf 141
CODE EXAMPLE B-4 Starting Apache 141

xiv Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002

xv
Preface
This book provides an overview of the system and presents a step-by-step
description of common administration procedures. It explains how to configure and
manage the platform and domains. It also explains how to remove and replace
components and perform firmware upgrades. It contains information about security,
troubleshooting, and a glossary of technical terms.
How This Book Is Organized
Chapter 1 describes domains and the system controller. It provides an overview of
partitions and domains, redundant system components, and minimum system
configurations. This chapter also provides an overview of reliability, serviceability,
and availability.
Chapter 2 explains how to navigate between the platform and domain shells,
between the Solarisoperating environment and the domain shell, or between the
OpenBootPROM and the domain shell. This chapter also explains how to
terminate a system controller session.
Chapter 3 explains how to power on and set up the system for the first time.
Chapter 4 explains how to create and start multiple domains.
Chapter 5 presents information on security.
Chapter 6 explains how to power on and power off the system. It also explains how
to update firmware.
Chapter 7 describes how system controller failover works.
Chapter 8 describes how to test boards.

xvi Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
Chapter 9 describes the software steps necessary to remove and install a
CPU/Memory board, I/O assembly, Compact PCI card, PCI card, Repeater board,
System Controller board, and ID board/centerplane.
Chapter 10 provides troubleshooting information about LEDs, system faults, the
system controller loghost, and procedures such as displaying diagnostic information,
displaying system configuration information, recovering from a hung domain,
disabling components (blacklisting), and mapping device path names to physical
system devices.
Appendix A describes how to map device path names to physical system devices.
Appendix B describes how to set up an HTTP and FTP server.
Using UNIX Commands
This book assumes you are experienced with the UNIX®operating environment. If
you are not experienced with the UNIX operating environment, see one or more of
the following for this information:
■Documentation for the Solaris operating environment, available on
docs.sun.com (see “Accessing Sun Documentation Online” on page xviii)
■Sun Hardware Platform Guide, which is available in both hard copy and online with
your operating system release, describes Solaris operating environment
information specific to the Sun Fire 6800/4810/4800/3800 systems.
■Release Notes Supplement for Sun Hardware describes late breaking information
about the Solaris operating environment.
■Other software documentation that you received with your system

Preface xvii
Typographic Conventions
Shell Prompts
Typeface Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your .login file.
Use ls -a to list all files.
AaBbCc123 What you type, when
contrasted with on-screen
computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized
Command-line variable; replace
with a real name or value
Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
To delete a file, type rm filename.
Shell Prompt
C shell machine_name%
C shell superuser machine_name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
Platform shell schostname:SC>
Platform console schostname:SC>
Domain shell schostname:A> or B>,C>,D>
Domain console ok, login:,machine_name%, or
machine_name#

xviii Sun Fire 6800/4810/4800/3800 Systems Platform Administration Manual • May 2002
Related Documentation
Accessing Sun Documentation Online
A broad selection of Sun system documentation is located at:
http://www.sun.com/products-n-solutions/hardware/docs
A complete set of Solaris documentation and many other titles are located at:
http://docs.sun.com
Type of Book Title Part Number
Overview Sun Fire 6800/4810/4800/3800 Systems
Overview Manual 805-7362
Service Sun Fire 6800/4810/4800/3800 Systems Service
Manual 805-7363
Service Sun Fire 4810/4800/3800 System Cabinet
Mounting Guide 806-6781
System Controller Sun Fire 6800/4810/4800/3800 System
Controller Command Reference Manual 816-2971
Release Notes Sun Fire 6800/4810/4800/3800 Systems
Software Release Notes 816-2972
Solaris operating
environment Sun Hardware Platform Guide Varies with
release.
Solaris operating
environment Release Notes Supplement for Sun Hardware Varies with
release.