Sun Microsystems StorEdge T3+ Manual

Sun Microsystems, Inc.
4150 Network Circle
Santa Clara, CA 95054 U.S.A.
650-960-1300
Send comments about this document to: [email protected]
Sun StorEdge™T3+ Array
Installation and Configuration
Manual
Version 2.1 Controller Firmware
Part No. 816-4769-10
April 2002, Revision A

Please
Recycle
Copyright 2002 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, CA 95054 U.S.A. All rights reserved.
This product or document is distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this product or
document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Third-party
software, including font technology, is copyrighted and licensed from Sun suppliers.
Parts of the product may be derived from Berkeley BSD systems, licensed from the University of California. UNIX is a registered trademark in
the U.S. and other countries, exclusively licensed through X/Open Company, Ltd.
Sun, Sun Microsystems, the Sun logo, AnswerBook2, docs.sun.com, SunSolve, JumpStart, StorTools, Solstice Backup, SunService, OpenBoot,
Sun Enterprise, Sun Fire, Sun VTS, Solstice DiskSuite, Sun StorEdge, and Solaris are trademarks, registered trademarks, or service marks of Sun
Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks
of SPARC International, Inc.in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by
Sun Microsystems, Inc.
The OPEN LOOK and Sun™ Graphical User Interface was developed by Sun Microsystems, Inc. for its users and licensees. Sun acknowledges
the pioneering efforts of Xerox in researching and developing the concept of visual or graphical user interfaces for the computer industry. Sun
holds a nonexclusive license from Xerox to the Xerox Graphical User Interface, which license also covers Sun’s licensees who implement OPEN
LOOK GUIs and otherwise comply with Sun’s written license agreements.
Federal Acquisitions: Commercial Software—Government Users Subject to Standard License Terms and Conditions.
DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES,
INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT,
ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright 2002 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, CA 95054 Etats-Unis. Tous droits réservés.
Ce produit ou document est distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la décompilation. Aucune
partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans l’autorisation préalable et
écrite de Sun et de ses bailleurs de licence, s’il y en a. Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de
caractères, est protégé par un copyright et licencié par des fournisseurs de Sun.
Des parties de ce produit pourront être dérivées des systèmes Berkeley BSD licenciés par l’Université de Californie. UNIX est une marque
déposée aux Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd.
Sun, Sun Microsystems, le logo Sun, AnswerBook2, docs.sun.com, SunSolve, JumpStart, StorTools, Solstice Backup, SunService, OpenBoot, Sun
Enterprise, Sun Fire, Sun VTS, Solstice DiskSuite, Sun StorEdge, et Solaris sont des marques de fabrique ou des marques déposées, ou marques
de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutes les marques SPARC sont utilisées sous licence et sont des
marques de fabrique ou des marques déposées de SPARC International, Inc. aux Etats-Unis et dans d’autres pays. Les produits portant les
marques SPARC sont basés sur une architecture développée par Sun Microsystems, Inc.
L’interface d’utilisation graphique OPEN LOOK et Sun™ a été développée par Sun Microsystems, Inc. pour ses utilisateurs et licenciés. Sun
reconnaît les efforts de pionniers de Xerox pour la recherche et le développement du concept des interfaces d’utilisation visuelle ou graphique
pour l’industrie de l’informatique. Sun détient une licence non exclusive de Xerox sur l’interface d’utilisation graphique Xerox, cette licence
couvrant également les licenciés de Sun qui mettent en place l’interface d’utilisation graphique OPEN LOOK et qui en outre se conforment aux
licences écrites de Sun.
LA DOCUMENTATION EST FOURNIE “EN L’ETAT” ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES
OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT
TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A
L’ABSENCE DE CONTREFAÇON.

iii
Contents
Preface xvii
1. Overview of the Sun StorEdge
T3+ Array 1
Product Description 2
Array Components 4
Disk Drive 4
Array Controller Card 5
Unit Interconnect Cards (UIC) 7
Power and Cooling Unit 9
Array Features 9
Firmware Version 2.1 New Features List 11
Array Architecture 11
2. Supported Configurations 13
Workgroup 14
Enterprise 16
Configuration Guidelines and Restrictions 17
Workgroup Configuration Restrictions 17
Enterprise Configuration Restrictions 17
Configuration Recommendations 18

iv Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
Sun Cluster Support 19
3. Supported Software 21
Supported Operational Environment 22
Supported Multiple Operational Environments 22
Supported Multi-Pathing Software 22
Supported Clustering Software 22
Supported Host Side Drivers 23
Supported SAN Switch Support 23
Supported Diagnostics and Monitoring Software 23
Administrative Tools 23
End-User Tools 24
Supported Interfaces 24
Supported Import Interfaces 24
Supported Bootability 25
Supported Multi-Platform Software 25
Supported Multi-Host Environments 25
Summary of Supported Software 26
4. Configuration Scenarios 27
Direct Host Connection 28
Single Host With One Controller Unit 28
Single Host With Two Controller Units Configured as a Partner Group 29
Host Multi-Pathing Management Software 30
Single Host With Four Controller Units Configured as Two Partner
Groups 31
Single Host With Eight Controller Units Configured as Four Partner
Groups 33
Hub Host Connection 35

Contents v
Single Host With Two Hubs and Four Controller Units Configured as Two
Partner Groups 35
Single Host With Two Hubs and Eight Controller Units Configured as Four
Partner Groups 38
Dual Hosts With Two Hubs and Four Controller Units 40
Dual Hosts With Two Hubs and Eight Controller Units 42
Dual Hosts With Two Hubs and Four Controller Units Configured as Two
Partner Groups 44
Dual Hosts With Two Hubs and Eight Controller Units Configured as Four
Partner Groups 46
Switch Host Connection 48
Dual Hosts With Two Switches and Two Controller Units 48
Dual Hosts With Two Switches and Eight Controller Units 50
5. Preparing to Install 53
Preparing for the Installation 54
▼To Inspect the Array 55
▼To Edit the Host Files 57
▼To Install Required Patches 59
Installation Checklist 61
6. Array Installation 63
▼To Install the Array 64
▼To Connect the Cables 65
▼To Power On and Verify the Hardware Configuration 70
▼To Establish a Network Connection 72
▼To Verify the Firmware Level and Configuration 75
Installing the Administration Tools 81
Defining and Mounting Volumes 81
▼To Configure the Workgroup 83
▼To Configure the Enterprise 85

vi Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
Changing the Default Configuration 88
Connecting the Host System 89
Verifying the Data Host Connection 89
Establishing Logical Volumes on the Host 90
Creating Soft Partitions on the Data Host 90
▼To Establish Alternate Pathing on the Host 91
Powering Off and On 94
▼To Power Off 94
▼To Power On 95
7. Controller Firmware Version 2.1 Upgrade 97
Upgrading Overview 98
Upgrading Requirements 98
Upgrading Limitations 99
Connecting to the Array 100
▼To Establish an ftp Session 100
▼To Establish a Telnet Session 101
▼To Determine the Firmware Version 103
Upgrading the System Firmware 104
▼To Install the System Firmware 2.1 Patch 104
▼To Install the Interconnect Card Firmware 107
▼To Upgrade the Controller Firmware 109
▼To Verify the Upgrade 111
8. Post-Installation Global Parameters Configurations 115
Configuring Cache 116
Performance and Redundancy 116
Data Block Size Configuration 117
Data Block Size Selection 117

Contents vii
Mirrored Cache Enabling 118
Cache Allocation Configuration 118
Configuring Logical Volumes 119
Guidelines for Configuring Logical Volumes 119
Determining the Number of Logical Volumes 120
Determining the RAID Level 120
Determining a Hot-Spare 121
Creating and Labeling a Logical Volume 122
Setting the LUN Reconstruction Rate 122
Using RAID Levels to Configure Redundancy 123
RAID 0 124
RAID 1 124
RAID 5 125
Configuring RAID Levels 125
9. Post-Installation Array Settings Configuration 127
Reconfiguring the Array Settings 128
Unit Volume Configurations 128
RAID Levels 129
Cache Modes 129
Disabling and Reconstructing a Drive 131
Monitoring the Array 132
StorEdge Component Manager 132
SNMP Notification 132
syslog Error Reports 133
10. Post-Installation Partner Groups Configuration 135
Understanding Partner Groups 136
How Partner Groups Work 137

viii Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
Creating Partner Groups 138
11. Post-Installation Host Connections 139
Sun Enterprise SBus+ and Graphics+
I/O Boards 140
System Requirements 140
Sun StorEdge PCI FC-100 Host Bus Adapter 141
System Requirements 141
Sun StorEdge SBus FC-100 Host Bus Adapter 142
System Requirements 142
Sun StorEdge PCI Single Fibre Channel Network Adapter 143
System Requirements 143
Sun StorEdge PCI Dual Fibre Channel Network Adapter 144
System Requirements 144
Compact PCISun StorEdge CompactPCI Dual Fibre Channel Network
Adapter 145
System Requirements 145
12. Post-Installation Array Cabling 147
Overview of Array Cabling 148
Data Path 148
Administration Path 148
Connecting Arrays 148
Workgroup Configurations 150
Enterprise Configurations 151
13. Troubleshooting the Array 153
ofdg Notice 154
Analyzing the Problem 155
Host-Generated Message 155
Sun StorEdge Component Manager 155

Contents ix
Telnet Session 156
Array LEDs 156
Disk Drive LEDs 156
Power and Cooling Unit LEDs 157
Interconnect Card LEDs 159
Controller Card LEDs 160
Channel Connection Failures 162
FRU Failures 162
14. Servicing the Array 163
ofdg Notice 164
Preparing for Service 165
Removing and Replacing Components 165
Disk Drives 166
Disk Drive LEDs 166
▼To Remove and Replace a Disk Drive 167
Power and Cooling Units 170
Power and Cooling Unit LEDs 171
▼To Remove and Replace a Power and Cooling Unit 171
UPS Battery 173
Battery Maintenance 173
Removing and Replacing the UPS Battery 174
Interconnect Cards 174
Interconnect Card LEDs 174
▼To Removing and Replacing an Interconnect Card 175
Controller Card 177
Controller Card LEDs 177
▼To Remove and Replace a Controller Card 177
Chassis 179

xSun StorEdge T3+ Array Installation and Configuration Manual • April 2002
A. Specifications 181
Power Specifications 182
Environmental Specifications 183
Mechanical Specifications 184
Cable Specifications 185
B. Illustrated Parts 187
Glossary 193

xi
Figures
FIGURE 1-1 Sun StorEdge T3+ Array 3
FIGURE 1-2 Disk Drives (Front View) 4
FIGURE 1-3 Controller Card (Rear View) 5
FIGURE 1-4 Sun StorEdge T3+ Array Controller Card Front Panel 5
FIGURE 1-5 Sun StorEdge T3+ array Controller Card and Ports 6
FIGURE 1-6 Interconnect Card and Ports 7
FIGURE 1-7 Interconnect Cards (Rear View) 8
FIGURE 1-8 Power and Cooling Units (Rear View) 9
FIGURE 2-1 Workgroup Configuration 14
FIGURE 2-2 Enterprise Configuration 15
FIGURE 4-1 Single Host Connected to One Controller Unit 28
FIGURE 4-2 Single Host With Two Controller Units Configured as a Partner Group 29
FIGURE 4-3 Failover Configuration 30
FIGURE 4-4 Single Host With Four Controller Units Configured as Two Partner Groups 32
FIGURE 4-5 Single Host With Eight Controller Units Configured as Four Partner Groups 34
FIGURE 4-6 Single Host With Two Hubs and Four Controller Units Configured as Two Partner Groups 37
FIGURE 4-7 Single Host With Two Hubs Configured and Eight Controller Units as Four Partner
Groups 39
FIGURE 4-8 Dual Hosts With Two Hubs and Four Controller Units 41
FIGURE 4-9 Dual Hosts With Two Hubs and Eight Controller Units 43
FIGURE 4-10 Dual Hosts With Two Hubs and Four Controller Units Configured as Two Partner Groups 45

xii Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
FIGURE 4-11 Dual Hosts With Two Hubs and Eight Controller Units Configured as Four Partner
Groups 47
FIGURE 4-12 Dual Hosts With Two Switches and Two Controller Units 49
FIGURE 4-13 Dual Hosts With Two Switches and Eight Controller Units 51
FIGURE 5-1 Sun StorEdge T3+ Array Cables 55
FIGURE 5-2 Removing the Front Panel 56
FIGURE 5-3 Serial Number and MAC Address on Pull-out Tab 56
FIGURE 6-1 Sun StorEdge T3+ Array Cables 66
FIGURE 6-2 Connecting the Fiber-Optic Cable to the FC-AL Connector on a
Sun StorEdge T3+ Array 67
FIGURE 6-3 Connecting the Ethernet Cable 67
FIGURE 6-4 Connecting the Power Cords 68
FIGURE 6-5 Connecting the Interconnect Cables 69
FIGURE 6-6 Fully Cabled Partner Group (Enterprise Configuration) 70
FIGURE 6-7 Power and Cooling Unit LEDs and Power Button Location 71
FIGURE 6-8 Disk Drive Physical Numbering 82
FIGURE 6-9 Power Switch Locations 95
FIGURE 7-1 Level 3 Firmware Version Check Output for Master Unit 103
FIGURE 7-2 Level 3 Firmware Version Check Output for Master Unit 111
FIGURE 10-1 Sun StorEdge T3+ Array Partner Group 136
FIGURE 11-1 Sun Enterprise 6x00/5x00/4x00/3x00 SBus+ I/O Board 140
FIGURE 11-2 Sun StorEdge PCI FC-100 Host Bus Adapter 141
FIGURE 11-3 Sun StorEdge SBus FC-100 Host Bus Adapter 142
FIGURE 11-4 Sun StorEdge PCI Single Fibre Channel Network Adapter 143
FIGURE 11-5 Sun StorEdge PCI Dual Fibre Channel Network Adapter 144
FIGURE 11-6 Sun StorEdge CompactPCI Dual Fibre Channel Network Adapter 145
FIGURE 12-1 Sun StorEdge T3+ Array Controller Card and Interconnect Cards 149
FIGURE 12-2 Array Workgroup Configuration 150
FIGURE 12-3 Enterprise Configuration 151
FIGURE 13-1 Disk Drive LEDs (Viewed Through Front Cover) 157
FIGURE 13-2 Power and Cooling Unit LEDs 158

Figures xiii
FIGURE 13-3 Interconnect Card LEDs 160
FIGURE 13-4 Sun StorEdge T3+ Array Controller Card LEDs 161
FIGURE 14-1 Removing the Front Panel 167
FIGURE 14-2 Disk Drive Numbering 167
FIGURE 14-3 Releasing the Latch Handle 168
FIGURE 14-4 Removing a Disk Drive 169
FIGURE 14-5 Power Cords Connected to the Power and Cooling Units 170
FIGURE 14-6 Removing the Power and Cooling Unit 172
FIGURE 14-7 Removing the Interconnect Card 176
FIGURE 14-8 Removing the Controller Card 178
FIGURE B-1 Disk Drive in Canister 188
FIGURE B-2 Sun StorEdge T3+ Array Controller Card 189
FIGURE B-3 Interconnect Card 189
FIGURE B-4 Power and Cooling Unit 189
FIGURE B-5 Cables, Adapters, and Cords 190
FIGURE B-6 Door Assembly (Front Panel) 191

xiv Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002

xv
Tables
TABLE 1-1 Sun StorEdge T3+ Array Key Features—73-Gbyte Drive 10
TABLE 5-1 Required Patches 60
TABLE 6-1 Drive Status Messages 83
TABLE 7-1 Explanation of ver Command Results 103
TABLE 7-2 t3.sh Utility Installation Prompts 106
TABLE 7-3 Explanation of ver Command Results 111
TABLE 8-1 RAID 0 Data Blocks 124
TABLE 8-2 RAID 1 (1+0) Data Blocks 124
TABLE 8-3 RAID 5 Data Blocks 125
TABLE 9-1 Examples of Volume Configurations 129
TABLE 9-2 Cache Transition States 130
TABLE 9-3 syslog Error Reporting Levels 133
TABLE 13-1 Disk Drive LED Descriptions 157
TABLE 13-2 Power and Cooling Unit LED Descriptions 158
TABLE 13-3 Interconnect Card LED Descriptions 160
TABLE 13-4 Sun StorEdge T3+ Array Controller Card LED Descriptions 161
TABLE A-1 Power Specifications 182
TABLE A-2 Environmental Specifications 183
TABLE A-3 Physical Specifications 184

xvi Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
TABLE A-4 Cable Specifications 185
TABLE B-1 Illustrated Part Numbers 187

xvii
Preface
This manual contains information on how to install, operate, and service the Sun
StorEdge™ T3+ array. Most of the procedures in this manual can be performed by an
experienced system administrator.
Topics covered here are:
■“Before You Read This Book” on page xviii
■“Using UNIX Commands” on page xviii
■“Typographic Conventions” on page xix
■“Shell Prompts” on page xix
■“Related Documentation” on page xx
■“Accessing Sun Documentation Online” on page xxi
■“Sun Welcomes Your Comments” on page xxi

xviii Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
Before You Read This Book
Read the safety information in the Sun StorEdge T3+ Array Regulatory and Safety
Compliance Manual that is included with the array before attempting the installation.
Make sure you have prepared for the installation by reviewing the Sun StorEdge T3+
Array Site Preparation Guide. These guides are available on the Sun™ documentation
web site or from your Sun representative.
Work with your Sun representative to determine if you require any external
hardware or software products for using this device. Being prepared with this
knowledge and the appropriate tools will simplify the installation.
Using UNIX Commands
This document contains some information on basic UNIX®commands and
procedures such as booting the devices. For further information, see one or more of
the following:
■AnswerBook2™ online documentation for the Solaris™ operating environment
■Other software documentation that you received with your system

Preface xix
Typographic Conventions
Shell Prompts
Typeface Meaning Examples
AaBbCc123 The names of commands, files,
and directories; on-screen
computer output
Edit your.login file.
Use ls -a to list all files.
% You have mail.
AaBbCc123 What you type, when
contrasted with on-screen
computer output
%su
Password:
AaBbCc123 Book titles, new words or terms,
words to be emphasized Read Chapter 6 in the User’s Guide.
These are called class options.
You must be superuser to do this.
Command-line variable; replace
with a real name or value To delete a file, type rm filename.
Shell Prompt
C shell machine_name%
C shell superuser machine_name#
Bourne shell and Korn shell $
Bourne shell and Korn shell superuser #
Sun StorEdge T3 and T3+ array :/:

xx Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002
Related Documentation
Application Title Part Number
Latest array updates Sun StorEdge T3+ Array Release Notes 816-4771
Installation overview Sun StorEdge T3+ Array Start Here 816-4768
Safety procedures Sun StorEdge T3+ Array Regulatory and
Safety Compliance Manual 816-0774
Site preparation Sun StorEdge T3+ Array Site Preparation
Guide 816-0778
Installation and
configuration Sun StorEdge T3+ Array Installation and Configuration Manual 816-4769
Administration Sun StorEdge T3+ Array Administrator’s
Manual 816-4770
Cabinet installation Sun StorEdge T3 Array Cabinet Installation
Guide 806-7979
Disk drive specifications 18 Gbyte, 1-inch, 10K rpm Disk Drive
Specifications 806-1493
36 Gbyte, 10K rpm 1-Inch Disk Drive
Specifications 806-6383
73 Gbyte, 10K rpm 1.6-Inch Disk Drive
Specifications 806-4800
Host Bus Adapters Sun Enterprise 6x00/5x00/4x00/3x00 Systems
SBus+ and Graphics+ I/O Boards Installation
Guide
805-2704
Sun StorEdge PCI FC-100 Host Adapter
Installation 805-3682
Sun StorEdge SBus FC-100 Host Adapter
Installation and Service Manual 802-7572
Sun StorEdge PCI Single Fibre Channel
Network Adapter Installation Guide 806-7532
Sun StorEdge PCI Dual Fibre Channel Host
Adapter Installation Guide 806-4199
Sun StorEdge Compact PCI Dual Fibre
Channel Network Adapter Installation and
User’s Guide
816-0241