HP bh5700 User manual

HP bh5700 ATCA 14-Slot Blade Server
Ethernet Switch Blade
First Edition
Manufacturing Part Number: AD171-9603A
June 2006

Ethernet Switch Blade User's Guide release 3.2.2j page ii

Legal otices
The information in this document is subject to change without notice.
Hewlett-Packard makes no warranty of any kind with regard to this manual, including, but
not limited to, the implied warranties of merchantability and fitness for a particular
purpose. Hewlett- Packard shall not be held liable for errors contained herein or direct,
indirect, special, incidental or consequential damages in connection with the furnishing,
performance, or use of this material.
Restricted Rights egend. Use, duplication or disclosure by the U.S. Government is subject
to restrictions as set forth in subparagraph (c) (1) (ii) of the Rights in Technical Data and
Computer Software clause at DFARS 252.227-7013 for DOD agencies, and subparagraphs
(c) (1) and (c) (2) of the Commercial Computer Software Restricted Rights clause at FAR
52.227-19 for other agencies.
Information in this document is provided in connection with Intel® products. No
license, express or implied, by estoppel or otherwise, to any intellectual property rights
is granted by this document. Except as provided in Intel’s Terms and Conditions of
Sale for such products, Intel assumes no liability whatsoever, and Intel disclaims any
express or implied warranty, relating to sale and/or use of Intel products including
liability or warranties relating to fitness for a particular purpose, merchantability, or
infringement of any patent, copyright or other intellectual property right. Intel
products are not intended for use in medical, life saving, or life sustaining applications.
Intel may make changes to specifications and product descriptions at any time, without
notice. HEW ETT-PACKARD COMPANY 3000 Hanover Street Palo Alto, California 94304
U.S.A.
Copyright Notice. Copyright ©2003 Hewlett-Packard Development Company, .P.
Reproduction, adaptation, or translation of this document without prior written
permission is prohibited, except as allowed under the copyright laws.
Additional Copyright Notices. AdvancedTCA® is a registered trademark of the PCI
Industrial Computer Manufacturers Group. inux® is a registered trademark of inus
Torvalds. ZNYX Networks, RAIN, RAINlink, OpenArchitect®, CarrierClass and HotSwap
are trademarks or registered trademarks of ZNYX Networks in the United States and/or
other countries. All other marks, trademarks or service marks are the property of their
respective owners.
Ethernet Switch Blade User's Guide release 3.2.2j page iii

About the Ethernet Switch Blade Manual
This manua inc udes everything you need to begin using the HP Ethernet Switch B ade with
OpenArchitect software, Re ease 3.2.2j.
Ethernet Switch Blade User's Guide release 3.2.2j page iv

Table of Contents
Chapter 1 Overview of the Ethernet Switch B ade ...........................................................17
High Performance Embedded Switching...................................................................... 17
Advanced TCA® Comp iant.........................................................................................17
OpenArchitect Switch Management............................................................................. 18
Extensib e Customization of Routing Po icies..............................................................18
Powerfu CarrierC ass Features.....................................................................................18
Ethernet Port Layout..................................................................................................... 18
Ethernet Switch B ade Port Configuration..................................................................19
Base switch Quick Reference.............................................................................. 19
Fabric Switch Quick Reference........................................................................... 19
OpenArchitect Switch Environment............................................................................. 20
OpenArchitect Software Structure................................................................................ 20
Chapter 2 Port Cab ing and LED Indicators...................................................................... 23
Connecting the Cab es...................................................................................................23
Conso e Port Cab ing................................................................................................23
Connecting to the Conso e Port................................................................................23
Out of Band Ports (OOB Ports).................................................................................... 24
LED Reference......................................................................................................... 24
Chapter 3 High Avai abi ity Networking...........................................................................27
Surviving Partner.......................................................................................................... 27
VRRP........................................................................................................................28
z md.......................................................................................................................... 28
Switch Rep acement and Reconfiguration............................................................... 29
zspconfig...................................................................................................................29
Examp e HA Switch Configuration..........................................................................30
Modifying zsp.conf on the Base switch...............................................................31
Modifying zsp_v an.conf on the Fabric Switch...................................................35
Configuring Surviving Partner......................................................................................42
Centra Authority.......................................................................................................... 43
Chapter 4 Fabric Switch Configuration ............................................................................ 46
Two switches, two conso es..........................................................................................46
Connecting to the Fabric Switch Conso e.....................................................................46
OpenArchitect Configuration Procedure.......................................................................46
Changing the She Prompt........................................................................................... 47
Defau t Configuration Scripts...................................................................................47
Examp e Configuration Scripts................................................................................ 47
Overview of OpenArchitect VLAN Interfaces.........................................................48
Tagging and Untagging VLANs..........................................................................48
Switch Port Interfaces..........................................................................................49
Layer 2 Switch Configuration.......................................................................................49
Using the S50 ayer2 Script.................................................................................. 50
Ethernet Switch Blade User's Guide release 3.2.2j page v

Rapid Spanning Tree................................................................................................ 50
To Enab e Rapid Spanning Tree:.........................................................................51
Port Path Cost...................................................................................................... 51
Layer 3 Switch Configuration............................................................................. 52
Using the S50 ayer3 Script.................................................................................. 52
Layer 3 Routing Protoco s with GateD ........................................................................54
Using the S55gatedRip1 Script................................................................................ 54
To Modify the GateD Scripts: ................................................................................. 56
C ass of Service (COS) ................................................................................................ 57
Egress Queues.......................................................................................................... 57
Ingress C assification................................................................................................57
Marking and Re-marking......................................................................................... 58
Schedu ing................................................................................................................ 58
ztmd Exp ained.................................................................................................... 58
zfi terd Exp ained..................................................................................................... 58
Running zfi terd........................................................................................................58
Restrictions on Imp ementation................................................................................59
Conf ict Reso ution.............................................................................................. 59
iptab es and fi tering............................................................................................ 60
Introduction..........................................................................................................60
Packet Wa k......................................................................................................... 61
Fi ter Ru es Specifications...................................................................................62
Specifying Source and Destination IP Addresses.................................................... 62
Specifying Protoco ............................................................................................. 62
Specifying an ICMP Message Type.................................................................... 62
Specifying TCP or UDP ports............................................................................. 63
Specifying TCP f ags...........................................................................................63
Specifying an Interface........................................................................................ 63
Fi ter Ru e Targets............................................................................................... 63
Supported Targets................................................................................................63
C assica Targets..................................................................................................63
ZNYX Targets..................................................................................................... 63
ZACTION Examp es........................................................................................... 64
Extensions to the defau t matches........................................................................64
tc and zqosd ............................................................................................................. 65
FIFO Queues (pfifo and bfifo discip ines)...........................................................65
PRIO and WRR queues....................................................................................... 67
The U32 Fi ter.......................................................................................................... 69
Combining Queuing Discip ines.............................................................................. 69
Hand e Semantics................................................................................................ 70
COPS: Common Open Po icy Service..........................................................................70
Protoco Architecture................................................................................................71
OpenArchitect PEP...................................................................................................71
Using pepd................................................................................................................72
Ethernet Switch Blade User's Guide release 3.2.2j page vi

Chapter 5 Fabric Switch Administration........................................................................... 73
Setting the Root Password............................................................................................ 73
Adding Additiona Users...............................................................................................73
Setting up a Defau t Route............................................................................................ 74
Name Service Reso ution..............................................................................................74
DHCP C ient Configuration..........................................................................................74
DHCP Server Configuration......................................................................................... 74
Network Time Protoco (NTP) C ient Configuration................................................... 75
Network Fi e System (NFS) C ient Configuration........................................................75
NFS Server Configuration.............................................................................................76
Connecting to the Switch Using FTP............................................................................77
ftpd Server Configuration............................................................................................. 77
Connecting to the Switch Using TFTP......................................................................... 77
TFTPD Server Configuration........................................................................................77
SNMP Agent................................................................................................................. 78
Supported MIBS.......................................................................................................78
Supported Traps........................................................................................................79
SNMP and OpenArchitect Interface Definitions......................................................80
ifStackTab e Entries.............................................................................................81
SNMP Configuration................................................................................................81
SNMP App ications..................................................................................................82
Port Mirroring............................................................................................................... 82
Link and LED Contro .................................................................................................. 83
Link Event Monitoring..................................................................................................83
Chapter 6 Fabric Switch Maintenance...............................................................................84
Overview of the OpenArchitect switch boot process....................................................84
Saving Changes.............................................................................................................86
Modifying Fi es and Updating the Switch.................................................................... 86
Recovering from a System Fai ure................................................................................86
System Boots with a Conso e Cab e............................................................................. 86
Booting with the –i option.............................................................................................87
System Hangs During Boot...........................................................................................88
Booting the Dup icate F ash Image...............................................................................88
Upgrading the OpenArchitect Image............................................................................ 88
Upgrading or Adding Fi es............................................................................................89
Exc uding Saving Fi es to F ash...............................................................................89
Upgrading the Switch Driver........................................................................................ 89
Using apt-get................................................................................................................. 90
Chapter 7 Base Switch Configuration................................................................................91
Two switches, two conso es..........................................................................................91
Connecting to the Base Switch Conso e....................................................................... 91
OpenArchitect Configuration Procedure..................................................................91
Changing the She Prompt.......................................................................................92
Defau t Configuration Scripts..............................................................................92
Ethernet Switch Blade User's Guide release 3.2.2j page vii

Examp e Configuration Scripts............................................................................92
Overview of OpenArchitect VLAN Interfaces....................................................93
Tagging and Untagging VLANs..........................................................................94
Switch Port Interfaces..........................................................................................94
Layer 2 Switch Configuration.................................................................................. 94
Using the S50 ayer2 Script.................................................................................. 96
Rapid Spanning Tree................................................................................................ 96
To Enab e Rapid Spanning Tree:.........................................................................96
Port Path Cost...................................................................................................... 97
Layer 3 Switch Configuration.................................................................................. 97
Using the S50 ayer3 Script.................................................................................. 98
Layer 3 Switch Using Mu tip e VLANs............................................................100
Using the S50mu tiv an Script...........................................................................100
To Modify the Layer 3 Mu tiv an Script ......................................................... 102
Modify the examp e script you copied into the /etc/rcZ.d directory. Adjust and
assign the number of IP addresses as app icab e. In the examp e be ow, the IP
address is changed for the interface in the ifconfig command ine of the script.
........................................................................................................................... 102
Layer 3 Routing Protoco s with GateD ................................................................. 102
Using the Provided S55gatedRip1 Script.......................................................... 102
To Modify the GateD Scripts: .......................................................................... 104
C ass of Service (COS) ..........................................................................................105
Egress Queues....................................................................................................105
Ingress C assification.........................................................................................105
Marking and Re-marking...................................................................................106
Schedu ing......................................................................................................... 106
zcos......................................................................................................................... 106
zfi terd.....................................................................................................................106
ztmd................................................................................................................... 106
Running zfi terd................................................................................................. 107
Restrictions on Imp ementation.........................................................................107
Conf ict Reso ution............................................................................................ 107
iptab es and fi tering............................................................................................... 108
Introduction........................................................................................................109
Packet Wa k....................................................................................................... 110
Fi ter Ru es Specifications.................................................................................110
Specifying Source and Destination IP Addresses..............................................110
Specifying Protoco ........................................................................................... 110
Specifying an ICMP Message Type.................................................................. 110
Specifying TCP or UDP ports........................................................................... 111
Specifying TCP f ags.........................................................................................111
Specifying an Interface...................................................................................... 111
Fi ter Ru e Targets............................................................................................. 111
Supported Targets..............................................................................................111
Ethernet Switch Blade User's Guide release 3.2.2j page viii

C assica Targets................................................................................................111
ZNYX Targets................................................................................................... 112
ZACTION Examp es......................................................................................... 112
Extensions to the defau t matches......................................................................113
tc: Traffic Contro ..................................................................................................113
Strict Priority Qdisc................................................................................................113
Weighted Round Robin Qdisc................................................................................114
FIFO Queues (pfifo and bfifo discip ines).........................................................114
Fifo Qdiscs..............................................................................................................115
Using Fi ters to Direct Packets to a COS Queue....................................................115
Protoco ip.............................................................................................................. 115
Protoco arp............................................................................................................ 116
Protoco a ..............................................................................................................116
Matching Specific Ingress Ports.............................................................................116
Advanced Fi tering – Po icing................................................................................117
Examp es............................................................................................................118
Po icing Actions..................................................................................................... 118
u32 match se ectors used in fi ters.........................................................................119
zqosd.......................................................................................................................120
PRIO and WRR queues..................................................................................... 121
The U32 Fi ter........................................................................................................ 123
Combining Queuing Discip ines............................................................................ 124
Hand e Semantics.............................................................................................. 124
COPS: Common Open Po icy Service................................................................... 124
Protoco Architecture.........................................................................................125
OpenArchitect PEP............................................................................................126
Using pepd......................................................................................................... 126
Chapter 8 Base Switch Administration............................................................................128
Setting the Root Password......................................................................................128
Adding Additiona Users........................................................................................128
Setting up a Defau t Route..................................................................................... 129
Name Service Reso ution....................................................................................... 129
DHCP C ient Configuration................................................................................... 129
DHCP Server Configuration...................................................................................129
Network Time Protoco (NTP) C ient Configuration.............................................130
Network Fi e System (NFS) C ient Configuration.................................................130
NFS Server Configuration......................................................................................131
Connecting to the Switch Using FTP..................................................................... 131
ftpd Server Configuration.......................................................................................132
Connecting to the Switch Using TFTP...................................................................132
TFTPD Server Configuration................................................................................. 132
SNMP Agent.......................................................................................................... 132
Supported MIBS................................................................................................ 132
Supported Traps.................................................................................................134
Ethernet Switch Blade User's Guide release 3.2.2j page ix

SNMP and OpenArchitect Interface Definitions............................................... 134
ifStackTab e Entries...........................................................................................135
SNMP Configuration......................................................................................... 135
SNMP App ications........................................................................................... 136
Port Mirroring.........................................................................................................136
Link and LED Contro ............................................................................................137
Link Event Monitoring........................................................................................... 137
Chapter 9 Base Switch Maintenance............................................................................... 138
Overview of the OpenArchitect switch boot process............................................. 138
Saving Changes...................................................................................................... 140
Modifying Fi es and Updating the Switch..............................................................140
Recovering from a System Fai ure......................................................................... 140
System Boots with a Conso e Cab e.......................................................................140
Booting with the –i option......................................................................................141
System Hangs During Boot.................................................................................... 142
Booting the Dup icate F ash Image........................................................................ 142
Upgrading the OpenArchitect Image......................................................................142
Upgrading or Adding Fi es.....................................................................................143
Exc uding Saving Fi es to F ash.............................................................................143
Upgrading the Switch Driver..................................................................................143
Using apt-get.......................................................................................................... 144
Chapter 10 Connecting to the Ethernet Switch B ade..................................................... 145
Base Interface Hub System:........................................................................................ 145
Ethernet Interfaces: ................................................................................................145
Management Interfaces: ........................................................................................ 145
Fabric Interface Hub System: .....................................................................................146
Ethernet Interfaces: ................................................................................................146
Management Interfaces: ........................................................................................ 146
Connecting to the Base Interface................................................................................ 146
Base Interface Seria Port Connection....................................................................146
Base Interface Out-of-Band Ethernet Connection .................................................147
Connecting to the Fabric Interface .............................................................................148
Fabric Interface Seria Port Connection ................................................................ 148
Fabric Interface Out of Band Ethernet Connection ...............................................149
Chapter 11 Diagnosing a Fai ed Ethernet Switch B ade Activation ..............................150
Accessing the ShMM.................................................................................................. 152
Verifying Communications Between the ShMM and Switch................................ 152
Critica Thresho d Error Reported..................................................................... 152
Ana yzing Mstate information for the switch............................................................. 153
Checking the ekey Status From the She f Manager.................................................... 153
Chapter 12 Troub eshooting a Fai ed OpenArchitect Load.............................................155
Recovering from a System Fai ure .............................................................................157
Booting Without the Over ay Fi e...............................................................................158
Ethernet Switch Blade User's Guide release 3.2.2j page x