Alcatel OmniSwitch 6624 User manual

OmniSwitch Troubleshooting Guide September 2005 i
Part No. 031496-00, Rev. C
September 2005
OmniSwitch 6624/6648/
6800/7700/7800/8800
Troubleshooting Guide
www.alcatel.com

ii OmniSwitch Troubleshooting Guide September 2005
This troubleshooting guide documents OmniSwitch 6624/6648/770/7800/8800
hardware, including chassis and associated components, and Release 5.1 software.
The specifications described in this guide are subject to change without notice.
Copyright © 2006 by Alcatel Internetworking, Inc. All rights reserved. This document may not be repro-
duced in whole or in part without the express written permission of Alcatel Internetworking, Inc.
Alcatel®and the Alcatel logo are registered trademarks of Alcatel. Xylan®, OmniSwitch®, OmniStack®,
and Alcatel OmniVista®are registered trademarks of Alcatel Internetworking, Inc.
OmniAccess™, Omni Switch/Router™, PolicyView™, RouterView™, SwitchManager™, VoiceView™,
WebView™, X-Cell™, X-Vision™, and the Xylan logo are trademarks of Alcatel Internetworking, Inc.
This OmniSwitch product contains components which may be covered by one or more of the following
U.S. Patents:
• U.S. Patent No. 6,339,830
• U.S. Patent No. 6,070,243
• U.S. Patent No. 6,061,368
• U.S. Patent No. 5,394,402
• U.S. Patent No. 6,047,024
• U.S. Patent No. 6,314,106
• U.S. Patent No. 6,542,507
26801 West Agoura Road
Calabasas, CA 91301
[phone] FAX [phone]
[email protected]
US Customer Support—[phone]
International Customer Support—[phone]
Internet—http://eservice.ind.alcatel.com

OmniSwitch Troubleshooting Guide September 2005 iii
Contents
About This Guide .........................................................................................................xv
Supported Platforms ......................................................................................................... xv
Who Should Read this Manual? ...................................................................................... xvi
When Should I Read this Manual? .................................................................................. xvi
What is in this Manual? ................................................................................................... xvi
What is Not in this Manual? ...........................................................................................xvii
How is the Information Organized? ............................................................................... xvii
Related Documentation .................................................................................................. xvii
Before Calling Alcatel’s Technical Assistance Center .................................................... xx
Chapter 1 Troubleshooting the Switch System ......................................................................1-1
In This Chapter ................................................................................................................1-1
Introduction .....................................................................................................................1-2
Troubleshooting System for OS-6624/6648 and OS-7/8XXX .......................................1-3
Advanced Troubleshooting .............................................................................................1-9
Dshell Troubleshooting .................................................................................................1-11
Troubleshooting NIs on OmniSwitch 7700/7800/8800 .........................................1-21
OmniSwitch 6624/6648 Dshell Troubleshooting ...................................................1-23
Accessing Dshell on Idle Switches ..................................................................1-25
Using AlcatelDebug.cfg ................................................................................................1-26
Troubleshooting IPC on OS-6/7/8XXX Series of Switches .........................................1-27
Debugging IPC .......................................................................................................1-27
OmniSwitch 6624/6648 Example ..........................................................................1-34
Port Numbering Conversion Overview .........................................................................1-36
ifindex to gport .......................................................................................................1-36
gport to ifindex .......................................................................................................1-36
Converting from lport .............................................................................................1-36
OmniSwitch 7700/7800/8800 (Falcon/Eagle) Example ..................................1-36
OmniSwitch 6624/6648 (Hawk) Example ......................................................1-37
Chapter 2 Troubleshooting Switched Ethernet Connectivity ..............................................2-1
In This Chapter ................................................................................................................2-1
Overview of Troubleshooting Approach ........................................................................2-2
Verify Physical Layer Connectivity ................................................................................2-3
Verify Current Running Configuration ...........................................................................2-5

iv OmniSwitch Troubleshooting Guide September 2005
Verify Source Learning ...................................................................................................2-6
Verify Switch Health .......................................................................................................2-7
Verify ARP ......................................................................................................................2-7
Using the Log File ...........................................................................................................2-8
Checking the 7700/7800 Nantucket Fabric ..............................................................2-8
Checking the 7700/7800 Nantucket Fabric for Interrupts, Data Counts and
Error Counts ............................................................................................................2-9
Checking the Traffic Queue on the NI .....................................................................2-9
Check for Catalina (MAC) or Port Lockup ............................................................2-10
Chapter 3 Troubleshooting Source Learning .........................................................................3-1
In This Chapter ................................................................................................................3-1
Introduction .....................................................................................................................3-2
Troubleshooting a Source Learning Problem .................................................................3-3
Advanced Troubleshooting .............................................................................................3-5
Dshell Troubleshooting ...................................................................................................3-7
OS-6600 .................................................................................................................3-10
Chapter 4 Troubleshooting Spanning Tree ............................................................................4-1
In This Chapter ................................................................................................................4-1
Introduction .....................................................................................................................4-1
Troubleshooting Spanning Tree ......................................................................................4-2
Dshell ..............................................................................................................................4-5
Generic Troubleshooting in Dshell ...............................................................................4-10
Event Trace (stpni_traceprint) ................................................................................4-10
PORTATCH ....................................................................................................4-11
PORTDELE .....................................................................................................4-11
ADDVLAN .....................................................................................................4-11
MODVLADM .................................................................................................4-12
MODVLSTP ....................................................................................................4-12
ADDQTAG .....................................................................................................4-12
DELQTAG ......................................................................................................4-12
MDEFVLAN ...................................................................................................4-13
PORTAGGR ....................................................................................................4-13
PORTDISG ......................................................................................................4-13
AGGR_UP .......................................................................................................4-13
AGGRDOWN .................................................................................................4-13
PORTJOIN ......................................................................................................4-14
PORTLEAV ....................................................................................................4-14
BRGPARAM ...................................................................................................4-14
PTSTPMOD ....................................................................................................4-15
PORTMOD ......................................................................................................4-15
PORTVLBK ....................................................................................................4-15
PVLANBLK ....................................................................................................4-15
GMBPDU ........................................................................................................4-16

OmniSwitch Troubleshooting Guide September 2005 v
GMIGBPDU ....................................................................................................4-16
GM2FIXED .....................................................................................................4-17
VMADDVPA ..................................................................................................4-17
VMDELVPA ...................................................................................................4-17
VMDEFVPA ...................................................................................................4-17
TOPOCHGT ....................................................................................................4-18
LINK_UP ........................................................................................................4-18
LINKDOWN ...................................................................................................4-18
NI_UP ..............................................................................................................4-18
NI_DOWN ......................................................................................................4-18
Physical and Logical Port Dumps ..........................................................................4-19
Logical Ports (stpni_debugLport) ....................................................................4-19
Physical Port (stpni_debugPport) ....................................................................4-20
Physical and Logical Port Trace Display (stpni_debugport) ...........................4-22
Socket Handler Traces ...........................................................................................4-22
stpNISock_globals ...........................................................................................4-22
stpNISock_warningprint ..................................................................................4-23
stpNISock_traceprint .......................................................................................4-23
Inter-NI Trace (stpNISock_intraceprint) .........................................................4-24
Time-out Trace (stpNISock_totraceprint) .......................................................4-24
Board Up (stpNISock_boardupprint) ..............................................................4-24
stpNISock_printon ...........................................................................................4-24
StpNISock_printoff .........................................................................................4-24
CMM Spanning Tree Traces ..................................................................................4-25
Trace Menu ......................................................................................................4-25
stpCMM_traceprint .........................................................................................4-25
Writing a PR for Spanning Tree ....................................................................................4-26
Exception in Spanning Tree (NI and CMM case) ..................................................4-26
Port Does Not Forward ..........................................................................................4-26
Spanning Tree Unchanged When Port State Has Changed ....................................4-27
Other Cases ............................................................................................................4-27
Chapter 5 Troubleshooting BOOTP/DHCP/UDP Relay ........................................................5-1
In This Chapter ................................................................................................................5-1
Starting the Troubleshooting Procedure ..........................................................................5-1
Use a Network Diagram ...........................................................................................5-2
Use the OSI Model to Guide Your Troubleshooting ...............................................5-2
UDP Relay Configuration Problems ........................................................................5-2
Incorrect Server IP Address ...............................................................................5-2
Forward Delay Timer ........................................................................................5-3
Displaying DHCP Statistics ..............................................................................5-3
UDP Relay and Group Mobility ...............................................................................5-4
Advanced Troubleshooting for UDP Relay ....................................................................5-5
Dshell ..............................................................................................................................5-6
Chapter 6 Troubleshooting DNS ................................................................................................6-1
In This Chapter ................................................................................................................6-1
Introduction .....................................................................................................................6-1

vi OmniSwitch Troubleshooting Guide September 2005
Troubleshooting a DNS Failure ......................................................................................6-2
Starting the Troubleshooting Procedure ...................................................................6-2
Layer 7 DNS or Name Resolution Issue ..................................................................6-2
DNS Configuration Considerations ................................................................................6-3
Chapter 7 Troubleshooting Link Aggregation .......................................................................7-1
In This Chapter ................................................................................................................7-1
Link Aggregation Limits and Guidelines ........................................................................7-2
OmniSwitch 6624/6648 Restrictions .......................................................................7-2
Troubleshooting a Link Aggregation Failure ..................................................................7-3
Verify the Configuration ..........................................................................................7-3
Source Learning .......................................................................................................7-5
Link Aggregation Affecting Other Traffic ...............................................................7-5
Problems Creating a Group ......................................................................................7-5
Problems Deleting a Group ......................................................................................7-5
LACP 802.3AD ........................................................................................................7-6
Advanced Link Aggregation Troubleshooting ................................................................7-7
6800 Link Aggregation Debug Functions .....................................................................7-10
la_ni_agg_prt ..........................................................................................................7-10
la_ni_port_prt .........................................................................................................7-10
la_ni_port_up_prt ...................................................................................................7-11
la_ni_port_stats_prt ................................................................................................7-11
la_ni_info ...............................................................................................................7-11
lagg_ni_Sock_help .................................................................................................7-11
la_ni_trace_freeze ..................................................................................................7-12
la_ni_trace_unfreeze ..............................................................................................7-12
la_ni_kite_help .......................................................................................................7-12
Chapter 8 Troubleshooting 802.1Q ..........................................................................................8-1
In This Chapter ................................................................................................................8-1
Troubleshooting 802.1Q .................................................................................................8-2
Default VLAN Traffic ..............................................................................................8-3
Tagged Packet on an Untagged Port ........................................................................8-3
802.1Q with VLAN ID of 0 ..............................................................................8-4
802.1Q and 64 Byte Packets ..............................................................................8-4
Advanced Troubleshooting .............................................................................................8-5
Dshell Commands ...........................................................................................................8-7
Chapter 9 Troubleshooting Group Mobility ............................................................................9-1
In This Chapter ................................................................................................................9-1
Troubleshooting a VLAN Mobility Failure ....................................................................9-2
Binding Rules ...........................................................................................................9-3
Port Rules .................................................................................................................9-3
Precedence ................................................................................................................9-4
Advanced Troubleshooting .............................................................................................9-5

OmniSwitch Troubleshooting Guide September 2005 vii
Dshell ..............................................................................................................................9-6
NI Debug Dshell .......................................................................................................9-6
6800 Group Mobility Troubleshooting ...........................................................................9-7
show vlan rules .........................................................................................................9-7
gmHelp .....................................................................................................................9-7
gmcKiteDebug .........................................................................................................9-8
gmcShowPorts ..........................................................................................................9-8
gmcShowRules .........................................................................................................9-8
gmnKiteDebug .........................................................................................................9-9
gmnKiteShowRules ..................................................................................................9-9
gmnMacVlanShowBuffer ........................................................................................9-9
Chapter 10 Troubleshooting QoS ...............................................................................................10-1
In This Chapter ..............................................................................................................10-1
QoS Behavior ................................................................................................................10-2
Default ....................................................................................................................10-2
QoS Queues and Ports ............................................................................................10-2
Troubleshooting QoS ....................................................................................................10-3
Information Gathering on Symptoms and Recent Changes ...................................10-3
Starting the Troubleshooting Procedure .................................................................10-3
QoS Activation .......................................................................................................10-3
QoS Apply ..............................................................................................................10-4
Invalid Policies .......................................................................................................10-4
Rules Order ............................................................................................................10-4
Viewing QoS Settings ............................................................................................10-5
Viewing QoS Policy Rules .....................................................................................10-5
Validation ...............................................................................................................10-6
Example 1 ........................................................................................................10-6
Example 2 ........................................................................................................10-6
Example 3 ........................................................................................................10-7
Correction ...............................................................................................................10-8
Reflexive Rules ......................................................................................................10-8
QoS Log .................................................................................................................10-9
QoS Statistics .......................................................................................................10-11
Debug QoS ...........................................................................................................10-11
Debug QoS Internal ..............................................................................................10-12
OmniSwitch 6624/6648 Dshell Troubleshooting .................................................10-13
qosIxHelp ......................................................................................................10-13
qosDBState ....................................................................................................10-13
QoS Dump .....................................................................................................10-13
Example QoS Rules ....................................................................................................10-15
Chapter 11 Troubleshooting ARP ...............................................................................................11-1
In This Chapter ..............................................................................................................11-1
ARP Protocol Failure ....................................................................................................11-2
Common Error Conditions ............................................................................................11-5
Advanced ARP Troubleshooting ..................................................................................11-6

viii OmniSwitch Troubleshooting Guide September 2005
Dshell Troubleshooting .................................................................................................11-8
Viewing the ARP Table on OmniSwitch 6624/6648 Switches ............................11-10
Chapter 12 Troubleshooting IP Routing ...................................................................................12-1
In This Chapter ..............................................................................................................12-2
Introduction ...................................................................................................................12-3
IP Routing Protocol Failure ..........................................................................................12-3
Troubleshooting via the CLI .........................................................................................12-3
Troubleshooting with Debug CLI ...............................................................................12-11
RIP Troubleshooting ...................................................................................................12-13
OSPF Troubleshooting ................................................................................................12-19
BGP Troubleshooting ..................................................................................................12-27
Dshell Troubleshooting Advanced IP Routing ...........................................................12-29
ipdbg=x .................................................................................................................12-29
ifShow ..................................................................................................................12-29
iprmShowRoutes ..................................................................................................12-30
iprmCountRoutes .................................................................................................12-30
ipni_ifShow ..........................................................................................................12-30
Iprm_routeShow ...................................................................................................12-31
Ipni_routeCount ...................................................................................................12-31
ospfDbgDumpEnv ................................................................................................12-31
Chapter 13 Troubleshooting Virtual Router Redundancy Protocol (VRRP) ....................13-1
In This Chapter ..............................................................................................................13-1
Overview .......................................................................................................................13-2
Protocol Information .....................................................................................................13-3
IP Field Descriptions ..............................................................................................13-3
VRRP Field Descriptions .......................................................................................13-3
VRRP States ...........................................................................................................13-3
OmniSwitch 7700/7800/8800 Implementation .............................................................13-4
VRRP Security .......................................................................................................13-4
OmniSwitch VRRP Limitations .............................................................................13-4
CMM Failover ...............................................................................................................13-5
OmniSwitch VRRP Troubleshooting ............................................................................13-9
ARP Table ...................................................................................................................13-10
Dshell Troubleshooting ...............................................................................................13-11
Chapter 14 Troubleshooting IP Multicast Switching (IPMS) ...............................................14-1
In This Chapter ..............................................................................................................14-1
Troubleshooting a Device that Cannot Join an IP Multicast Stream ............................14-2
Troubleshooting a Device that Drops Out of an IP Multicast Stream ..........................14-3
Troubleshooting IPMS in Debug CLI ...........................................................................14-7

OmniSwitch Troubleshooting Guide September 2005 ix
Dshell Troubleshooting .................................................................................................14-9
Chapter 15 Troubleshooting DVMRP ........................................................................................15-1
In This Chapter ..............................................................................................................15-1
Introduction ...................................................................................................................15-2
DVMRP Troubleshooting .............................................................................................15-2
DVMRP Global and Interface Commands .............................................................15-2
DVMRP Debug Commands ...................................................................................15-4
Chapter 16 Troubleshooting PIM-SM ........................................................................................16-1
In This Chapter ..............................................................................................................16-1
Introduction ...................................................................................................................16-2
Definition of Terms .......................................................................................................16-2
Protocol Overview ........................................................................................................16-3
DR Election ............................................................................................................16-3
Simplified Hello Message Format ...................................................................16-3
Debugging Hello Messages .............................................................................16-4
Related CLI Command ....................................................................................16-5
BSR Election .................................................................................................................16-6
Simplified Packet Format .......................................................................................16-7
Debugging BSR/Bootstrap .....................................................................................16-7
Election of a New BSR ....................................................................................16-8
Related CLI Command ....................................................................................16-9
C-RP Advertisements ..................................................................................................16-10
Simplified RP-Advertisement Packet Format ......................................................16-10
Debugging C-RP-Adv ..........................................................................................16-11
Related CLI Command ..................................................................................16-12
RP-SET .......................................................................................................................16-13
Simplified Bootstrap RP-SET Packet Taken on a 192.168.12/24 Network .........16-14
Debugging RP-SET ..............................................................................................16-16
On Non BSR You Should See .......................................................................16-16
Related CLI Command ..................................................................................16-17
Join/Prune ....................................................................................................................16-18
Simplified Join Packet ..........................................................................................16-18
Simplified PRUNE Packet ...................................................................................16-20
Debugging JOIN/PRUNE Event ..........................................................................16-20
Register .......................................................................................................................16-21
Simplified REGISTER Packet Format .................................................................16-22
Shared Tree .................................................................................................................16-23
Related CLI Command ..................................................................................16-24
Source-Based Tree ......................................................................................................16-25
Related CLI Command ..................................................................................16-26
Troubleshooting Examples: Limitations .....................................................................16-27
Incorrect BSR ID ..................................................................................................16-27

x OmniSwitch Troubleshooting Guide September 2005
Multicast Group Status is Shown as Disabled .....................................................16-27
PIM-SM Limitations ............................................................................................16-28
Upstream Neighbor/Next Hop Debug Commands ...............................................16-28
Chapter 17 Troubleshooting Server Load Balancing ...........................................................17-1
In This Chapter ..............................................................................................................17-1
Introduction ...................................................................................................................17-2
Server Load Balance Failure .........................................................................................17-2
What is an SLB Failure? ........................................................................................17-2
Description of a Complete Failure of Service ........................................................17-2
Description of a Partial Failure of Service .............................................................17-2
Troubleshooting Commands .........................................................................................17-3
Troubleshooting a Complete Failure .............................................................................17-4
Troubleshooting a Partial Failure ..................................................................................17-5
The Troubleshooting Procedure ....................................................................................17-5
Chapter 18 Troubleshooting Authenticated VLANs ..............................................................18-1
In This Chapter ..............................................................................................................18-1
Introduction ...................................................................................................................18-1
Troubleshooting AVLAN .............................................................................................18-2
DHCP Request Failure ...........................................................................................18-2
Authentication Failure ............................................................................................18-3
Problem Communicating Using Multiple Protocols Simultaneously ....................18-4
Useful Notes on Client Issues ................................................................................18-5
Troubleshooting Using Debug Systrace ........................................................................18-5
Telnet Authentication and De-authentication ........................................................18-5
Get the IP Address from Default VLAN .........................................................18-5
Initiate the Telnet Authentication ....................................................................18-6
Release/Renew IP ............................................................................................18-7
De-Authenticating ...........................................................................................18-7
Release/Renew to Go Back to Default VLAN ................................................18-7
HTTP/S Authentication ..........................................................................................18-8
Start of Authentication using https://x.x.x.253 ................................................18-8
De-Authenticate using https://x.x.x.253 ..........................................................18-9
AVClient ..............................................................................................................18-10
AVClient Authentication Start ......................................................................18-10
AVClient logout: ...........................................................................................18-11
Dshell Troubleshooting ...............................................................................................18-12
Authentication Dispatcher (AD) Debugging Help ...............................................18-12
The Authenticated VLAN adDebugShowContext Function ................................18-13

OmniSwitch Troubleshooting Guide September 2005 xi
Chapter 19 Troubleshooting 802.1X .........................................................................................19-1
In This Chapter ..............................................................................................................19-1
Troubleshooting with the CLI .......................................................................................19-2
Troubleshooting Using Debug CLI ...............................................................................19-4
Dshell Troubleshooting .................................................................................................19-7
Appendix A OS6600/OS7700/OS8800 Architecture Overview ............................................ A-1
In This Chapter ............................................................................................................... A-1
The MAC ASIC ............................................................................................................. A-2
Catalina .................................................................................................................... A-2
Firenze ..................................................................................................................... A-4
The Coronado ASIC ................................................................................................A-5
Functional Description ............................................................................................ A-6
Coronado: The “Brain” of the System .............................................................. A-7
Coronado Specifications ................................................................................... A-7
Software Module Interaction ............................................................................ A-8
Queue Driver Interaction ................................................................................................ A-8
Ethernet Driver ........................................................................................................ A-8
Queue Dispatcher .................................................................................................... A-8
NI Supervision ......................................................................................................... A-9
Source Learning ...................................................................................................... A-9
L3 Manager/IPMS ................................................................................................... A-9
QoS Manager ........................................................................................................... A-9
Destination MAC Learning .............................................................................. A-9
L3 Pseudo CAM Learning ................................................................................ A-9
QoS Policy Change ........................................................................................... A-9
QoS Policy Deleted ........................................................................................ A-10
L2 destination MAC Aged/Deleted ................................................................ A-10
L3 PseudoCAM Entry Aged/Deleted ............................................................. A-10
Request to Free Queues Sent to QoS Manager .............................................. A-10
Link Goes Up/Down ....................................................................................... A-10
Link Aggregation ......................................................................................................... A-11
Coronado Tables .......................................................................................................... A-11
Layer 2 Tables .......................................................................................................A-11
Layer 3 Tables .......................................................................................................A-11
Source Learning ........................................................................................................... A-12
Hardware Routing Engine (HRE) ................................................................................A-13
QoS/Policy Manager .................................................................................................... A-15
Coronado Egress Logic ................................................................................................A-15
The Fabric Architecture ............................................................................................... A-16
Nantucket ASIC ........................................................................................................... A-17
Additional Nantucket Specifications ..................................................................... A-17
Functional Description: .................................................................................. A-18
Data Flow ....................................................................................................... A-18

xii OmniSwitch Troubleshooting Guide September 2005
Calendar Manager Module .................................................................................... A-19
Data Port Output Module ...................................................................................... A-19
Nantucket Redundancy ......................................................................................... A-19
Roma ............................................................................................................................ A-22
Functional Description .......................................................................................... A-23
Initialization .................................................................................................... A-24
NI Slot Insertion ............................................................................................. A-25
Setup Calendars and Flow Control for New NI .............................................A-25
NI Slot Extraction ........................................................................................... A-25
CMM Takeover and Hot Swap ............................................................................. A-25
Framing Error ........................................................................................................ A-26
Chassis Management Module (CMM) .........................................................................A-26
OS7000 CMM ....................................................................................................... A-27
OS8800 CMM ....................................................................................................... A-27
Functional Description of CMM ........................................................................... A-28
CMM Software Startup Process ..................................................................... A-28
AOS ................................................................................................................ A-29
MiniBoot ........................................................................................................ A-30
AOS Start ........................................................................................................ A-30
Chassis Manager Component of System Services ................................................ A-30
CMM Reload of NI Module .................................................................................. A-30
Overall System Architecture ................................................................................. A-32
Packet Walk ................................................................................................................. A-34
Packet Walk Principles .......................................................................................... A-34
Data Flow Overview ............................................................................................. A-34
Specific Packet Flows .................................................................................................. A-35
Unknown L2 Source, Known L2 Destination ....................................................... A-35
The Catalina ASIC .........................................................................................A-35
The Coronado ASIC ....................................................................................... A-35
The Nantucket ASIC ......................................................................................A-35
The Coronado ASIC ....................................................................................... A-35
The Catalina ASIC .........................................................................................A-35
Unknown Destination ................................................................................................... A-36
Known L2 Source, Unknown L2 Destination ....................................................... A-36
The Catalina ASIC .........................................................................................A-36
The Coronado ASIC ....................................................................................... A-36
The Nantucket ASIC ......................................................................................A-36
The Coronado ASIC ....................................................................................... A-37
The Catalina ASIC .........................................................................................A-37
Traffic is Being Passed; the Switch is Attempting to Put a Correct L2 DA
Entry on the NI ..................................................................................................... A-37
The Coronado ASIC ....................................................................................... A-37
Unknown L3 DA ...................................................................................................A-38
The Coronado ASIC ....................................................................................... A-38
Hardware Buses on OmniSwitch 7700/7800/8800 Switches ....................................... A-41
Xybus .................................................................................................................... A-41
Fbus ....................................................................................................................... A-41
Bbus ....................................................................................................................... A-41

OmniSwitch Troubleshooting Guide September 2005 xiii
Bus Mapping on OmniSwitch 7700/7800/8800 Switches ........................................... A-42
Xybus Mapping ..................................................................................................... A-42
Fbus Mapping ........................................................................................................ A-42
Falcon (OmniSwitch 7700/7800) Fbus Mapping ........................................... A-42
Eagle (OmniSwitch 8800) Fbus Mapping ...................................................... A-42
OS6624/6648 Architecture ........................................................................................... A-43
Hardware Architectural Overview ........................................................................ A-44
Layer 2 Forwarding ...............................................................................................A-46
Address Resolution Protocol .......................................................................... A-46
Address Learning ............................................................................................ A-47
Location of Address Tables ............................................................................A-47
Address Look-up Methodology ...................................................................... A-48
L2 Data Structures .......................................................................................... A-48
3-Protocol Entry ............................................................................................. A-49
Layer 3 Forwarding ...............................................................................................A-50
VLANs .................................................................................................................. A-51
Port Based VLANs ......................................................................................... A-51
Protocol Based VLANs ..................................................................................A-51
Address Based VLANs ................................................................................... A-51
Tag Net ID Entry ............................................................................................ A-52
Priority ............................................................................................................ A-52
802.1p Priority ................................................................................................ A-52
Rules-Based Priority ....................................................................................... A-53
QOS Flow ....................................................................................................... A-53
Bandwidth Management and QoS .................................................................. A-53
CMM Functionality for OS6600 .................................................................................. A-54
OS6600 IPC Communication ....................................................................................... A-58
OS6600 BOOT Sequence ............................................................................................ A-59
Appendix B Debug Commands ..................................................................................................... B-1
Appendix C Technical Support Commands ............................................................................... C-1
Appendix D Modifying Files with VI Editor ................................................................................ D-1
In This Chapter ............................................................................................................... D-1
Useful VI Commands ..................................................................................................... D-2
Sample VI Session .........................................................................................................D-3
Index ...................................................................................................................... Index-1

xiv OmniSwitch Troubleshooting Guide September 2005

OmniSwitch Troubleshooting Guide September 2005 page -xv
About This Guide
This OmniSwitch Troubleshooting Guide describes how to use Command Line Interface (CLI) and Dshell
commands available on the OmniSwitch 6600 Family, OmniSwitch 6800 Series, OmniSwitch 7700/7800,
and the OmniSwitch 8800 to troubleshoot switch and network problems.
Supported Platforms
This information in this guide applies to the following products:
•OmniSwitch 6624 (OmniSwitch 6600-24)
•OmniSwitch 6648 (OmniSwitch 6600-48)
•OmniSwitch 6600-P24
•OmniSwitch 6600-U24
•OmniSwitch 6602-24
•OmniSwitch 6602-48
•OmniSwitch 6800
•OmniSwitch 7700
•OmniSwitch 7800
•OmniSwitch 8800
Note. All references to OmniSwitch 6624 and 6648 switches also apply to the OmniSwitch 6600-P24,
OmniSwitch 6600-U24, OmniSwitch 6602-24, and OmniSwitch 6602-48 unless specified otherwise.
Unsupported Platforms
The information in this guide does not apply to the following products:
•OmniSwitch (original version with no numeric model name)
•Omni Switch/Router
•OmniStack
•OmniAccess

page -xvi OmniSwitch Troubleshooting Guide September 2005
Note. Troubleshooting documentation for legacy products (e.g., Omni Switch/Router) can be downloaded
at http://support.ind.alcatel.com/releasefiles/indexpage.cfm.
Who Should Read this Manual?
The principal audience for this user guide is Service and Support personnel who need to troubleshoot
switch problems in a live network. In addition, network administrators and IT support personnel who need
to configure and maintain switches and routers can use this guide to troubleshoot a problem upon advice
from Alcatel Service and Support personnel..
However, this guide is not intended for novice or first-time users of Alcatel OmniSwitches. Misuse or fail-
ure to follow procedures in this guide correctly can cause lengthy network down time and/or permanent
damage to hardware. Caution must be followed on distribution of this document.
When Should I Read this Manual?
Always read the appropriate section or sections of this guide before you log into a switch to troubleshoot
problems. Once you are familiar with the commands and procedures in the appropriate sections you can
use this document as reference material when you troubleshoot a problem.
What is in this Manual?
The principal sections (i.e., the chapters numbered numerically) use CLI and Dshell commands to analyze
and troubleshoot switch problems. Each section documents a specific switch feature (e.g., hardware, server
load balancing, routing).
Note. Dshell commands should only be used by Alcatel personnel or under the direction of Alcatel.
Misuse or failure to follow procedures that use Dshell commands in this guide correctly can cause lengthy
network down time and/or permanent damage to hardware.
Appendix A provides an architecture overview for the OmniSwitch 6600 Family, OmniSwitch 7700/7800,
and the OmniSwitch 8800.
Appendices B and C provide the following for debug and technical support CLI commands:
•Command description.
•Syntax.
•Description of keywords and variables included in the syntax.
•Default values.
•Usage guidelines, which include tips on when and how to use the command.
•Examples of command lines using the command.

OmniSwitch Troubleshooting Guide September 2005 page -xvii
•Related commands.
•Release history, which indicates the release when the command was introduced.
Appendix D provides a list of useful VI editor commands and a sample VI session that modifies the
boot.params file.
What is Not in this Manual?
This guide is intended for troubleshooting switches in live networks. It does not provide step-by-step
instructions on how to set up particular features on the switch or a comprehensive reference to all CLI
commands available in the OmniSwitch. For detailed syntax on non debug CLI commands and compre-
hensive information on how to configure particular software features in the switch, consult the user
guides, which are listed in “Related Documentation” on page xvii.
How is the Information Organized?
Each chapter in this guide includes troubleshooting guidelines related to a single software feature, such as
server load balancing or link aggregation.
Related Documentation
The following are the titles and descriptions of all the Release 5.1 and later OmniSwitch user guides:
•OmniSwitch 6600 Family Getting Started Guide
Describes the hardware and software procedures for getting an OmniSwitch 6624 or 6648 up and
running. Also provides information on fundamental aspects of OmniSwitch software and stacking
architecture.
•OmniSwitch 6800 Series Getting Started Guide
Describes the hardware and software procedures for getting an OmniSwitch 6800 up and running. Also
provides information on fundamental aspects of OmniSwitch software and stacking architecture.
•OmniSwitch 7700/7800 Getting Started Guide
Describes the hardware and software procedures for getting an OmniSwitch 7700 or 7800 up and
running. Also provides information on fundamental aspects of OmniSwitch software architecture.
•OmniSwitch 8800 Getting Started Guide
Describes the hardware and software procedures for getting an OmniSwitch 8800 up and running. Also
provides information on fundamental aspects of OmniSwitch software architecture.
•OmniSwitch 6600 Family Hardware Users Guide
Complete technical specifications and procedures for all OmniSwitch 6624 and 6648 chassis, power
supplies, fans, uplink modules, and stacking modules.

page -xviii OmniSwitch Troubleshooting Guide September 2005
•OmniSwitch 6800 Series Hardware Users Guide
Complete technical specifications and procedures for all OmniSwitch 6800 chassis, power supplies,
fans, uplink modules, and stacking modules.
•OmniSwitch 7700/7800 Hardware Users Guide
Complete technical specifications and procedures for all OmniSwitch 7700 and 7800 chassis, power
supplies, fans, and Network Interface (NI) modules.
•OmniSwitch 8800 Hardware Users Guide
Complete technical specifications and procedures for all OmniSwitch 8800 chassis, power supplies,
fans, and Network Interface (NI) modules.
•OmniSwitch CLI Reference Guide
Complete reference to all CLI commands supported on the OmniSwitch 6624/6648, 7700/7800, and
8800. Includes syntax definitions, default values, examples, usage guidelines and CLI-to-MIB variable
mappings.
•OmniSwitch 6600 Family Switch Management Guide
Includes procedures for readying an individual switch for integration into a network. Topics include the
software directory architecture, image rollback protections, authenticated switch access, managing
switch files, system configuration, using SNMP, and using web management software (WebView).
•OmniSwitch 6800 Series Switch Management Guide
Includes procedures for readying an individual switch for integration into a network. Topics include the
software directory architecture, image rollback protections, authenticated switch access, managing
switch files, system configuration, using SNMP, and using web management software (WebView).
•OmniSwitch 7700/7800/8800 Switch Management Guide
Includes procedures for readying an individual switch for integration into a network. Topics include the
software directory architecture, image rollback protections, authenticated switch access, managing
switch files, system configuration, using SNMP, and using web management software (WebView).
•OmniSwitch 6600 Family Network Configuration Guide
Includes network configuration procedures and descriptive information on all the major software
features and protocols included in the base software package. Chapters cover Layer 2 information
(Ethernet and VLAN configuration), Layer 3 information (RIP and static routes), security options
(authenticated VLANs), Quality of Service (QoS), and link aggregation.
•OmniSwitch 6800 Series Network Configuration Guide
Includes network configuration procedures and descriptive information on all the major software
features and protocols included in the base software package. Chapters cover Layer 2 information
(Ethernet and VLAN configuration), Layer 3 information (RIP and static routes), security options
(authenticated VLANs), Quality of Service (QoS), and link aggregation.

OmniSwitch Troubleshooting Guide September 2005 page -xix
•OmniSwitch 7700/7800/8800 Network Configuration Guide
Includes network configuration procedures and descriptive information on all the major software
features and protocols included in the base software package. Chapters cover Layer 2 information
(Ethernet and VLAN configuration), Layer 3 information (routing protocols, such as RIP and IPX),
security options (authenticated VLANs), Quality of Service (QoS), link aggregation, and server load
balancing.
•OmniSwitch 6600 Family Advanced Routing Configuration Guide
Includes network configuration procedures and descriptive information on the software features
included in the advanced routing software package (OSPF).
•OmniSwitch 6800 Series Advanced Routing Configuration Guide
Includes network configuration procedures and descriptive information on the software features and
protocols included in the advanced routing software package (OSPF, DVMRP, PIM-SM).
•OmniSwitch 7700/7800/8800 Advanced Routing Configuration Guide
Includes network configuration procedures and descriptive information on all the software features and
protocols included in the advanced routing software package. Chapters cover multicast routing
(DVMRP and PIM-SM) and OSPF.
•Technical Tips, Field Notices
Includes information published by Alcatel’s Service and Support group.
•Release Notes
Includes critical Open Problem Reports, feature exceptions, and other important information on the
features supported in the current release and any limitations to their support.
These user guides are included on the Alcatel Enterprise User Manual CD that ships with every switch.
You can also download these guides at http://www.ind.alcatel.com/library/manuals/index.cfm?cnt=index.

page -xx OmniSwitch Troubleshooting Guide September 2005
Before Calling Alcatel’s Technical Assistance
Center
Before calling Alcatel’s Technical Assistance Center (TAC), make sure that you have read through the
appropriate section (or sections) and have completed the actions suggested for your system’s problem.
Additionally, do the following and document the results so that the Alcatel TAC can better assist you:
•Have a network diagram ready. Make sure that relevant information is listed, such as all IP addresses
and their associated network masks.
•Have any information that you gathered while troubleshooting the issue to this point available to
provide to the TAC engineer.
•If the problem appears to be with only a few-fewer than four-switches, capture the output from the
show tech-support CLI command on these switches. (See Appendix C, “Technical Support
Commands,” for more information on show tech-support CLI commands.)
When calling Alcatel TAC in order to troubleshoot or report a problem following information can be help-
ful to get a quick resolution:
•All the dump files that were created, if any
•Output of switch log or the switch log files swlog1.log and swlog2.log
•Configuration file boot.cfg
•A capture of the show microcode command
•A capture of the show module long command
•A capture of the show tech-support command from CLI.
•If a CMM fail over to the redundant CMM happened because of this failure then include this informa-
tion from both of the CMMs.
Dial-in or Telnet access can also helpful for effective problem resolution.