Cisco ASR 5500 User manual

Troubleshooting
This chapter provides information and instructions for using the system command line interface (CLI) for
troubleshooting any issues that may arise during system operation.
Refer to the ASR 5500 Installation Guide for comprehensive descriptions of the hardware components addressed
by these troubleshooting procedures.
•Detecting Faulty Hardware, on page 1
•Taking Corrective Action, on page 20
•Verifying Network Connectivity, on page 23
•Using the System Diagnostic Utilities, on page 26
•Generating an SSD, on page 29
•Configuring and Using the Support Data Collector, on page 29
Detecting Faulty Hardware
When power is applied to the chassis, power is sequentially applied to the Management I/O (MIO/UMIO/MIO2)
cards, Data Processing Cards (DPC/UDPC/DPC2/UDPC2s), Fabric and Storage Cards (FSCs), and System
Status Cards (SSCs).
Each PFU and card installed in the system incorporates light emitting diodes (LEDs) that indicate its operating
status. This section describes how to use these status LEDs to verify that all of the installed components are
functioning properly.
As the system progresses through its boot process, some cards will not exhibit immediate LED activity. Allow
several minutes to elapse after a reboot is initiates before checking the LEDs on the various cards to verify
that the boot process has successfully completed.
Important
Licensing Issues
The system boot process is governed by StarOS licenses. During the startup process, each card performs a
series of Power-On Self Tests (POSTs) to ensure that the hardware is operational. These tests also verify that
the card meets all license requirements to operate in this chassis.
Refer to Chassis Universal License Requirements in the ASR 5500 Installation Guide for additional information
on the effect licenses and card types have on the boot process.
Troubleshooting
1

Using the CLI to View Status LEDs
Status LEDs for all cards can be viewed via the CLI by entering the Exec mode show leds all command.
[local]host_name#show leds all
The following displays a sample of this command's output.
Slot 01: Run/Fail: Green | Active: Off | Redundant: Green
Slot 02: Run/Fail: Green | Active: Off | Redundant: Green
Slot 03: Run/Fail: Green | Active: Off | Redundant: Green
Slot 05: Run/Fail: Green | Active: Green | Redundant: Green Master: Green
Slot 06: Run/Fail: Green | Active: Off | Redundant: Green Master:Off
Slot 08: Run/Fail: Green | Active: Off | Redundant: Green
Slot 11: Run/Fail: Green | Active: Green | Redundant: Green Status: Green |
Service: Off
Slot 12: Run/Fail: Green | Active: Green | Redundant: Green Status: Green |
Service: Off
Slot 13: Run/Fail: Green | Active: Green | Redundant: Green
Slot 14: Run/Fail: Green | Active: Green | Redundant: Green
Slot 15: Run/Fail: Green | Active: Green | Redundant: Green
Slot 16: Run/Fail: Green | Active: Green | Redundant: Green
Slot 17: Run/Fail: Green | Active: Green | Redundant: Green
The status of the two Power Filter Units (PFUs) can be viewed by entering the Exec mode show power chassis
command.
Checking the LEDs on the PFU
Each PFU has four LEDs along the top edge of its front panel. You must unsnap the top front cover from the
chassis to view these LEDs. Each LED is associated with one of the four -48 VDC power feeds connected to
the PFU.
Each LED on the PFU should illuminate blue for normal operating conditions.
Figure 1: PFU LEDs
The possible states for these LEDs are described in the following table. If the LED is not blue, use the
troubleshooting information below to diagnose the problem.
Troubleshooting
2
Troubleshooting
Using the CLI to View Status LEDs

Table 1: PFU LED States
TroubleshootingDescriptionColor
None needed.Power feed is supplying -48VDC to this
power plane
Blue
Verify that each circuit breaker is in the ON
position.
PFU is not receiving power to one or more
of its power planes.
None
Verify that the RTN and -48VDC lugs are
attached properly to the posts on the upper
rear of the chassis.
Verify that the ground lug is attached
properly.
Use a voltmeter to verify that the power
distribution panel is supplying the correct
voltage and sufficient current to the
terminals at the rear of the PFU.
Check the cables from the power source to
the rack for continuity.
If a power distribution panel (PDP) is
installed between the power distribution
frame (PDF) and the chassis, verify that its
circuit breakers are set to ON.
If a PDP is installed between the PDF and
the chassis, check the cables from the PDP
to the chassis for continuity.
If all of the above suggestions have been
verified, then it is likely that the PFU is not
functional. Please contact your service
representative.
Checking the LEDs on the MIO Card
Each MIO/UMIO/MIO2 is equipped with the following LEDs:
• Run/Fail
• Active
• Redundancy
• Master
• Busy
Troubleshooting
3
Troubleshooting
Checking the LEDs on the MIO Card

Figure 2: MIO Card Status LEDs
The possible states for all MIO/UMIO/MIO2 LEDs are described in the sections that follow.
MIO Run/Fail LED States
The MIO/UMIO/MIO2 Run/Fail LED indicates the overall status of the card. This LED should be steady
green for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 2: MIO Run/Fail LED States
TroubleshootingDescriptionColor
None needed.Card powered with no errors detectedGreen
This is normal operation during boot-up.Card is initializing and/or loading softwareBlinking Green
Errors were detected during the Power On
Self Tests (POSTs). It is likely that the
errors were logged to the system's
command line interface during boot.
Card powered with error(s) detectedRed
Troubleshooting
4
Troubleshooting
MIO Run/Fail LED States

TroubleshootingDescriptionColor
Verify that the LEDs on the PFUs are blue.
If they are not, refer to Checking the LEDs
on the PFU, on page 2 for troubleshooting
information.
Card is not receiving powerNone
Verify that the power source is supplying
ample voltage and current to the chassis.
Verify that the card is properly installed per
the instructions in the ASR 5500 Installation
Guide.
If all of the above suggestions have been
verified, it is possible that the MIO is not
functional. Please contact your service
representative.
MIO Active LED States
The Active LED on the MIO/UMIO/MIO2 indicates that the software is loaded on the card and it is ready for
operation. For the MIO installed in chassis slot 5, this LED should be green for normal operation. For the
MIO installed in slot 6, this LED should be off for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 3: Active LED States
TroubleshootingDescriptionColor
None needed for the MIO/UMIO/MIO2 in
slot 5. If green for the MIO/UMIO/MIO2
in slot 6, verify that the MIO/UMIO/MIO2
in slot 5 is installed and licensed properly
according to the instructions in the ASR
5500 Installation Guide.
Card is activeGreen
Refer to Monitoring the System for
information on determining the status of
the MIO/UMIO/MIO2 and system software
processes.
Tasks or processes being migrated from the
active MIO to the standby MIO.
Blinking Green
Verify that the Run/Fail LED is green. If
so, the card is receiving power and POST
results are positive. If it is off, refer to MIO
Run/Fail LED States, on page 4 for
troubleshooting information.
Card is not receiving power.
OR
Card has failed.
None
Troubleshooting
5
Troubleshooting
MIO Active LED States

MIO Redundancy LED States
The Redundancy LED on the MIO/UMIO/MIO2 indicates that software is loaded on the card, but it is serving
as a redundant component. For the MIO/UMIO/MIO2 installed in slot 6, this LED should be green for normal
operation. For the MIO/UMIO installed in slot 8, this LED should be off for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 4: MIO Redundancy LED States
TroubleshootingDescriptionColor
None needed. If green for the
MIO/UMIO/MIO2s in slot 5 and slot 6, the
cards and ports are fully backed up.
Card is in redundant modeGreen
Check the status of the other
MIO/UMIO/MIO2. If it has failed or one
or more of its ports are no longer active,
the system can continue to function but
redundancy is compromised.
Card or port on this card is not backed up
by other MIO.
Amber
Refer to Monitoring the System for
information on determining the status of
the MIO/UMIO/MIO2 and system software
processes.
Refer to Monitoring the System for
information on determining the status of
the MIO/UMIO/MIO2 and system software
processes.
Tasks or processes being migrated from the
active MIO to the standby MIO.
Blinking Amber
Verify that the Run/Fail LED is green. If
so, the card is receiving power and POST
results are positive. If it is off, refer to MIO
Run/Fail LED States, on page 4 for
troubleshooting information on.
Card is not receiving power.
OR
Card has failed.
None
MIO Master LED States
The Master LED on the MIO/UMIO/MIO2 indicates whether the card is in Active or Standby mode.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information also provided to diagnose the problem.
Table 5: MIO Master LED States
TroubleshootingDescriptionColor
None needed.This card is the Active MIO.Green
Troubleshooting
6
Troubleshooting
MIO Redundancy LED States

TroubleshootingDescriptionColor
Refer to Monitoring the System for
information on determining the status of
the MIO/UMIO /MIO2and system software
processes.
Tasks or processes being migrated from the
active MIO to the standby MIO.
Blinking Green
Verify that the Run/Fail LED is green. If
so, the card is receiving power and POST
results are positive. If it is off, refer to MIO
Run/Fail LED States, on page 4 for
troubleshooting information.
This card is the Standby MIO.
OR
Card has failed.
None
Refer to Monitoring the System for
information on determining the status of he
MIO/UMIO/MIO2 and system software
processes.
MIO Busy LED States
The Busy LED on the MIO/UMIO/MIO2 indicates that the card is accessing the RAID solid state drives on
the FSCs.
This LED is off when no file storage activity is occurring.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 6: MIO Busy LED States
TroubleshootingDescriptionColor
None required.Files are being transferred to or accessed
from the RAID configuration on the FSCs.
Green
Checking the LEDs on the FSC, on page
12
No RAID activity.
OR
RAID configuration is unavailable.
None
MIO –Interface Link LED States
The Link LED associated with a 1000Base-T (management) or 10 Gigabit Ethernet port on an MIO/UMIO
daughter card (subscriber traffic) indicates the status of the network link. This LED should be green for normal
operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Troubleshooting
7
Troubleshooting
MIO Busy LED States

Table 7: MIO –Interface Link LED States
TroubleshootingDescriptionColor
None needed.
NOTE: This LED will not indicate the
presence of a network link until the
interface parameters are set during the
software configuration process.
Link is upGreen
Verify that the Run/Fail LED is green. If
so, the card is receiving power. If it is off,
refer to MIO Run/Fail LED States, on page
4for troubleshooting information.
No power to card.
OR
Link is down.
None
Verify that the interface is cabled properly.
Verify that the device on which the
interface is located is cabled and powered
properly.
MIO –Interface Activity LED States
The Activity LED associated with a 1000Base-T (management) or 10 Gigabit Ethernet port on an
MIO/UMIO/MIO2 daughter card (subscriber traffic) indicates the presence of traffic on the network link.
This LED should be green when data is being transmitted or received over the interface.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 8: MIO –Interface Activity LED States
TroubleshootingDescriptionColor
None needed.Traffic is present on the linkFlashing Green
None needed if there is no activity
on the link. Prior to interface
configuration, this is normal
operation.
No traffic is present on the linkNone
Checking the LEDs on the DPC
Each DPC/UDPC or /DPC2/UDPC2 is equipped with status LEDs as listed below:
• Run/Fail
• Active
• Redundancy
Troubleshooting
8
Troubleshooting
MIO –Interface Activity LED States

Figure 3: DPC Status LEDs
The possible states for all of the DPC/UDPC or /DPC2/UDPC2 LEDs are described in the sections that follow.
DPC Run/Fail LED States
The DPC/UDPC or /DPC2/UDPC2 Run/Fail LED indicates the overall status of the card. This LED should
be green for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 9: DPC Run/Fail LED States
TroubleshootingDescriptionColor
None needed.Card powered up with no errors detected.Green
This is normal operation during boot-up.Card is initializing and/or loading software.Blinking Green
Errors were detected during the Power On
Self Tests (POSTs). It is likely that the
errors were logged to the system's
command line interface during boot.
Card powered up with error(s) detected.Red
Troubleshooting
9
Troubleshooting
DPC Run/Fail LED States

TroubleshootingDescriptionColor
Verify that the LEDs on the PFUs are blue.
If they are not, refer to Checking the LEDs
on the PFU, on page 2 for troubleshooting
information.
Card is not receiving power.None
Verify that the power source is supplying
ample voltage and current to the chassis.
Verify that the card is properly installed
and licensed per the instructions in the ASR
5500 Installation Guide.
If all of the above suggestions have been
verified, it is possible that the DPC/UDPC
or /DPC2/UDPC2 is not functional. Please
contact your service representative.
DPC Active LED States
The Active LED on the DDPC/UDPCPC or /DPC2/UDPC2 indicates that the software is loaded on the card
and that the card is ready for operation. When the system first boots up, all installed DPC/UDPCs or
/DPC2/UDPC2s are booted into standby mode. The system must then be configured as to which DPC/UDPCs
or /DPC2/UDPC2s should serve as redundant components (remain in standby mode) and which should function
as active components.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 10: DPC Active LED States
TroubleshootingDescriptionColor
The first time power is applied to the
system, all of the DPC/UDPCs or
/DPC2/UDPC2s should be booted into the
standby mode. Therefore, this LED should
be off.
Card is active.Green
Verify that the Redundancy LED on a
standby DPC/UDPC or /DPC2/UDPC2 is
also blinking green. If so, there is an issue
with the active DPC/UDPC or
/DPC2/UDPC2 and it is transferring its
processes.
Tasks or processes are being migrated from
an active DPC to a standby DPC.
Blinking Green
Refer to Monitoring the System for
information on determining the status of
the DPC/UDPC or /DPC2/UDPC2 and
system software processes and
functionality.
Troubleshooting
10
Troubleshooting
DPC Active LED States