Cisco ASR 5000 User manual

Troubleshooting
This chapter provides information and instructions for using the system command line interface (CLI) for
troubleshooting any issues that may arise during system operation.
Refer to the ASR 5000 Installation Guide for comprehensive descriptions of the hardware components
addressed by these troubleshooting procedures.
•Detecting Faulty Hardware, page 1
•Taking Corrective Action, page 21
•Verifying Network Connectivity, page 25
•Using the System Diagnostic Utilities, page 28
•Generating an SSD, page 31
•Configuring and Using the Support Data Collector, page 32
Detecting Faulty Hardware
When power is applied to the chassis, power is sequentially applied to management cards, application cards
and line cards.
Each PFU, application and line card installed in the system incorporates light emitting diodes (LEDs) that
indicate its operating status. This section describes how to use these status LEDs to verify that all of the
installed components are functioning properly.
As the system progresses through its boot process, some cards will not exhibit immediate LED activity.
Allow several minutes to elapse after a reboot is initiates before checking the LEDs on the various cards
to verify that the boot process has successfully completed.
Important
ASR 5000 System Administration Guide, StarOS Release 21.2
1

Using the CLI to View Status LEDs
The status of application and line card LEDs can be viewed through the CLI by entering the show leds all
command in Exec mode.
[local]host_name#show leds all
The following displays a sample of this command's output.
Slot 01: Run/Fail: Green | Active: Off | Standby: Green
Slot 08: Run/Fail: Green | Active: Green | Standby: Off
Status: Green | Service: Off |
Slot 09: Run/Fail: Green | Active: Off | Standby: Green
Status: Green | Service: Off |
Slot 12: Run/Fail: Green | Active: Green | Standby: Off
Slot 14: Run/Fail: Green | Active: Green | Standby: Off
Slot 17: Run/Fail: Green | Active: Green | Standby: Off
Slot 24: Run/Fail: Green | Active: Green | Standby: Off
Slot 25: Run/Fail: Green | Active: Off | Standby: Green
Slot 30: Run/Fail: Green | Active: Green | Standby: Off
Slot 33: Run/Fail: Green | Active: Off | Standby: Off
Slot 40: Run/Fail: Green | Active: Green | Standby: Off
The status of the two Power Filter Units (PFUs) can be viewed by entering the show power chassis command
in the Exec mode.
Checking the LED on the PFU
Each PFU has a single status LED labeled POWER.
This LED should be green for normal operating conditions.
Figure 1: PFU LED Location
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information below to diagnose the problem.
ASR 5000 System Administration Guide, StarOS Release 21.2
2
Troubleshooting
Using the CLI to View Status LEDs

Table 1: PFU POWER LED States
TroubleshootingDescriptionColor
None needed.PFU powered with no errors
detected
Green
Verify that the power switch is in the ON position.PFU is not receiving powerNone
Verify that the RTN and -VDC lugs are attached properly.
Verify that the ground lug is attached properly. Verify that the power
source is on and is supplying the correct voltage and sufficient current.
Check the cables from the power source to the rack for continuity.
If a power distribution panel (PDP) is installed between the power
distribution frame (PDF) and the chassis, verify that the circuit breakers
are set to ON.
If a PDP is installed between the PDF and the chassis, check the cables
from the PDP to the chassis for continuity.
If all of the above suggestions have been verified, then it is likely that
the PFU is not functional. Please contact your service representative.
Checking the LEDs on the SMC
Each SMC is equipped with the following LEDs as shown in the accompanying figure:
•Run/Fail
•Active
•Standby
•Status
•Service
ASR 5000 System Administration Guide, StarOS Release 21.2
3
Troubleshooting
Checking the LEDs on the SMC

•Busy
Figure 2: SMC LEDs
The possible states for all SMC LEDs are described in the sections that follow.
SMC Run/Fail LED States
The SMC Run/Fail LED indicates the overall status of the card. This LED should be green for normal
operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
ASR 5000 System Administration Guide, StarOS Release 21.2
4
Troubleshooting
Checking the LEDs on the SMC

Table 2: SMC Run/Fail LED States
TroubleshootingDescriptionColor
None needed.Card powered with no errors
detected.
Green
This is normal operation during boot-up.Card is initializing and/or
loading software.
Blinking Green
Errors were detected during the Power On Self Tests (POSTs). It is likely that
the errors were logged to the command line interface during boot. Refer to one
or more of the following to help analyze this problem.
Card powered with error(s)
detected.
Red
Monitoring the System for show commands, the outputs of which will assist in
further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status and alarm
conditions.
Verify that the POWER LEDs on the PFUs are green. If they are not, check the
PFU power feeds.
Card is not receiving power.None
Verify that the power source is supplying ample voltage and current to the
chassis.
Verify that the card is properly installed per the instructions in the ASR 5000
Installation Guide.
If all of the above suggestions have been verified, it is possible that the SMC is
not functional. Please contact your service representative.
SMC Active LED States
The Active LED on the SMC indicates that the software is loaded on the card and it is ready for operation.
For the SMC installed in chassis slot 8, this LED should be green for normal operation. For the SMC installed
in slot 9, this LED should be off for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 3: SMC Active LED States
TroubleshootingDescriptionColor
None needed for the SMC in slot 8. If green for the SMC in slot 9, verify that
the SMC in slot 8 is installed properly according to the instructions in this
document.
Card is active.Green
ASR 5000 System Administration Guide, StarOS Release 21.2
5
Troubleshooting
Checking the LEDs on the SMC

TroubleshootingDescriptionColor
Verify that the Standby LED on the redundant SMC is also blinking green. If
so, there is an issue with the active SMC. Refer to one or more of the following
to help analyze this problem.
Tasks or processes are being
migrated from the active SMC
to the redundant/secondary
SMC.
Blinking Green
Monitoring the System for show commands, the outputs of which will assist in
further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status and alarm
conditions.
Verify that the Run/Fail LED is green. If so, the card is receiving power and
POST test results are positive. If it is off, the card is not receiving power.
Card is not receiving power
OR
Card is in Standby Mode.
None
Check the state of the Standby LED. If it is green, the card is in standby mode.
If needed, refer to the Configuring Packet Processing Card and Line Card
Availability section of System Settings for information on making the card active.
SMC Standby LED States
The Standby LED on the SMC indicates that software is loaded on the card, but it is serving as a redundant
component. For the SMC installed in slot 9, this LED should be green for normal operation. For the SMC
installed in slot 8, this LED should be off for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 4: SMC Standby LED States
TroubleshootingDescriptionColor
None needed for the SMC in slot 9. If green for the SMC in slot 8, then verify
it is installed properly according to the instructions in this document.
Card is in redundant mode.Green
Verify that the Active LED on the redundant SMC is also blinking green. If so,
there is an issue with the active SMC. Refer to one or more of the following to
help analyze this problem.
Tasks or processes are being
migrated from the active SMC
to the redundant/secondary
SMC.
Blinking Green
Monitoring the System for show commands, the outputs of which will assist in
further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status and alarm
conditions.
Verify that the Run/Fail LED is green. If so, the card is receiving power and
POST test results are positive. If it is off, the card is not receiving power.
Card is not receiving power.
OR
Card is in Active Mode.
None
Check the state of the Active LED. If it is green, the card is in active mode.
ASR 5000 System Administration Guide, StarOS Release 21.2
6
Troubleshooting
Checking the LEDs on the SMC

SMC Status LED States
The Status LEDs on the SMC indicate the status of system level hardware such as installed cards, fans, and
PFUs. This LED is green during normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information also provided to diagnose the problem.
Table 5: SMC Status LED States 3
TroubleshootingDescriptionColor
None needed.No system errors detected.Green
Check the Run/Fail LEDs for all installed application cards, and line cards. If
any are red or off, refer to the troubleshooting information in this chapter
pertaining to that device.
Failures detected.Red
Monitoring the System for show commands, the outputs of which will assist in
further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status and alarm
conditions.
Verify that the Run/Fail LED is green. If so, the card is receiving power and
POST test results are positive. If it is off, the card is not receiving power.
Card is not receiving power.None
SMC Service LED States
The Service LEDs on the SMCs indicate that the system requires maintenance or service (for example, the
system could not locate a a valid software image at boot-up, or a high temperature condition exists).
This LED is off during normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 6: SMC Service LED States
TroubleshootingDescriptionColor
Refer to one or more of the following to help analyze this problem.System requires maintenance
(fan filter, temperature warning,
PFU outage etc.).
Yellow
Monitoring the System for show commands, the outputs of which will assist in
further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status and alarm
conditions.
ASR 5000 System Administration Guide, StarOS Release 21.2
7
Troubleshooting
Checking the LEDs on the SMC

TroubleshootingDescriptionColor
No maintenance needed.Card is not receiving power.None
SMC Busy LED States
The Busy LEDs on the SMCs indicate that there is activity on one of their memory devices. Activity is
displayed for the following memory devices:
•CompactFlash module
•PCMCIA device
•Nand Flash (used to store SMC firmware).
•Hard Drive
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 7: SMC Busy LED States
TroubleshootingDescriptionColor
No maintenance needed.
NOTE: You should wait until this LED is off before removing the SMC from
the chassis. This practice ensures the integrity of all data being transferred to or
from the memory device.
Data is being read from/written
to one of the memory devices.
Green/ Blinking
Green
No maintenance needed.The memory devices are not in
use.
None
Checking the LEDs on the Packet Processing Cards
The ASR 5000 supports a variety of packet processing cards (PSCnand PPC). For detailed information about
the types of cards and their applications, refer to the ASR 5000 Installation Guide.
Each packet processing card is equipped with the status LEDs listed below:
•Run/Fail
•Active
•Standby
•Status
ASR 5000 System Administration Guide, StarOS Release 21.2
8
Troubleshooting
Checking the LEDs on the Packet Processing Cards

•Service
Figure 3: Packet Processing Card LEDs
The possible states for all packet processing card LEDs are described below.
Packet Processing Card Run/Fail LED States
The packet processing card Run/Fail LED indicates the overall status of the card. This LED should be green
for normal operation.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
ASR 5000 System Administration Guide, StarOS Release 21.2
9
Troubleshooting
Checking the LEDs on the Packet Processing Cards

Table 8: Packet Processing Card Run/Fail LED States
TroubleshootingDescriptionColor
None needed.Card powered with no
errors detected.
Green
None needed.Card is initializing and/or
loading software.
Blinking
Green
Errors were detected during the Power On Self Tests (POSTs).
It is likely that the errors were logged to the system's command
line interface during the boot process.
Card powered with
error(s) detected.
Red
Monitoring the System for show commands, the outputs of which
will assist in further determining the problem.
System Logs for information on how to view logs.
The SNMP MIB Reference for information on associated status
and alarm conditions.
Verify that the POWER LEDs on the PFUs are green. If they are
not, check the PFU power feeds.
Card is not receiving
power.
None
Verify that the power source is supplying ample voltage and
current to the chassis.
Verify that the card is properly installed per the instructions in
the ASR 5000 Installation Guide.
If all of the above suggestions have been verified, it is possible
that the packet processing card is not functional. Please contact
your service representative.
Packet Processing Card Active LED States
The Active LED on a packet processing card indicates that the software is loaded on the card and that the card
is ready for operation. When the system first boots up, all installed packet processing cards are booted into
standby mode. The system must then be configured as to which packet processing cards should serve as
redundant components (remain in standby mode) and which should function as active components.
The possible states for this LED are described in the following table. If the LED is not green, use the
troubleshooting information in the table to diagnose the problem.
Table 9: Packet Processing Card Active LED States
TroubleshootingDescriptionColor
The first time power is applied to the system, all of the packet processing cards
should be booted into the standby mode. Therefore, this LED should be off.
Card is active.Green
ASR 5000 System Administration Guide, StarOS Release 21.2
10
Troubleshooting
Checking the LEDs on the Packet Processing Cards