Cisco ASR 903 User manual

Cisco ASR 903 Router Design and Deployment
Guide
Version 1.0
Last Updated: September 11, 2013
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: [phone]
800 553-NETS (6387)
Fax: [phone]
Text Part Number: OL-30526-01

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL
STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY
OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED
WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED
WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public domain
version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH ALL
FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE
OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE
PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,
WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR
ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Cisco and the Cisco Logo are trademarks of Cisco Systems, Inc. and/or its affiliates in the U.S. and other countries. A listing of Cisco's trademarks can be found at
www.cisco.com/go/trademarks. Third party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership relationship
between Cisco and any other company.
Any Internet Protocol (IP) addresses and phone numbers used in this docume nt are not intended to be actual addresses and phone numbers. Any examples, command display
output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any u se of actual IP addresses or phone numbers in
illustrative content is unintentional and coincidental.
© 2013 Cisco Systems, Inc. All rights reserved.

CONTENTS
Introduction............................................................................................................................................... 6
Chapter 1 Cisco ASR 903 Chassis.................................................................7
Chapter 2 Layer 2 Solution.............................................................................8
Ethernet Flow Point (EFP) ....................................................................................................................... 8
Bridge Domain Interface with EFP, Sub-interface ................................................................................... 9
Ethernet Virtual Circuit using Regular EFPs............................................................................................ 9
Verifying Connectivity ........................................................................................................................ 12
Ethernet Virtual Circuit using Trunk EFP............................................................................................... 13
Verifying the Configuration................................................................................................................. 15
Layer 2 Protocol Peering........................................................................................................................ 16
Spanning-Tree Configuration................................................................................................................. 16
Verify Spanning-tree Configuration.................................................................................................... 17
Ethernet Port-channel............................................................................................................................ 18
G.8032.................................................................................................................................................... 21
Verifying G.8032................................................................................................................................ 30
Protection Switching .......................................................................................................................... 35
REP........................................................................................................................................................ 39
Verifying REP..................................................................................................................................... 41
Link Failover....................................................................................................................................... 42
Chapter 3 Basic MPLS VPN Configuration..................................................45
Configuration of OSPF and BFD............................................................................................................ 45
Verifying the Configuration................................................................................................................. 46
Configuration of BGP and VRF on PE Routers ..................................................................................... 47
CE Related Configuration on PE Routers.............................................................................................. 48
Configuration of CE Routers.................................................................................................................. 50
Verification of PE and CE Routers..................................................................................................... 52
Verifying the Routing Tables on CE Devices..................................................................................... 53
Chapter 4 Ethernet over MPLS.....................................................................55
Ethernet over MPLS using Ethernet Flow Point..................................................................................... 55

New l2vpn Commands........................................................................................................................... 57
Port mode by using Encapsulation Default............................................................................................ 58
Verify the L2VPN is up and running and CE1 can reach CE2, vice versa. ....................................... 59
Multi-segment Pseudowire..................................................................................................................... 59
Verifying Pseudowire......................................................................................................................... 60
Ethernet OAM......................................................................................................................................... 61
Connectivity Fault Management........................................................................................................ 61
Verify OAM......................................................................................................................................... 62
Chapter 5 Virtual Private LAN Service - VPLS ............................................65
Manually Provisioned VPLS................................................................................................................... 65
Verifying VC Neighbors...................................................................................................................... 66
VPLS –BGP Auto-discovery and LDP Signaling................................................................................... 67
Verifying VPLS Neighbors ................................................................................................................. 68
VPLS –BGP Auto-discovery and Signaling........................................................................................... 69
Verifying VPLS................................................................................................................................... 70
VPLS Hub-Spoke Configuration............................................................................................................. 71
H-VPLS with Ethernet Q-in-Q Access.................................................................................................... 72
H-VPLS with MPLS Access ................................................................................................................... 73
Chapter 6 TDM ...............................................................................................75
Optical Channel Mapping and Related Configuration............................................................................ 75
Circuit Emulation Service over Packet-Switched Network (CESoPSN) ................................................ 80
Verifying CEM.................................................................................................................................... 81
Structure-Agnostic TDM over Packet (SAToP)...................................................................................... 81
Verifying TDM PW ............................................................................................................................. 83
POS Configuration............................................................................................................................. 88
Verifying the Configuration................................................................................................................. 88
OC-3 SONET POS ............................................................................................................................ 89
OC-12 SDH POS............................................................................................................................... 90
OC-12 SONET POS .......................................................................................................................... 90
Chapter 7 MPLS TE Configuration...............................................................92
Basic Steps to Configure Traffic Engineering........................................................................................ 93
Dynamic TE Tunnel................................................................................................................................ 95
Explicit Path Configuration..................................................................................................................... 97
Explicit Path by using Affinity................................................................................................................. 98
Verify TE tunnel and Tunnel Path...................................................................................................... 99
Traffic Engineering Fast Reroute......................................................................................................... 101

Verifying Fast Reroute Configuration............................................................................................... 102
BFD Triggered TE Fast Reroute.......................................................................................................... 103
Verifying BFD Triggered Fast Reroute ............................................................................................ 104
Chapter 8 LFA & Remote LFA (rLFA).........................................................105
Configuration for LFA (with OSPF).................................................................................................. 106
Configuration for LFA (with ISIS)..................................................................................................... 106
Verifying LFA.................................................................................................................................... 106
Configuration for rLFA (with OSPF)................................................................................................. 107
Configuration for rLFA (with ISIS).................................................................................................... 107
Verifying rLFA .................................................................................................................................. 110
Chapter 9 BGP PIC & RFC3107 ..................................................................112
Configuration for BGP PIC (with OSPF).............................................................................................. 113
Verifying BGP PIC & RFC3107 ....................................................................................................... 120
Configuration for BGP PIC & RFC3107 (with ISIS) ............................................................................. 124
Chapter 10 QoS ..........................................................................................127
Chapter 11 Clocking...................................................................................130
Sync-E Configuration........................................................................................................................... 132
Verifying Clocking............................................................................................................................ 135
PTP Configuration................................................................................................................................ 138
Verifying PTP and Clock Synchronization....................................................................................... 140
Chapter 12 Cisco ASR 903 Software Upgrade.........................................143
Software Boot up options..................................................................................................................... 143
Consolidated package mode ........................................................................................................... 143
Sub package mode.......................................................................................................................... 144
ISSU One Shot Upgrade Overview...................................................................................................... 145
ISSU Preparation............................................................................................................................. 146
ISSU Procedure............................................................................................................................... 147
Appendix A References ..............................................................................147

Introduction
This document provides design guidance, and detailed configurations for deployment of the Cisco ASR 903 in
service provider carrier Ethernet and mobile backhaul network. The design guide examples are created to help
people who work on Cisco ASR 903 configuration.

Chapter 1 Cisco ASR 903 Chassis
The Cisco ASR 903 Router has the following hardware features:
•3-RU modular chassis designed for installation in a 300 mm European Telecommunications Standards Institute
(ETSI) cabinet
•Up to six interface modules
•Up to two Route Switch Processors (RSP)
•Up to two DC or AC power supply units
•One fan tray
Router# show platform
Chassis type: ASR-903
Slot Type State Insert time (ago)
--------- ------------------- ---------------- -----------------
0/0 A900-IMA8T ok 3d17h ! bottom slot, 8 CU
0/1 A900-IMA8S ok 3d17h ! 8 SFP ports IM
0/2 A900-IMA1X ok 3d17h ! 10GE IM
0/3 A900-IMA1X ok 3d17h
0/4 A900-IMA16D ok 3d17h ! 16 T1/E1 IM
0/5 A900-IMA4OS ok 3d17h ! top slot, OC-3 IM
R0 A903-RSP1A-55 ok, active 3d17h ! RSP R0, bottom RSP
R1 A903-RSP1A-55 ok, standby 3d17h ! RSP R1, top RSP
F0 ok, active 3d17h
F1 ok, standby 3d17h
P0 A900-PWR550-D ok 3d17h ! power supply
P1 A900-PWR550-D ok 3d17h
P2 A903-FAN ok 3d17h ! fan tray
Slot CPLD Version Firmware Version
--------- ------------------- ---------------------------------------
R0 11102133 15.3(2r)S
R1 11102133 15.3(2r)S
F0 11102133 15.3(2r)S
F1 11102133 15.3(2r)S

Layer 2 Solution
▀Ethernet Flow Point (EFP)
▄Cisco ASR 903 Router Design and Deployment Guide
8
OL-30526-01
Chapter 2 Layer 2 Solution
Ethernet Flow Point (EFP)
An Ethernet flow point (EFP) service instance is a logical interface that connects a bridge domain to a physical
port or to an EtherChannel group. An incoming frame is matched against EFP matching criteria on the interface,
learned on the matching EFP, and forwarded to one or more EFPs in the bridge domain. If there are no matching
EFPs, the frame is dropped. EFP is the building block for Ethernet Virtual Circuit, bridged EVC hop-by-hop,
EoMPLS or VPLS. An EFP can be viewed as switch access port but more powerful as it can manipulate the frames
by removing and imposing vlan tags. The following EFP matches incoming dot1q vlan 10, removes the vlan tag
and forwards into bridge-domain 10. On egress direction, a frame will be imposed vlan 10 before sending out on
the wire.
interface GigabitEthernet0/2/0
service instance 2 ethernet
encapsulation dot1q 10
rewrite ingress tag pop 1 symmetric
bridge-domain 10
Alternatively with new CLI, the above can also be configured as below. Note that the bridge-domain does not have
to be same as vlan tag and it has been purposely changed to 30 in the following example.
bridge-domain 30
member GigabitEthernet0/2/0 service-instance 2
interface GigabitEthernet0/2/0
service instance 2 ethernet
encapsulation dot1q 10
rewrite ingress tag pop 1 symmetric
Table 1. Encapsulation types
Encapsulation
Description
encapsulation untagged
Native Packets
encapsulation default
Catch-all Encap.
encasulationp priority-tagged
Dot1p Packets.
encapsulation dot1q any
All packets with one or more vlans
encapsulation dot1q vlan
Exact Outermost match.
encapsulation dot1q vlan (second-)dot1q vlan2
Exact Outermost two tags.
encapsulation dot1q range
Ranged Outermost match.
encapsulation dot1q range (second-)dot1q vlan2
Ranged Outermost match, exact second tag
encapsulation dot1q range (second-)dot1q range
Ranged Outermost two tags.
encapsulation dot1q vlan (second-)dot1q range
Exact Outermost match, ranged second tag
encapsulation dot1q vlan cos cos
Exact Outermost vlan, cos match.
encapsulation dot1q range cos cos (second-)dot1q range cos cos
Ranged combinations of outermost vlan and second tag

Layer 2 Solution
Bridge Domain Interface with EFP, Sub-interface ▀
Cisco ASR 903 Router Design and Deployment Guide▄
OL-30526-01
9
The following rewrite can be implemented on Cisco ASR 903.
•Pop 1, remove one vlan tag
•Pop 2, remove two vlan tags
•Push 1, impose one vlan tag
With the above push and pop function, vlan 1 to 1, 1 to 2, 2 to 1, and 2 to 2 mapping can be achieved.
Bridge Domain Interface with EFP, Sub-interface
The Cisco ASR 903 router does not support sub-interfaces as on the other Cisco platforms but a workaround can
be used by pairing an Ethernet flow point (EFP) with a bridge domain interface (BDI).
•BDI is similar to SVI on the switch.
•At least one EFP must be associated with BDI to have line protocol up.
•EFP must make the packet native, one tag or two tags popping may be needed.
•Bridge-domain interface supports routing.
•Symmetric keyworld is required for push or pop operation.
The following shows an example how to create “sub-interface”off the interface of Gigabit Ethernet 0/2/0 on Cisco
ASR 903 router. The EFP will match encapsulation with vlan tag 10, pop the dot1q header in ingress direction,
forward the packet into bridge-domain 10 (think BD as Vlan domain as on the switch).
interface Gi0/2/0
! create an EFP instance
service instance 1 ethernet
encapsulation dot1q 10
rewrite ingress tag pop 1 symmetric ! pop is required to make packet native
bridge-domain 10
interface BDI10 ! BDI 10 is associated with bridge
ip address 10.10.10.1 255.255.255.0 ! domain 10
The above example is equivalent to the sub-interface on the other platforms. Note that Vlan command is not
required for create vlan to make BDI active on the Cisco ASR 903 router.
interface gigabitEthernet0/0/0/1.10
encapsulation dot1q 10
ip address 10.10.10.1 255.255.255.0
Ethernet Virtual Circuit using Regular EFPs
Here is a design example to provide end-to-end connectivity between CEs by using Ethernet bridging. For
illustration purpose, two subnets of A and B, are created to demonstrate connectivity. On CE1 router, vlan tag 10
and 11 are used; vlan tag 15 and 16 are used on CE2 router.

Layer 2 Solution
▀Ethernet Virtual Circuit using Regular EFPs
▄Cisco ASR 903 Router Design and Deployment Guide
10
OL-30526-01
Figure 1. Ethernet Virtual Circuit with Regular EFPs
ASR903-PE2
Gi0/1/2 Gi0/1/2
Gi0/1/0 Gi0/1/2Gi0/1/0Gi0/1/1
ASR903-PE1ASR903-CE1
Customer A
Site 1
ASR903-CE2
172.16.11.0/24 - SubnetB 172.16.11.0/24 –SubnetB
Customer A
Site 2
10 10 10
20 11
15 15
11 20 11
10
11 16 16
172.16.10.0/24 - SubnetA 172.16.10.0/24 –SubnetA
ASR903-CE1 Configuration
bridge-domain 10
member GigabitEthernet0/1/1 service-instance 10
!
bridge-domain 11
member GigabitEthernet0/1/1 service-instance 11
!
interface GigabitEthernet0/1/1
no ip address
negotiation auto
service instance 10 ethernet ! create service instance
encapsulation dot1q 10
rewrite ingress tag pop 1 symmetric ! to use BDI, pop is required.
! ! otherwise rewrite may not be needed.
service instance 11 ethernet
encapsulation dot1q 11
rewrite ingress tag pop 1 symmetric
!
interface BDI10 ! subnet A
ip address 172.16.10.1 255.255.255.0
!
interface BDI11 ! subnet B
ip address 172.16.11.1 255.255.255.0
ASR903-PE1 Configuration
bridge-domain 10 ! bridge-domain 10
member GigabitEthernet0/1/0 service-instance 10 ! vlan tag 10 for CE subnet A
member GigabitEthernet0/1/2 service-instance 10
!
bridge-domain 11
member GigabitEthernet0/1/0 service-instance 11 ! vlan tag 11 for CE1 subnet B
member GigabitEthernet0/1/2 service-instance 11
!
interface GigabitEthernet0/1/0
description interface to CE1
no ip address
negotiation auto
service instance 10 ethernet