Brocade Communications Systems 6505 Service manual

53-1002474-01
15 December 2011
®
Fabric OS FCIP
Administrator’s Guide
Supporting Fabric OS v7.0.1

Copyright © 2009-2011 Brocade Communications Systems, Inc. All Rights Reserved.
Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, NetIron, SAN Health, ServerIron, and TurboIron are registered
trademarks, and Brocade Assurance, Brocade NET Health, Brocade One, CloudPlex, MLX, VCS, VDX, and When the Mission Is
Critical, the Network Is Brocade are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other
countries. Other brands, products, or service names mentioned are or may be trademarks or service marks of their respective
owners.
Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning
any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to
this document at any time, without notice, and assumes no responsibility for its use. This informational document describes
features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.
Export of technical data contained in this document may require an export license from the United States government.
The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with
respect to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that
accompany it.
The product described by this document may contain “open source” software covered by the GNU General Public License or other
open source license agreements. To find out which open source software is included in Brocade products, view the licensing
terms applicable to the open source software, and obtain a copy of the programming source code, please visit
http://www.brocade.com/support/oscd.
Brocade Communications Systems, Incorporated
Corporate and Latin American Headquarters
Brocade Communications Systems, Inc.
130 Holger Way
San Jose, CA 95134
Tel: [phone]
Fax: [phone]
E-mail: [e-mail]
Asia-Pacific Headquarters
Brocade Communications Systems China HK, Ltd.
No. 1 Guanghua Road
Chao Yang District
Units 2718 and 2818
Beijing 100020, China
Tel: [phone]
Fax: [phone]
E-mail: [email protected]
European Headquarters
Brocade Communications Switzerland Sàrl
Centre Swissair
Tour B - 4ème étage
29, Route de l'Aéroport
Case Postale 105
CH-1215 Genève 15
Switzerland
Tel: [phone]
Fax: [phone]
E-mail: [e-mail]
Asia-Pacific Headquarters
Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)
Citic Plaza
No. 233 Tian He Road North
Unit 1308 – 13th Floor
Guangzhou, China
Tel: [phone]
Fax: [phone]
E-mail: [email protected]

Fabric OS FCIP Administrator’s Guide iii
53-1002474-01
Document History
Title Publication number Summary of changes Date
Fabric OS FCIP Administrator’s Guide 53-1001349-01 New document. July 2009
Fabric OS FCIP Administrator’s Guide 53-1001349-02 Various changes and
corrections.
October 2009
Fabric OS FCIP Administrator’s Guide 53-1001755-01 New document for Fabric OS
version 6.3.1.
January 2010
Fabric OS FCIP Administrator’s Guide 53-1001766-01 New document for Fabric OS
version 6.4.0.
March 2010
Fabric OS FCIP Administrator’s Guide 53-1002155-01 Updated document for
Fabric OS version 7.0.0.
April 2011
Fabric OS FCIP Administrator’s Guide 53-1002474-01 Updated document for
Fabric OS version 7.0.1.
December 2011

iv Fabric OS FCIP Administrator’s Guide
53-1002474-01

Fabric OS FCIP Administrator’s Guide v
53-1002474-01
Contents
About This Document
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
What’s new in this document. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Text formatting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Command syntax conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Notes, cautions, and warnings . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Key terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Brocade resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Other industry resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Getting technical help. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Chapter 1 FCIP Overview
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
FCIP platforms and supported features . . . . . . . . . . . . . . . . . . . . . . . 1
FCIP concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
IP WAN network considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2 FCIP on the 7800 Switch and FX8-24 Blade
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
7800 switch hardware overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
7800 switch license options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
VE_Ports and FCIP tunnels on the 7800 switch . . . . . . . . . . . . . 8
FCIP trunking capacity on the 7800 switch . . . . . . . . . . . . . . . . . 8
FX8-24 blade hardware overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Removing FX8-24 blades. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
FX8-24 blade license options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
VE_Ports and FCIP tunnels on the FX8-24 blade. . . . . . . . . . . . 10
FCIP trunking capacity on the FX8-24 blade . . . . . . . . . . . . . . . 11
10 GbE port considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

vi Fabric OS FCIP Administrator’s Guide
53-1002474-01
FCIP trunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Design for redundancy and fault tolerance . . . . . . . . . . . . . . . . 16
FCIP tunnel restrictions for FCP and FICON acceleration
features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
FCIP circuit failover capabilities . . . . . . . . . . . . . . . . . . . . . . . . . 17
Failover in TI zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Bandwidth calculation during failover . . . . . . . . . . . . . . . . . . . . 20
Adaptive Rate Limiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
FSPF link cost calculation when ARL is used. . . . . . . . . . . . . . . 21
QoS SID/DID priorities over an FCIP trunk . . . . . . . . . . . . . . . . . . . . 21
QoS, DSCP, and VLANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
VLANs and Layer 2 Quality of Service. . . . . . . . . . . . . . . . . . . . . 24
When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 25
DSCP and VLAN support on FCIP circuits. . . . . . . . . . . . . . . . . .25
Managing the VLAN tag table . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Compression options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
IPsec implementation over FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . 28
Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 29
IPsec for the 7800 switch and FX8-24 blade. . . . . . . . . . . . . . .29
Enabling IPsec and IKE policies . . . . . . . . . . . . . . . . . . . . . . . . . 30
Open Systems Tape Pipelining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . . 30
Support for IPv6 addressing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
IPv6 with embedded IPv4 addresses . . . . . . . . . . . . . . . . . . . . .33
Configuration preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Configuration steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Setting VE_Ports to persistently disabled state . . . . . . . . . . . . .34
Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Enabling XISL for VE_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Configuring the media type for GbE ports 0 and 1 (7800
switch only). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Setting the GbE port operating mode (FX8-24 blade only) . . . .35
Configuring a GbE or XGE port IP address . . . . . . . . . . . . . . . . . 36
Configuring an IP route . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Validating IP connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Creating an FCIP tunnel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Creating additional FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . .44
Verifying the FCIP tunnel configuration on the Brocade 7800
FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Enabling persistently disabled ports on the Brocade 7800
FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Creating a multicircuit tunnel (example) . . . . . . . . . . . . . . . . . . . . . .46
Modifying an FCIP tunnel on a Brocade 7800 FX8-24 blade. . . . . .49
Modifying an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . .49
Deleting an IP interface on a Brocade 7800 FX8-24 blade . . . . . . . 50

Fabric OS FCIP Administrator’s Guide vii
53-1002474-01
Deleting an IP route on a Brocade 7800 FX8-24 blade . . . . . . . . . . 50
Deleting an FCIP tunnel on a Brocade 7800 FX8-24 blade . . . . . . . 50
Deleting an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . . . 51
Virtual Fabrics and the Brocade 7800 FX8-24 blade. . . . . . . . . . . . 51
Port sharing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Chapter 3 FCIP on the FR4-18i Blade
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
FR4-18i blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
FR4-18i blade ports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
FCIP design considerations for the FR4-18i blade . . . . . . . . . . . . . .55
Virtual port types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Compression on FCIP tunnels . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Traffic shaping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
FCIP services license . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
QoS implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
L2CoS Quality of Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58
When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 58
IPsec implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 59
Configuring IPsec . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59
IPsec parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Creating an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61
Displaying IKE and IPsec policy settings . . . . . . . . . . . . . . . . . . 61
Deleting an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61
Viewing IPsec information for an FCIP tunnel . . . . . . . . . . . . . . 62
Virtual Fabrics and FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Options for enhancing tape I/O performance . . . . . . . . . . . . . . . . . .63
FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . .64
Unsupported configurations for Fastwrite and OSTP . . . . . . . .65
FCIP services configuration guidelines . . . . . . . . . . . . . . . . . . . . . . .66
Setting persistently disabled ports . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Creating IP interfaces and routes . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Creating an FCIP tunnel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69
Verifying the FCIP tunnel configuration on the Brocade FR4-18i . . 69
Enabling persistently disabled ports on the Brocade 7500 FR4-18i70
Managing FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70
Modifying and deleting QoS settings . . . . . . . . . . . . . . . . . . . . . 71
Deleting an FCIP tunnel on a Brocade 7500 FR4-18i. . . . . . . . 71
Deleting an IP route on a Brocade 7500 FR4-18i . . . . . . . . . . .72
Deleting an IP interface on a Brocade 7500 FR4-18i. . . . . . . . 72

viii Fabric OS FCIP Administrator’s Guide
53-1002474-01
Managing the VLAN tag table. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Chapter 4 FCIP Management and Troubleshooting
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Inband management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
IP routing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Configuring IP addresses and routes . . . . . . . . . . . . . . . . . . . . . 74
VLAN tagging support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78
IP forwarding support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
WAN performance analysis tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
The tperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
The ipperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .82
Ipperf performance statistics . . . . . . . . . . . . . . . . . . . . . . . . . . .83
Starting an ipperf session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Ipperf options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
Using ping to test a connection. . . . . . . . . . . . . . . . . . . . . . . . . . 84
Using traceroute. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
Portshow command usage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying IP interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Displaying IP routes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying FCIP tunnel information. . . . . . . . . . . . . . . . . . . . . . .85
Displaying IP addresses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying performance statistics. . . . . . . . . . . . . . . . . . . . . . . . 86
Displaying FCIP tunnel information (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .86
Displaying an FCIP tunnel with FCIP circuit information
(7800 switch and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . .86
Displaying FCIP tunnel performance (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP tunnel TCP connections (7800 switch
and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP circuits (7800 switch and FX8-24 blade) . . . . 87
Displaying a single circuit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP circuit performance (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying QoS prioritization for a circuit . . . . . . . . . . . . . . . . . .88
Displaying FCIP tunnel information (FR4-18i blade) . . . . . . . . .88
FCIP tunnel issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
FCIP links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Gathering additional information . . . . . . . . . . . . . . . . . . . . . . . . 90
FTRACE concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Index

Fabric OS FCIP Administrator’s Guide ix
53-1002474-01
About This Document
In this chapter
•How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
•Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
•What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
•Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
•Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
•Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
•Getting technical help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
•Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
How this document is organized
.This document is organized to help you find the information that you want as quickly and easily as
possible. It contains the following components:
•Chapter 1, “FCIP Overview” describes FCIP concepts and features.
•Chapter 2, “FCIP on the 7800 Switch and FX8-24 Blade” describes FCIP tunnel and trunking
configuration options for the 7800 switch and FX8-24 blade.
•Chapter 3, “FCIP on the FR4-18i Blade” describes FCIP tunnel configuration options for the
FR4-18i blade.
•Chapter 4, “FCIP Management and Troubleshooting” describes FCIP management and
troubleshooting operations.
Supported hardware and software
The following hardware platforms support FCIP as described in this manual:
•Brocade DCX, DCX 8510-8, DCX-4S, and DCX 8510-4 with one or more FX8-24 blades
•Brocade 7800 switch
•Brocade DCX and DCX-4S with one or more FR4-18i blades
NOTE
FR4-18i blades are not supported on the16 Gbps DCX 8510-8 and DCX 8510-4 models.

xFabric OS FCIP Administrator’s Guide
53-1002474-01
What’s new in this document
Major new additions or deletions in this document support the following:
•Preface. Added location of serial number label for the Brocade 6505 switch.
•Chapter 1
-Added support for printer emulation in Table 1, “FCIP capabilities by platform,” under the
FICON extension row and referenced statement that this is not supported on FR4-18i
blades.
-Added note under “FCIP platforms and supported features” that FCIP connections are not
supported between the 7800 switch or FX8-24 blades and previous generation Brocade
7500 switches or FR4-18i blades.
•Chapter 2
-Under “7800 switch hardware overview,” added the following notes:
•Copper ports do not support auto-sense functions.
•With copper media, auto-negotiation must be enabled on the other end of the port
connection. 1 Gbps is the only negotiated speed.
-Under 7800 switch license options” and “FX8-24 blade license options,” added FICON
printer emulation to the list of features enabled by the Advanced FICON Acceleration
License. Also added printer and other emulation features to the Advanced FICON
Acceleration License row of Table 2, “7800 FCIP feature licenses” and Table 3, “FX8-24
blade license options.”
-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels
on the FX8-24 blade” added the following note:
-VE_Ports or VEX_Ports cannot connect to the same domain at the same time as Fibre
Channel E_Ports or EX_Ports.
-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels
on the FX8-24 blade” a note was added concerning VE_Ports.
-Under “FCIP tunnel restrictions for FCP and FICON acceleration features,” added
restrictions about FCIP tunnels not supporting DPS and that both ends of the FICON
emulating tunnel must run Fabric OS v7.0 or later if one end of tunnel runs v7.0 or later.
-Under “FCIP circuit failover capabilities, added “Failover in TI zones” section.
-Under “Limitations using IPsec over FCIP tunnels,” added limitation that IPsec is not
supported on VE group 12-21 on FX8-24 blades and that to enable IPsec with Fabric OS
v7.0 and later, both ends of the tunnel must use v7.0 and later.
-Added timeout value information under the “keep-alive timeout” option.
-Under “Creating Additional FCIP circuits,” added note about adding additional circuits to
an active tunnel when multiple FCIP tunnels are present.
-Added notes under the “Setting the GbE port operating mode (FX8-24 blade only)” section.
•Chapter 4
-Under “Inband management,” added that the following functions are not supported by the
inband management interface:
•Downloading firmware
•IPv6 addressing