Brocade Communications Systems 6505 Service manual

53-1002474-01
15 December 2011
®
Fabric OS FCIP
Administrator’s Guide
Supporting Fabric OS v7.0.1

Copyright © 2009-2011 Brocade Communications Systems, Inc. All Rights Reserved.
Brocade, the B-wing symbol, BigIron, DCX, Fabric OS, FastIron, NetIron, SAN Health, ServerIron, and TurboIron are registered
trademarks, and Brocade Assurance, Brocade NET Health, Brocade One, CloudPlex, MLX, VCS, VDX, and When the Mission Is
Critical, the Network Is Brocade are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other
countries. Other brands, products, or service names mentioned are or may be trademarks or service marks of their respective
owners.
Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning
any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to
this document at any time, without notice, and assumes no responsibility for its use. This informational document describes
features that may not be currently available. Contact a Brocade sales office for information on feature and product availability.
Export of technical data contained in this document may require an export license from the United States government.
The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with
respect to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that
accompany it.
The product described by this document may contain “open source” software covered by the GNU General Public License or other
open source license agreements. To find out which open source software is included in Brocade products, view the licensing
terms applicable to the open source software, and obtain a copy of the programming source code, please visit
http://www.brocade.com/support/oscd.
Brocade Communications Systems, Incorporated
Corporate and Latin American Headquarters
Brocade Communications Systems, Inc.
130 Holger Way
San Jose, CA 95134
Tel: [phone]
Fax: [phone]
E-mail: [e-mail]
Asia-Pacific Headquarters
Brocade Communications Systems China HK, Ltd.
No. 1 Guanghua Road
Chao Yang District
Units 2718 and 2818
Beijing 100020, China
Tel: [phone]
Fax: [phone]
E-mail: [email protected]
European Headquarters
Brocade Communications Switzerland Sàrl
Centre Swissair
Tour B - 4ème étage
29, Route de l'Aéroport
Case Postale 105
CH-1215 Genève 15
Switzerland
Tel: [phone]
Fax: [phone]
E-mail: [e-mail]
Asia-Pacific Headquarters
Brocade Communications Systems Co., Ltd. (Shenzhen WFOE)
Citic Plaza
No. 233 Tian He Road North
Unit 1308 – 13th Floor
Guangzhou, China
Tel: [phone]
Fax: [phone]
E-mail: [email protected]

Fabric OS FCIP Administrator’s Guide iii
53-1002474-01
Document History
Title Publication number Summary of changes Date
Fabric OS FCIP Administrator’s Guide 53-1001349-01 New document. July 2009
Fabric OS FCIP Administrator’s Guide 53-1001349-02 Various changes and
corrections.
October 2009
Fabric OS FCIP Administrator’s Guide 53-1001755-01 New document for Fabric OS
version 6.3.1.
January 2010
Fabric OS FCIP Administrator’s Guide 53-1001766-01 New document for Fabric OS
version 6.4.0.
March 2010
Fabric OS FCIP Administrator’s Guide 53-1002155-01 Updated document for
Fabric OS version 7.0.0.
April 2011
Fabric OS FCIP Administrator’s Guide 53-1002474-01 Updated document for
Fabric OS version 7.0.1.
December 2011

iv Fabric OS FCIP Administrator’s Guide
53-1002474-01

Fabric OS FCIP Administrator’s Guide v
53-1002474-01
Contents
About This Document
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Supported hardware and software . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
What’s new in this document. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Text formatting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Command syntax conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Notes, cautions, and warnings . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Key terms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Brocade resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Other industry resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Getting technical help. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
Chapter 1 FCIP Overview
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
FCIP platforms and supported features . . . . . . . . . . . . . . . . . . . . . . . 1
FCIP concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
IP WAN network considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2 FCIP on the 7800 Switch and FX8-24 Blade
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
7800 switch hardware overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
7800 switch license options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
VE_Ports and FCIP tunnels on the 7800 switch . . . . . . . . . . . . . 8
FCIP trunking capacity on the 7800 switch . . . . . . . . . . . . . . . . . 8
FX8-24 blade hardware overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Removing FX8-24 blades. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
FX8-24 blade license options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
VE_Ports and FCIP tunnels on the FX8-24 blade. . . . . . . . . . . . 10
FCIP trunking capacity on the FX8-24 blade . . . . . . . . . . . . . . . 11
10 GbE port considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

vi Fabric OS FCIP Administrator’s Guide
53-1002474-01
FCIP trunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Design for redundancy and fault tolerance . . . . . . . . . . . . . . . . 16
FCIP tunnel restrictions for FCP and FICON acceleration
features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
FCIP circuit failover capabilities . . . . . . . . . . . . . . . . . . . . . . . . . 17
Failover in TI zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20
Bandwidth calculation during failover . . . . . . . . . . . . . . . . . . . . 20
Adaptive Rate Limiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
FSPF link cost calculation when ARL is used. . . . . . . . . . . . . . . 21
QoS SID/DID priorities over an FCIP trunk . . . . . . . . . . . . . . . . . . . . 21
QoS, DSCP, and VLANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
VLANs and Layer 2 Quality of Service. . . . . . . . . . . . . . . . . . . . . 24
When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 25
DSCP and VLAN support on FCIP circuits. . . . . . . . . . . . . . . . . .25
Managing the VLAN tag table . . . . . . . . . . . . . . . . . . . . . . . . . . .26
Compression options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28
IPsec implementation over FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . 28
Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 29
IPsec for the 7800 switch and FX8-24 blade. . . . . . . . . . . . . . .29
Enabling IPsec and IKE policies . . . . . . . . . . . . . . . . . . . . . . . . . 30
Open Systems Tape Pipelining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30
FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . . 30
Support for IPv6 addressing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
IPv6 with embedded IPv4 addresses . . . . . . . . . . . . . . . . . . . . .33
Configuration preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Configuration steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Setting VE_Ports to persistently disabled state . . . . . . . . . . . . .34
Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .34
Enabling XISL for VE_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Configuring the media type for GbE ports 0 and 1 (7800
switch only). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Setting the GbE port operating mode (FX8-24 blade only) . . . .35
Configuring a GbE or XGE port IP address . . . . . . . . . . . . . . . . . 36
Configuring an IP route . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
Validating IP connectivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .38
Creating an FCIP tunnel. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Creating additional FCIP circuits . . . . . . . . . . . . . . . . . . . . . . . .44
Verifying the FCIP tunnel configuration on the Brocade 7800
FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Enabling persistently disabled ports on the Brocade 7800
FX8-24 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Creating a multicircuit tunnel (example) . . . . . . . . . . . . . . . . . . . . . .46
Modifying an FCIP tunnel on a Brocade 7800 FX8-24 blade. . . . . .49
Modifying an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . .49
Deleting an IP interface on a Brocade 7800 FX8-24 blade . . . . . . . 50

Fabric OS FCIP Administrator’s Guide vii
53-1002474-01
Deleting an IP route on a Brocade 7800 FX8-24 blade . . . . . . . . . . 50
Deleting an FCIP tunnel on a Brocade 7800 FX8-24 blade . . . . . . . 50
Deleting an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . . . 51
Virtual Fabrics and the Brocade 7800 FX8-24 blade. . . . . . . . . . . . 51
Port sharing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Chapter 3 FCIP on the FR4-18i Blade
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
FR4-18i blade . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .54
FR4-18i blade ports. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
FCIP design considerations for the FR4-18i blade . . . . . . . . . . . . . .55
Virtual port types . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Compression on FCIP tunnels . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Traffic shaping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
FCIP services license . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
QoS implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
DSCP Quality of Service. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
L2CoS Quality of Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .58
When both DSCP and L2CoS are used. . . . . . . . . . . . . . . . . . . . 58
IPsec implementation over FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Limitations using IPsec over FCIP tunnels . . . . . . . . . . . . . . . . . 59
Configuring IPsec . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .59
IPsec parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .60
Creating an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61
Displaying IKE and IPsec policy settings . . . . . . . . . . . . . . . . . . 61
Deleting an IKE and IPsec policy . . . . . . . . . . . . . . . . . . . . . . . . 61
Viewing IPsec information for an FCIP tunnel . . . . . . . . . . . . . . 62
Virtual Fabrics and FCIP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Options for enhancing tape I/O performance . . . . . . . . . . . . . . . . . .63
FCIP Fastwrite and OSTP configurations . . . . . . . . . . . . . . . . . .64
Unsupported configurations for Fastwrite and OSTP . . . . . . . .65
FCIP services configuration guidelines . . . . . . . . . . . . . . . . . . . . . . .66
Setting persistently disabled ports . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Configuring VEX_Ports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Creating IP interfaces and routes . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Creating an FCIP tunnel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .69
Verifying the FCIP tunnel configuration on the Brocade FR4-18i . . 69
Enabling persistently disabled ports on the Brocade 7500 FR4-18i70
Managing FCIP tunnels. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70
Modifying and deleting QoS settings . . . . . . . . . . . . . . . . . . . . . 71
Deleting an FCIP tunnel on a Brocade 7500 FR4-18i. . . . . . . . 71
Deleting an IP route on a Brocade 7500 FR4-18i . . . . . . . . . . .72
Deleting an IP interface on a Brocade 7500 FR4-18i. . . . . . . . 72

viii Fabric OS FCIP Administrator’s Guide
53-1002474-01
Managing the VLAN tag table. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Chapter 4 FCIP Management and Troubleshooting
In this chapter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
Inband management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .73
IP routing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Configuring IP addresses and routes . . . . . . . . . . . . . . . . . . . . . 74
VLAN tagging support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .78
IP forwarding support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
WAN performance analysis tools . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
The tperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
The ipperf option . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .82
Ipperf performance statistics . . . . . . . . . . . . . . . . . . . . . . . . . . .83
Starting an ipperf session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Ipperf options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
Using ping to test a connection. . . . . . . . . . . . . . . . . . . . . . . . . . 84
Using traceroute. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .84
Portshow command usage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying IP interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
Displaying IP routes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying FCIP tunnel information. . . . . . . . . . . . . . . . . . . . . . .85
Displaying IP addresses. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .85
Displaying performance statistics. . . . . . . . . . . . . . . . . . . . . . . . 86
Displaying FCIP tunnel information (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .86
Displaying an FCIP tunnel with FCIP circuit information
(7800 switch and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . .86
Displaying FCIP tunnel performance (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP tunnel TCP connections (7800 switch
and FX8-24 blade) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP circuits (7800 switch and FX8-24 blade) . . . . 87
Displaying a single circuit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying FCIP circuit performance (7800 switch and
FX8-24 blade). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Displaying QoS prioritization for a circuit . . . . . . . . . . . . . . . . . .88
Displaying FCIP tunnel information (FR4-18i blade) . . . . . . . . .88
FCIP tunnel issues. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .88
FCIP links . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Gathering additional information . . . . . . . . . . . . . . . . . . . . . . . . 90
FTRACE concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91
Index

Fabric OS FCIP Administrator’s Guide ix
53-1002474-01
About This Document
In this chapter
•How this document is organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
•Supported hardware and software. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
•What’s new in this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
•Document conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
•Notice to the reader . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
•Additional information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
•Getting technical help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
•Document feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiv
How this document is organized
.This document is organized to help you find the information that you want as quickly and easily as
possible. It contains the following components:
•Chapter 1, “FCIP Overview” describes FCIP concepts and features.
•Chapter 2, “FCIP on the 7800 Switch and FX8-24 Blade” describes FCIP tunnel and trunking
configuration options for the 7800 switch and FX8-24 blade.
•Chapter 3, “FCIP on the FR4-18i Blade” describes FCIP tunnel configuration options for the
FR4-18i blade.
•Chapter 4, “FCIP Management and Troubleshooting” describes FCIP management and
troubleshooting operations.
Supported hardware and software
The following hardware platforms support FCIP as described in this manual:
•Brocade DCX, DCX 8510-8, DCX-4S, and DCX 8510-4 with one or more FX8-24 blades
•Brocade 7800 switch
•Brocade DCX and DCX-4S with one or more FR4-18i blades
NOTE
FR4-18i blades are not supported on the16 Gbps DCX 8510-8 and DCX 8510-4 models.

xFabric OS FCIP Administrator’s Guide
53-1002474-01
What’s new in this document
Major new additions or deletions in this document support the following:
•Preface. Added location of serial number label for the Brocade 6505 switch.
•Chapter 1
-Added support for printer emulation in Table 1, “FCIP capabilities by platform,” under the
FICON extension row and referenced statement that this is not supported on FR4-18i
blades.
-Added note under “FCIP platforms and supported features” that FCIP connections are not
supported between the 7800 switch or FX8-24 blades and previous generation Brocade
7500 switches or FR4-18i blades.
•Chapter 2
-Under “7800 switch hardware overview,” added the following notes:
•Copper ports do not support auto-sense functions.
•With copper media, auto-negotiation must be enabled on the other end of the port
connection. 1 Gbps is the only negotiated speed.
-Under 7800 switch license options” and “FX8-24 blade license options,” added FICON
printer emulation to the list of features enabled by the Advanced FICON Acceleration
License. Also added printer and other emulation features to the Advanced FICON
Acceleration License row of Table 2, “7800 FCIP feature licenses” and Table 3, “FX8-24
blade license options.”
-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels
on the FX8-24 blade” added the following note:
-VE_Ports or VEX_Ports cannot connect to the same domain at the same time as Fibre
Channel E_Ports or EX_Ports.
-Under “VE_Ports and FCIP tunnels on the 7800 switch” and “VE_Ports and FCIP tunnels
on the FX8-24 blade” a note was added concerning VE_Ports.
-Under “FCIP tunnel restrictions for FCP and FICON acceleration features,” added
restrictions about FCIP tunnels not supporting DPS and that both ends of the FICON
emulating tunnel must run Fabric OS v7.0 or later if one end of tunnel runs v7.0 or later.
-Under “FCIP circuit failover capabilities, added “Failover in TI zones” section.
-Under “Limitations using IPsec over FCIP tunnels,” added limitation that IPsec is not
supported on VE group 12-21 on FX8-24 blades and that to enable IPsec with Fabric OS
v7.0 and later, both ends of the tunnel must use v7.0 and later.
-Added timeout value information under the “keep-alive timeout” option.
-Under “Creating Additional FCIP circuits,” added note about adding additional circuits to
an active tunnel when multiple FCIP tunnels are present.
-Added notes under the “Setting the GbE port operating mode (FX8-24 blade only)” section.
•Chapter 4
-Under “Inband management,” added that the following functions are not supported by the
inband management interface:
•Downloading firmware
•IPv6 addressing

Fabric OS FCIP Administrator’s Guide xi
53-1002474-01
Document conventions
This section describes text formatting conventions and important notice formats used in this
document.
Text formatting
The narrative-text formatting conventions that are used are as follows:
bold text Identifies command names
Identifies the names of user-manipulated GUI elements
Identifies keywords and operands
Identifies text to enter at the GUI or CLI
italic text Provides emphasis
Identifies variables
Identifies paths and Internet addresses
Identifies document titles
code text Identifies CLI output
Identifies command syntax examples
For readability, command names in the narrative portions of this guide are presented in mixed
lettercase: for example, switchShow. In actual examples, command lettercase is often all
lowercase. Otherwise, this manual specifically notes those cases in which a command is
case-sensitive.
Command syntax conventions
Command syntax in this manual follows these conventions:
command Commands are printed in bold.
--option, option Command options are printed in bold.
-argument, arg Arguments.
[ ] Optional element.
variable Variables are printed in italics. In the help pages, variables are underlined or
enclosed in angled brackets < >.
... Repeat the previous element, for example “member[;member...]”
value Fixed values following arguments are printed in plain font. For example,
--show WWN
| Boolean. Elements are exclusive. Example: --show -mode egress | ingress
\ Backslash. Indicates that the line continues through the line break. For
command line input, type the entire line without the backslash.

xii Fabric OS FCIP Administrator’s Guide
53-1002474-01
Notes, cautions, and warnings
The following notices and statements are used in this manual. They are listed below in order of
increasing severity of potential hazards.
NOTE
A note provides a tip, guidance, or advice, emphasizes important information, or provides a
reference to related information.
ATTENTION
An Attention statement indicates potential damage to hardware or data.
CAUTION
A Caution statement alerts you to situations that can cause damage to hardware, firmware,
software, or data.
DANGER
A Danger statement indicates conditions or situations that can be potentially lethal or extremely
hazardous to you. Safety labels are also attached directly to products to warn of these conditions
or situations.
Key terms
For definitions specific to Brocade and Fibre Channel, see the technical glossaries on MyBrocade.
See “Brocade resources” on page xiii for instructions on accessing MyBrocade.
For definitions of SAN-specific terms, visit the Storage Networking Industry Association online
dictionary at:
http://www.snia.org/education/dictionary
Notice to the reader
This document may contain references to the trademarks of the following corporations. These
trademarks are the properties of their respective companies and corporations.
These references are made for informational purposes only.
Corporation Referenced Trademarks and Products
Microsoft Corporation Windows, Windows NT, Internet Explorer

Fabric OS FCIP Administrator’s Guide xiii
53-1002474-01
Additional information
This section lists additional Brocade and industry-specific documentation that you might find
helpful.
Brocade resources
To get up-to-the-minute information, go to http://my.brocade.com and register at no cost for a user
ID and password.
For additional Brocade documentation, visit the Brocade SAN Info Center and click the Resource
Library location:
http://www.brocade.com
Release notes are available on the MyBrocade website and are also bundled with the Fabric OS
firmware.
Other industry resources
•White papers, online demos, and data sheets are available through the Brocade website at
http://www.brocade.com/products-solutions/products/index.page.
•Best practice guides, white papers, data sheets, and other documentation is available through
the Brocade Partner website.
For additional resource information, visit the Technical Committee T11 website. This website
provides interface standards for high-performance and mass storage applications for Fibre
Channel, storage management, and other applications:
http://www.t11.org
For information about the Fibre Channel industry, visit the Fibre Channel Industry Association
website:
http://www.fibrechannel.org
Getting technical help
Contact your switch support supplier for hardware, firmware, and software support, including
product repairs and part ordering. To expedite your call, have the following information available:
1. General Information
•Switch model
•Switch operating system version
•Error numbers and messages received
•supportSave command output
•Detailed description of the problem, including the switch or fabric behavior immediately
following the problem, and specific questions
•Description of any troubleshooting steps already performed and the results

xiv Fabric OS FCIP Administrator’s Guide
53-1002474-01
•Serial console and Telnet session logs
•syslog message logs
2. Switch Serial Number
The switch serial number and corresponding bar code are provided on the serial number label,
as illustrated below:
The serial number label is located as follows:
•Brocade 300, 5100, 5300, 7800, 8000, VA-40FC, 6505, 6510, and Brocade Encryption
Switch—On the switch ID pull-out tab located inside the chassis on the port side on the left
•Brocade 5410, M5424, 5450, 5460, 5470, 5480—Serial number label attached to the
module
•DCX 8510-8 and DCX—On the port side of the chassis, on the lower right side and directly
above the cable management comb.
•DCX 8510-4 and DCX-4S—On the nonport side of the chassis, on the lower left side.
3. World Wide Name (WWN)
4. Use the licenseIdShow command to display the switch WWN.
If you cannot use the licenseIdShow command because the switch is inoperable, you can get
the WWN from the same place as the serial number, except for the Brocade DCX and DCX-4S.
For the Brocade DCX and DCX-4S, access the numbers on the WWN cards by removing the
Brocade logo plate at the top of the non-port side of the chassis.
Document feedback
Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and
completeness of this document. However, if you find an error or an omission, or you think that a
topic needs further development, we want to hear from you. Forward your feedback to:
[e-mail]
Provide the title and version number of the document and as much detail as possible about your
comment, including the topic heading and page number and your suggestions for improvement.
*FT00X0054E9*
FT00X0054E9

Fabric OS FCIP Administrator’s Guide 1
53-1002474-01
Chapter
1
FCIP Overview
In this chapter
•FCIP platforms and supported features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
•FCIP concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
•IP WAN network considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
FCIP platforms and supported features
There are three Brocade platforms that support FCIP:
•The Brocade 7800 switch
•The Brocade FX8-24 blade (DCX, DCX-4S, DCX 8510-8, and DCX 8510-4 chassis)
•The Brocade FR4-18i blade (DCX, DCX-4S chassis)
NOTE
FCIP connections are not supported between 7800 switch or FX8-24 blades and previous
generation Brocade 7500 switches or FR4-18i blades.
Note the following about hardware support:
•The FR4-18i blade is not supported on the 16 Gbps DCX 8510-8, and DCX 8510-4 chassis.
•The FX8-24 and FR4-18i blades are not supported concurrently in the same chassis.
•There are differences in platform capabilities. For example, the FR4-18i blade cannot support
FCIP trunking.
Table 1 summarizes FCIP capabilities per platform.
TABLE 1 FCIP capabilities by platform
Capabilities 7800 switch FX8-24 blade FR4-18i blade
FCIP trunking Yes Yes No
Adaptive Rate Limiting Yes Yes No
10GbE ports No Yes No
FC ports up to 8 Gbps Yes (1, 2, 4, 8
Gbps)
Yes (1, 2, 4, 8
Gbps)
No (1, 2, 4 Gbps)
Compression Yes
LZ and Deflate
Yes
LZ and Deflate
Yes
LZ only

2Fabric OS FCIP Administrator’s Guide
53-1002474-01
FCIP platforms and supported features
1
Protocol acceleration
•FCIP Fastwrite
•Open Systems Tape
Pipelining
-OSTP read
-OSTP write
Yes Yes Yes
QoS
•Marking DSCP Yes Yes Yes
•Marking 802.1P - VLAN
tagging
Yes Yes Yes
•Enforcement 802.1P - VLAN
tagging
Yes Yes No
FICON extension
•FICON emulation
•IBM z/OS Global Mirror
(formerly eXtended Remote
Copy or XRC) acceleration
•Tape read acceleration
•Tape write acceleration
•Teradata emulation1
•Printer emulation1
Yes Yes Yes
IPsec
•AES encryption algorithm
Yes
Transport mode
Yes
Transport mode
Yes
Tunnel mode
VEX_Ports Yes Yes Yes
Support for third-party WAN
optimization hardware
No2No No2
IPv6 addresses for FCIP
tunnels3
Yes Yes Yes
Support for jumbo frames No2
MTU of 1500 is
maximum
No2
MTU of 1500 is
maximum
Yes
1. This emulation is not supported on the FR4-18i blade.
2. Not supported in Fabric OS version v7.0 and later.
3. IPv6 addressing is not supported in conjunction with IPsec in Fabric OS version v7.0.1.
TABLE 1 FCIP capabilities by platform (Continued)
Capabilities 7800 switch FX8-24 blade FR4-18i blade

Fabric OS FCIP Administrator’s Guide 3
53-1002474-01
FCIP concepts 1
FCIP concepts
Fibre Channel over IP (FCIP) enables you to use existing IP wide area network (WAN) infrastructure
to connect Fibre Channel SANs. FCIP supports applications such as remote data replication (RDR),
centralized SAN backup, and data migration over very long distances that are impractical or very
costly using native Fibre Channel connections. FCIP tunnels are used to pass Fibre Channel I/O
through an IP network. FCIP tunnels are built on a physical connection between two peer switches
or blades. Fibre Channel frames enter FCIP through virtual E_Ports (VE_Ports or VEX_Ports) and are
encapsulated and passed to Transmission Control Protocol (TCP) layer connections. The TCP
connections ensure in-order delivery of FC frames and lossless transmission. The Fibre Channel
fabric and all Fibre Channel targets and initiators are unaware of the presence of the IP network.
Figure 1 shows the relationship of FC and TCP/IP layers, and the general concept of FCIP tunneling.
FIGURE 1 FCIP tunnel concept and TCP/IP layers
IP WAN network considerations
Because FCIP uses TCP connections over an existing wide area network, consult with the WAN
carrier and IP network administrator to ensure that the network hardware and software equipment
operating in the data path can properly support the TCP connections. Keep the following
considerations in mind:
•Routers and firewalls that are in the data path must be configured to pass FCIP traffic (TCP
port 3225) and IPsec traffic, if IPsec is used (UDP port 500). TCP port 3226 must be
configured for the FR4-18i only.
•To enable recovery from a WAN failure or outage, be sure that diverse, redundant network
paths are available across the WAN.
•Be sure the underlying WAN infrastructure is capable of supporting the redundancy and
performance expected in your implementation.
To Fibre Channel To Fibre Channel
FCIP Tunnel
WAN
FC-IP
FC-2
FC-1
FC-0
FC-2
FC-1
FC-0
FC-IP
TCP
IP
LINK
PHY
TCP
IP
LINK
PHY

4Fabric OS FCIP Administrator’s Guide
53-1002474-01
IP WAN network considerations
1

Fabric OS FCIP Administrator’s Guide 5
53-1002474-01
Chapter
2
FCIP on the 7800 Switch and FX8-24 Blade
In this chapter
•7800 switch hardware overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
•7800 switch license options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
•FX8-24 blade hardware overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
•FX8-24 blade license options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
•FCIP trunking . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
•Adaptive Rate Limiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
•QoS SID/DID priorities over an FCIP trunk. . . . . . . . . . . . . . . . . . . . . . . . . . . 21
•QoS, DSCP, and VLANs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
•Compression options. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
•IPsec implementation over FCIP tunnels . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
•Open Systems Tape Pipelining . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
•Support for IPv6 addressing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
•Configuration preparation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
•Configuration steps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
•Creating a multicircuit tunnel (example) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
•Modifying an FCIP tunnel on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . 49
•Modifying an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . 49
•Deleting an IP interface on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . . 50
•Deleting an IP route on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . . . . . 50
•Deleting an FCIP tunnel on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . . 50
•Deleting an FCIP circuit on a Brocade 7800 FX8-24 blade . . . . . . . . . . . . . 51
•Virtual Fabrics and the Brocade 7800 FX8-24 blade . . . . . . . . . . . . . . . . . . 51

6Fabric OS FCIP Administrator’s Guide
53-1002474-01
7800 switch hardware overview
2
7800 switch hardware overview
Figure 2 shows the FC ports and GbE ports on the 7800 switch. There are 16 FC ports, numbered
0 through 15. The FC ports can operate at 1, 2, 4, or 8 Gbps. There are 6 GbE ports, numbered 0
through 5. Ports 0 and 1 are available as either RJ-45 ports or small form factor pluggable (SFP)
transceiver ports. Only six total GbE ports can be used. The 6 GbE ports together can provide up to
6 Gbps total bandwidth.
FIGURE 2 7800 switch FC and GbE ports
The 7800 switch comes in two models:
•The 7800 4/2 base model uses FC ports 0 through 3, and GbE ports 0 and 1. The GbE ports
can be either copper or optical. The RJ-45 copper ports are the default ports. Consider the
following when using these ports:
-Copper ports do not support auto-sense functions.
-With copper media, auto-negotiation must be enabled on the other end of the port
connection. 1 Gbps is the only negotiated speed.
•The 7800 16/6 uses FC ports 0 through 15, and GbE ports 0 through 5. The 7800 upgrade
license is required. A 7800 upgrade license can be purchased for a 7800 4/2, which enables
12 more Fibre Channel ports for a total of 16, and enables the use of 4 more optical GbE ports
for a total of 6.
1FC ports 0 through 3 3Copper GbE ports 0 and 1 (these ports are
RJ-45 copper alternatives for GbE ports 0
and 1.)
2FC ports 4 through 15 4GbE ports 0 though 5
2 4
1 3