Cisco Nexus 5000 Series User manual

Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
Americas Headquarters
Cisco Systems, Inc.
170 West Tasman Drive
San Jose, CA 95134-1706
USA
http://www.cisco.com
Tel: [phone]
800 553-NETS (6387)
Fax: [phone]
Text Part Number: OL-xxxxx-xx

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL STATEMENTS,
INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT SHIPPED WITH
THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE OR LIMITED WARRANTY,
CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB's public domain version
of the UNIX operating system. All rights reserved. Copyright ©1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS" WITH ALL FAULTS.
CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT LIMITATION, THOSE OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING, WITHOUT
LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO OR ITS SUPPLIERS
HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display output, network
topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in illustrative content is unintentional
and coincidental.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this URL: http://
www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership
relationship between Cisco and any other company. (1110R)
©2015 Cisco Systems, Inc. All rights reserved.

CONTENTS
Preface Preface xvii
Audience xvii
Document Organization xvii
Document Conventions xix
Related Documentation for Nexus 5000 Series NX-OS Software xx
Obtaining Documentation and Submitting a Service Request xxi
CHAPTER 1 New and Changed Information 1
New and Changed Information 1
CHAPTER 2 Overview 3
SAN Switching Overview 3
CHAPTER 3 Configuring Fibre Channel Interfaces 7
Configuring Fibre Channel Interfaces 7
Information About Fibre Channel Interfaces 7
Licensing Requirements for Fibre Channel 7
QOS Requirements for Fibre Channel 7
Physical Fibre Channel Interfaces 8
Virtual Fibre Channel Interfaces 8
Interface Modes 8
E Port 9
F Port 9
NP Port 9
TE Port 9
TF Port 9
TNP Port 10
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
OL-xxxxx-xx iii

SD Port 10
Auto Mode 10
Interface States 10
Administrative States 10
Operational States 11
Reason Codes 11
Buffer-to-Buffer Credits 14
Configuring Fibre Channel Interfaces 14
Configuring a Fibre Channel Interface 14
Configuring a Range of Fibre Channel Interfaces 14
Setting the Interface Administrative State 15
Configuring Interface Modes 15
Configuring the Interface Description 16
Configuring Port Speeds 17
Autosensing 18
Configuring SD Port Frame Encapsulation 18
Configuring Receive Data Field Size 18
Understanding Bit Error Thresholds 19
Configuring Buffer-to-Buffer Credits 20
Configuring Global Attributes for Fibre Channel Interfaces 21
Configuring Switch Port Attribute Default Values 21
About N Port Identifier Virtualization 22
Enabling N Port Identifier Virtualization 22
Example Port Channel Configurations 23
Verifying Fibre Channel Interfaces 24
Verifying SFP Transmitter Types 24
Verifying Interface Information 24
Verifying BB_Credit Information 25
Default Fibre Channel Interface Settings 25
CHAPTER 4 Configuring Domain Parameters 27
Configuring Domain Parameters 27
Information About Fibre Channel Domains 27
About Domain Restart 28
Restarting a Domain 29
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
iv OL-xxxxx-xx
Contents

About Domain Manager Fast Restart 29
Enabling Domain Manager Fast Restart 29
About Switch Priority 30
Configuring Switch Priority 30
About fcdomain Initiation 31
Disabling or Reenabling fcdomains 31
Configuring Fabric Names 31
About Incoming RCFs 32
Rejecting Incoming RCFs 32
About Autoreconfiguring Merged Fabrics 33
Enabling Autoreconfiguration 33
Domain IDs 34
About Domain IDs 34
Specifying Static or Preferred Domain IDs 36
About Allowed Domain ID Lists 37
Configuring Allowed Domain ID Lists 37
About CFS Distribution of Allowed Domain ID Lists 38
Enabling Distribution 38
Locking the Fabric 39
Committing Changes 39
Discarding Changes 40
Clearing a Fabric Lock 40
Displaying CFS Distribution Status 40
Displaying Pending Changes 41
Displaying Session Status 41
About Contiguous Domain ID Assignments 41
Enabling Contiguous Domain ID Assignments 41
FC IDs 42
About Persistent FC IDs 42
Enabling the Persistent FC ID Feature 43
Persistent FC ID Configuration Guidelines 43
Configuring Persistent FC IDs 44
About Unique Area FC IDs for HBAs 44
Configuring Unique Area FC IDs for an HBA 45
About Persistent FC ID Selective Purging 46
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
OL-xxxxx-xx v
Contents

Purging Persistent FC IDs 46
Verifying fcdomain Information 47
Default Fibre Channel Domain Settings 48
CHAPTER 5 Configuring N Port Virtualization 49
Configuring N Port Virtualization 49
Information About NPV 49
NPV Overview 49
NPV Mode 50
Server Interfaces 50
NP Uplinks 50
FLOGI Operation 51
NPV Traffic Management 52
Automatic Uplink Selection 52
Traffic Maps 52
Disruptive Load Balancing 52
NPV Traffic Management Guidelines 53
NPV Guidelines and Limitations 53
Configuring NPV 54
Enabling NPV 54
Configuring NPV Interfaces 54
Configuring an NP Interface 55
Configuring a Server Interface 55
Configuring NPV Traffic Management 56
Configuring NPV Traffic Maps 56
Enabling Disruptive Load Balancing 56
Verifying NPV 57
Verifying NPV Examples 57
Verifying NPV Traffic Management 58
CHAPTER 6 Configuring VSAN Trunking 59
Configuring VSAN Trunking 59
Information About VSAN Trunking 59
VSAN Trunking Mismatches 60
VSAN Trunking Protocol 61
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
vi OL-xxxxx-xx
Contents

Configuring VSAN Trunking 61
Guidelines and Restrictions 61
Enabling or Disabling the VSAN Trunking Protocol 61
About Trunk Mode 62
Configuring Trunk Mode 63
About Trunk-Allowed VSAN Lists 64
Configuring an Allowed-Active List of VSANs 65
Displaying VSAN Trunking Information 66
Default Trunk Configuration Settings 66
CHAPTER 7 Configuring SAN Port Channel 69
Configuring SAN Port Channels 69
Information About SAN Port Channels 69
Understanding Port Channels and VSAN Trunking 70
Understanding Load Balancing 71
Configuring SAN Port Channels 73
SAN Port Channel Configuration Guidelines 75
F and TF Port Channel Guidelines 75
Creating a SAN Port Channel 75
About Port Channel Modes 76
Configuring Active Mode SAN Port Channel 77
About SAN Port Channel Deletion 78
Deleting SAN Port Channels 78
Interfaces in a SAN Port Channel 79
About Interface Addition to a SAN Port Channel 79
Compatibility Check 79
Suspended and Isolated States 80
Adding an Interface to a SAN Port Channel 80
Forcing an Interface Addition 81
About Interface Deletion from a SAN Port Channel 82
Deleting an Interface from a SAN Port Channel 82
SAN Port Channel Protocol 82
About Channel Group Creation 83
Autocreation Guidelines 84
Enabling and Configuring Autocreation 85
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
OL-xxxxx-xx vii
Contents

About Manually Configured Channel Groups 86
Converting to Manually Configured Channel Groups 86
Example Port Channel Configurations 86
Verifying SAN Port Channel Configuration 87
Default Settings for SAN Port Channels 88
CHAPTER 8 Configuring and Managing VSANs 89
Configuring and Managing VSANs 89
Information About VSANs 89
VSAN Topologies 89
VSAN Advantages 92
VSANs Versus Zones 92
Configuring VSANs 93
About VSAN Creation 94
Creating VSANs Statically 94
About Port VSAN Membership 95
Assigning Static Port VSAN Membership 95
Displaying VSAN Static Membership 96
About the Default VSAN 96
About the Isolated VSAN 97
Displaying Isolated VSAN Membership 97
Operational State of a VSAN 97
About Static VSAN Deletion 97
Deleting Static VSANs 98
About Load Balancing 99
Configuring Load Balancing 99
About Interop Mode 100
Displaying Static VSAN Configuration 100
Default VSAN Settings 100
CHAPTER 9 Configuring and Managing Zones 103
Configuring and Managing Zones 103
Information About Zoning 103
Zoning Features 103
Zoning Example 105
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
viii OL-xxxxx-xx
Contents

Zone Implementation 105
Active and Full Zone Set Configuration Guidelines 106
Configuring Zones 109
Configuring Zones Example 109
Zone Sets 111
Activating a Zone Set 111
About the Default Zone 112
Configuring the Default Zone Access Permission 112
About FC Alias Creation 113
Creating FC Aliases 113
Creating FC Aliases Example 114
Creating Zone Sets and Adding Member Zones 115
Zone Enforcement 116
Zone Set Distribution 116
Enabling Full Zone Set Distribution 116
Enabling a One-Time Distribution 117
About Recovering from Link Isolation 118
Importing and Exporting Zone Sets 118
Zone Set Duplication 119
Copying Zone Sets 119
Renaming Zones, Zone Sets, and Aliases 120
Cloning Zones, Zone Sets, FC Aliases, and Zone Attribute Groups 121
Clearing the Zone Server Database 121
Verifying Zone Information 122
Enhanced Zoning 122
About Enhanced Zoning 122
Changing from Basic Zoning to Enhanced Zoning 123
Changing from Enhanced Zoning to Basic Zoning 124
Enabling Enhanced Zoning 124
Modifying the Zone Database 125
Releasing Zone Database Locks 126
Merging the Database 126
Configuring Zone Merge Control Policies 127
Default Zone Policies 128
Configuring System Default Zoning Settings 128
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
OL-xxxxx-xx ix
Contents

Verifying Enhanced Zone Information 129
Compacting the Zone Database 129
Zone and Zone Set Analysis 130
Default Basic Zone Settings 130
CHAPTER 10 Distributing Device Alias Services 131
Distributing Device Alias Services 131
Information About Device Aliases 131
Device Alias Features 131
Device Alias Requirements 132
Zone Aliases Versus Device Aliases 132
Device Alias Databases 133
Creating Device Aliases 133
Device Alias Modes 134
Changing Device Alias Mode Guidelines 134
Configuring Device Alias Modes 135
About Device Alias Distribution 135
Locking the Fabric 136
Committing Changes 136
Discarding Changes 137
Fabric Lock Override 137
Disabling and Enabling Device Alias Distribution 138
About Legacy Zone Alias Configuration 139
Importing a Zone Alias 139
Device Alias Database Merge Guidelines 139
Verifying Device Alias Configuration 140
Default Device Alias Settings 141
CHAPTER 11 Configuring Fibre Channel Routing Services and Protocols 143
Configuring Fibre Channel Routing Services and Protocols 143
Information About FSPF 143
FSPF Examples 144
Fault Tolerant Fabric Example 144
Redundant Link Example 144
FSPF Global Configuration 145
Cisco Nexus 5000 Series NX-OS SAN Switching Configuration Guide
xOL-xxxxx-xx
Contents