Cisco MDS 9000 Series User manual

Cisco Systems, Inc.
www.cisco.com
Cisco has more than 200 offices worldwide.
Addresses, phone numbers, and fax numbers
are listed on the Cisco website at
www.cisco.com/go/offices.
Cisco MDS 9000 Family NX-OS Interfaces
Configuration Guide
Cisco MDS NX-OS Release 4.2(1) Through 4.2(7a)
July 2010
Text Part Number: OL-19445-02

THE SPECIFICATIONS AND INFORMATION REGARDING THE PRODUCTS IN THIS MANUAL ARE SUBJECT TO CHANGE WITHOUT NOTICE. ALL
STATEMENTS, INFORMATION, AND RECOMMENDATIONS IN THIS MANUAL ARE BELIEVED TO BE ACCURATE BUT ARE PRESENTED WITHOUT
WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. USERS MUST TAKE FULL RESPONSIBILITY FOR THEIR APPLICATION OF ANY PRODUCTS.
THE SOFTWARE LICENSE AND LIMITED WARRANTY FOR THE ACCOMPANYING PRODUCT ARE SET FORTH IN THE INFORMATION PACKET THAT
SHIPPED WITH THE PRODUCT AND ARE INCORPORATED HEREIN BY THIS REFERENCE. IF YOU ARE UNABLE TO LOCATE THE SOFTWARE LICENSE
OR LIMITED WARRANTY, CONTACT YOUR CISCO REPRESENTATIVE FOR A COPY.
The Cisco implementation of TCP header compression is an adaptation of a program developed by the University of California, Berkeley (UCB) as part of UCB’s public
domain version of the UNIX operating system. All rights reserved. Copyright © 1981, Regents of the University of California.
NOTWITHSTANDING ANY OTHER WARRANTY HEREIN, ALL DOCUMENT FILES AND SOFTWARE OF THESE SUPPLIERS ARE PROVIDED “AS IS” WITH
ALL FAULTS. CISCO AND THE ABOVE-NAMED SUPPLIERS DISCLAIM ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING, WITHOUT
LIMITATION, THOSE OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OR ARISING FROM A COURSE OF
DEALING, USAGE, OR TRADE PRACTICE.
IN NO EVENT SHALL CISCO OR ITS SUPPLIERS BE LIABLE FOR ANY INDIRECT, SPECIAL, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, INCLUDING,
WITHOUT LIMITATION, LOST PROFITS OR LOSS OR DAMAGE TO DATA ARISING OUT OF THE USE OR INABILITY TO USE THIS MANUAL, EVEN IF CISCO
OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
Cisco and the Cisco logo are trademarks or registered trademarks of Cisco and/or its affiliates in the U.S. and other countries. To view a list of Cisco trademarks, go to this
URL: www.cisco.com/go/trademarks. Third-party trademarks mentioned are the property of their respective owners. The use of the word partner does not imply a partnership
relationship between Cisco and any other company. (1110R)
Any Internet Protocol (IP) addresses and phone numbers used in this document are not intended to be actual addresses and phone numbers. Any examples, command display
output, network topology diagrams, and other figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses or phone numbers in
illustrative content is unintentional and coincidental.
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
© 2014–2015 Cisco Systems, Inc. All rights reserved.

iii
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
CONTENTS
New and Changed Information ix
Preface xi
Audience xi
Organization xi
Document Conventions xii
Related Documentation xiii
Release Notes xiii
Regulatory Compliance and Safety Information xiii
Compatibility Information xiii
Hardware Installation xiii
Software Installation and Upgrade xiii
Cisco NX-OS xiv
Cisco Fabric Manager xiv
Command-Line Interface xiv
Intelligent Storage Networking Services Configuration Guides xiv
Troubleshooting and Reference xv
Obtaining Documentation and Submitting a Service Request 1-xv
xv
CHAPTER 1Interfaces Overview 1-1
Trunks and PortChannels 1-1
Fibre Channel Port Rate Limiting 1-2
Extended Credits 1-2
N Port Virtualization 1-2
FlexAttach 1-2
CHAPTER 2Configuring Interfaces 2-1
Fibre Channel Interfaces 2-1
Generation 1 Interfaces Configuration Guidelines 2-2
About Interface Modes 2-3
About Interface States 2-7
Configuring Fibre Channel Interfaces 2-11
Graceful Shutdown 2-12

Contents
iv
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
Setting the Interface Administrative State 2-12
Configuring Interface Modes 2-13
Configuring Port Speeds 2-14
About Interface Descriptions 2-15
Configuring the Interface Description 2-15
Specifying a Port Owner 2-15
About Frame Encapsulation 2-16
Identifying the Beacon LEDs 2-16
About Beacon Mode 2-17
Configuring Beacon Mode 2-17
About Bit Error Thresholds 2-18
Switch Port Attribute Default Values 2-18
About SFP Transmitter Types 2-19
Displaying Interface Information 2-20
TL Ports for Private Loops 2-28
About TL Ports 2-28
About TL Port ALPA Caches 2-30
Displaying TL Port Information 2-30
Manually Inserting Entries into ALPA Cache 2-32
Displaying the ALPA Cache Contents 2-32
Clearing the ALPA Cache 2-32
Configuring Port Guard 2-32
Configuring Port Monitor 2-34
Enabling Port Monitor 2-35
Configuring a Port Monitor Policy 2-35
Activating a Port Monitor Policy 2-38
Displaying Port Monitor Status and Policies 2-38
Configuring Port Group Monitor 2-40
Enabling Port Group Monitor 2-40
Configuring Port Group Monitor Policy 2-40
Activating a Port Group Monitor Policy 2-42
Displaying Port Group Monitor Status and Policies 2-42
Configuring Slow Drain Device Detection and Congestion Avoidance 2-44
About Slow Drain Device Detection and Congestion Avoidance 2-44
Configuring Stuck Frame Timeout Value 2-44
Configuring No-Credit Timeout Value 2-45
Configuring Credit Loss Recovery Threshold and Action 2-45
Configuring Average Credit Non-Available Duration Threshold and Action 2-47
Management Interfaces 2-47

Contents
v
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
About Management Interfaces 2-47
Configuring Management Interfaces 2-48
Displaying Management Interface Configuration 2-48
VSAN Interfaces 2-49
About VSAN Interfaces 2-49
Creating VSAN Interfaces 2-49
Displaying VSAN Interface Information 2-50
Default Settings 2-50
CHAPTER 3Configuring Fibre Channel Interfaces 3-1
About Generations of Modules and Switches 3-1
Port Groups and Port Rate Modes 3-2
Port Groups 3-3
Port Rate Modes 3-4
Dynamic Bandwidth Management 3-7
Out-of-Service Interfaces 3-8
Combining Generation 1, Generation 2, and Generation 3 Modules 3-8
Port Indexes 3-9
PortChannels 3-11
Configuring Module Interface Shared Resources 3-14
Displaying Interface Capabilities 3-14
Configuration Guidelines for 48-Port, 24-Port, and 4/44-Port 8-Gbps Fibre Channel Switching
Modules 3-15
Configuration Guidelines for 48-Port and 24-Port 4-Gbps Fibre Channel Switching Modules 3-17
Configuration Guidelines for 12-Port 4-Gbps Switching Module Interfaces 3-18
Configuration Guidelines for 4-Port 10-Gbps Switching Module Interfaces 3-18
Configuring Port Speed 3-19
Configuring Rate Mode 3-21
Configuring Oversubscription Ratio Restrictions 3-26
Configuring Bandwidth Fairness 3-31
Taking Interfaces Out of Service 3-33
Releasing Shared Resources in a Port Group 3-34
Disabling ACL Adjacency Sharing for System Image Downgrade 3-35
Displaying SFP Diagnostic Information 3-35
Example Configurations 3-36
Configuring a 48-Port 8-Gbps Fibre Channel Switching Module Example 3-36
Configuring a 24-Port 8-Gbps Fibre Channel Switching Module Example 3-37
Configuring a 4/44-Port 8-Gbps Fibre Channel Switching Module Example 3-37
Configuring a 24-Port 4-Gbps Fibre Channel Switching Module Example 3-38

Contents
vi
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
Configuring a 48-Port 4-Gbps Fibre Channel Switching Module Example 3-39
Default Settings 3-40
CHAPTER 4Configuring Interface Buffers 4-1
About Buffer-to-Buffer Credits 4-1
Configuring Buffer-to-Buffer Credits 4-2
About Performance Buffers 4-2
Configuring Performance Buffers 4-3
Buffer Pools 4-3
BB_Credit Buffers for Switching Modules 4-6
BB_Credit Buffers for Fabric Switches 4-16
About Extended BB_Credits 4-17
Configuring Extended BB_credits 4-19
Enabling Buffer-to-Buffer State Change Number 4-19
To use the BB_SC_N field during PLOGI or FLOGI, follow these steps: 4-20
.About Receive Data Field Size 4-20
Configuring Receive Data Field Size 4-20
Displaying BB_Credit Information 4-21
CHAPTER 5Configuring Trunking 5-1
About Trunking 5-1
Trunking E Ports 5-2
Trunking F Ports 5-2
Key Concepts 5-3
Trunking Guidelines and Restrictions 5-3
Trunking Misconfiguration Examples 5-4
Upgrade and Downgrade Restrictions 5-5
Difference Between TE Ports and TF-TNP Ports 5-5
Enabling the Trunking Protocols 5-7
About Trunking Protocols 5-7
Enabling the Cisco Trunking and Channeling Protocols 5-8
Enabling the F Port Trunking and Channeling Protocol 5-8
Configuring Trunk Mode and VSAN List 5-8
About Trunk Modes 5-8
Configuring Trunk Mode 5-9
About Trunk-Allowed VSAN Lists and VF_IDs 5-9
Configuring an Allowed-Active List of VSANs 5-12
Example F Port Trunking Configuration 5-12

Contents
vii
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
Displaying Trunking Information 5-13
Default Settings 5-14
CHAPTER 6Configuring PortChannels 6-1
About PortChannels 6-1
About E PortChannels 6-2
About F and TF PortChannels 6-3
About PortChanneling and Trunking 6-3
About Load Balancing 6-4
About PortChannel Modes 6-6
Configuration Guidelines and Restrictions 6-7
PortChannel Configuration 6-9
About PortChannel Configuration 6-10
Creating a PortChannel 6-11
Configuring the PortChannel Mode 6-11
About PortChannel Deletion 6-11
Deleting PortChannels 6-12
Interfaces in a PortChannel 6-12
About Interface Addition to a PortChannel 6-12
Adding an Interface to a PortChannel 6-14
Forcing an Interface Addition 6-14
About Interface Deletion from a PortChannel 6-15
Deleting an Interface from a PortChannel 6-15
PortChannel Protocols 6-15
About Channel Group Creation 6-16
About Autocreation 6-18
Enabling and Configuring Autocreation 6-18
About Manually Configured Channel Groups 6-19
Converting to Manually Configured Channel Groups 6-19
Example F and TF PortChannel Configurations 6-19
Verifying the PortChannel Configuration 6-21
Default Settings 6-25
CHAPTER 7Configuring N Port Virtualization 7-1
About N Port Identifier Virtualization 7-1
Enabling N Port Identifier Virtualization 7-2
About N Port Virtualization 7-2
NPV Mode 7-4

Contents
viii
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
NP Ports 7-5
NP Links 7-5
Default Port Numbers 7-6
NPV CFS Distribution over IP 7-7
NPV Traffic Management 7-7
Multiple VSAN Support 7-8
NPV Guidelines and Requirements 7-8
NPV Traffic Management Guidelines 7-9
Configuring NPV 7-9
Configuring NPV Traffic Management 7-11
DPVM Configuration 7-12
NPV and Port Security 7-12
Verifying NPV 7-12
Verifying NPV Traffic Management 7-14
CHAPTER 8Configuring FlexAttach Virtual pWWN 8-1
About FlexAttach Virtual pWWN 8-1
FlexAttach Virtual pWWN Guidelines and Requirements 8-2
Configuring FlexAttach Virtual pWWN 8-2
Enabling FlexAttach Virtual pWWN 8-2
Verifying FlexAttach Virtual pWWN 8-4
Verifying the End Device 8-4
Debugging FlexAttach Virtual pWWN 8-5
Security Settings for FlexAttach Virtual pWWN 8-5
FlexAttach Virtual pWWN CFS Distribution 8-6
Difference Between San Device Virtualization and FlexAttach Port Virtualization 8-6
I NDEX

Send documentation comments to mdsfeedbac[email protected]
ix
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
New and Changed Information
As of Cisco MDS NX-OS Release 4.2(1), software configuration information is available in new
feature-specific configuration guides for the following information:
•System management
•Interfaces
•Fabric
•Quality of service
•Security
•IP services
•High availability and redundancy
The information in these new guides previously existed in the Cisco MDS 9000 Family CLI
Configuration Guide and in the Cisco MDS 9000 Family Fabric Manager Configuration Guide. Those
configuration guides remain available on Cisco.com and should be used for all software releases prior
to MDS NX-OS Release 4.2(1). Each guide addresses the features introduced in or available in a
particular release. Select and view the configuration guide that pertains to the software installed in your
switch.
For a complete list of document titles, see the list of Related Documentation in the “Preface.”
To find additional information about Cisco MDS NX-OS Release 4.2(x), see the Cisco MDS 9000 Family
Release Notes available at the following Cisco Systems website:
http://www.cisco.com/en/US/products/ps5989/prod_release_notes_list.htm
About this Guide
The information in the new Cisco MDS 9000 NX-OS Interfaces Configuration Guide previously existed
in Part 3: Switch Configuration of the Cisco MDS 9000 Family CLI Configuration Guide.
Table 1 lists the New and Changed features for this guide, starting with MDS NX-OS Release 4.2(1).

Send documentation comments to mdsfeedbac[email protected]
x
Cisco MDS 9000 Family NX-OS Interfaces Configuration Guide
OL-19445-02, Cisco MDS NX-OS Release 4.2(x)
New and Changed Information
Table 1-1 New and Changed Features for Cisco MDS NX-OS Release 4.2(x)
Feature New and Change Topics
Changed
in
Release Where Documented
Slow Drain Device
Detection and Congestion
Avoidance
Added information about configuring stuck frame
timeout value, no-credit timeout value, credit loss
recovery threshold and action, and average credit
non-available duration threshold and action.
4.2(7) Chapter 2, “Configuring
Interfaces”
Port Group Monitor Added information about configuring policies
and monitoring port groups.
4.2(1) Chapter 2, “Configuring
Interfaces”
Port Guard Added port guard configuration guidelines for
multiple types of port failure causes.
4.2(1) Chapter 2, “Configuring
Interfaces”