Cray XD1 User manual

Cray XD1™ RapidArray
Interconnect Topologies
Private
HR6–6425–F

© 2006 Cray Inc. All Rights Reserved. Unpublished Private Information. This unpublished work is protected to trade secret,
copyright and other laws. Except as permitted by contract or express written permission of Cray Inc., no part of this work or its
content may be used, reproduced or disclosed in any form.
U.S. GOVERNMENT RESTRICTED RIGHTS NOTICE
The Computer Software is delivered as "Commercial Computer Software" as defined in DFARS 48 CFR 252.227-7014.
All Computer Software and Computer Software Documentation acquired by or for the U.S. Government is provided with Restricted
Rights. Use, duplication or disclosure by the U.S. Government is subject to the restrictions described in FAR 48 CFR 52.227-14
or DFARS 48 CFR 252.227-7014, as applicable.
Technical Data acquired by or for the U.S. Government, if any, is provided with Limited Rights. Use, duplication or disclosure by the
U.S. Government is subject to the restrictions described in FAR 48 CFR 52.227-14 or DFARS 48 CFR 252.227-7013, as applicable.
Autotasking, Cray, Cray Channels, Cray Y-MP, GigaRing, LibSci, UNICOS and UNICOS/mk are federally registered
trademarks and Active Manager, CCI, CCMT, CF77, CF90, CFT, CFT2, CFT77, ConCurrent Maintenance Tools, COS, Cray Ada,
Cray Animation Theater, Cray APP, Cray Apprentice2, Cray C++ Compiling System, Cray C90, Cray C90D, Cray CF90, Cray EL,
Cray Fortran Compiler, Cray J90, Cray J90se, Cray J916, Cray J932, Cray MTA, Cray MTA-2, Cray MTX, Cray NQS, Cray Research,
Cray SeaStar, Cray S-MP, Cray SHMEM, Cray SSD-T90, Cray SuperCluster, Cray SV1, Cray SV1ex, Cray SX-5, Cray SX-6,
Cray T3D, Cray T3D MC, Cray T3D MCA, Cray T3D SC, Cray T3E, Cray T90, Cray T916, Cray T932, Cray UNICOS, Cray X1,
Cray X1E, Cray XD1, Cray X-MP, Cray XMS, Cray XT3, Cray XT4, Cray Y-MP EL, Cray-1, Cray-2, Cray-3, CrayDoc, CrayLink,
Cray-MP, CrayPacs, Cray/REELlibrarian, CraySoft, CrayTutor, CRInform, CRI/TurboKiva, CSIM, CVT, Delivering the power...,
Dgauss, Docview, EMDS, Gigaring, HEXAR, HSX, IOS, ISP/Superlink, Libsci, MPP Apprentice, ND Series Network Disk Array,
Network Queuing Environment, Network Queuing Tools, OLNET, RapidArray, RQS, SEGLDR, SMARTE, SSD, SUPERLINK,
System Maintenance and Remote Testing Environment, Trusted UNICOS, TurboKiva, UNICOS MAX, UNICOS/lc, and
UNICOS/mp are trademarks of Cray Inc.
Linux is a registered trademark of Linus Torvalds. All other trademarks are the property of their respective owners.

New Features
Cray XD1™ RapidArray Interconnect Topologies HR6–6425–F
This revision includes the WEEE compliance statement. This revision also incorporates information on the
following new topics:
•Cabling 36-chassis fat tree systems
•Cabling 48-chassis fat tree systems
•Configuring nonstandard fat tree topologies by depopulating standard base topologies

Record of Revision
Version Description
F May 2006
Updates to support the general availability of release 1.4 of the Cray XD1 product.
Includes the Waste Electrical and Electronic Equipment (WEEE) compliance
statement.
E October 2005
Supports the generally available 1.3 release of the Cray XD1 product. Minor changes
only.
D July 2005
Supports the limitedly available 1.3 release of the Cray XD1 product. Minor changes
only.
C May 2005
Supports the generally available release 1.2 of the Cray XD1 product. Minor changes
only.
A, B April 2005
Initial versions. Support the limitedly available release 1.2 of the Cray XD1 product.
HR6–6425–F Cray Private i

Contents
Page
Preface xi
Accessing Product Documentation . . . . . . . . . . . . . . . . . . . xi
Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Reader Comments . . . . . . . . . . . . . . . . . . . . . . . . xiii
Cray User Group . . . . . . . . . . . . . . . . . . . . . . . . xiii
Cray XD1 Support . . . . . . . . . . . . . . . . . . . . . . . . xiv
Introduction [1] 1
Who Should Read This Manual . . . . . . . . . . . . . . . . . . . . 1
Scope of This Manual . . . . . . . . . . . . . . . . . . . . . . . 1
How This Manual is Organized . . . . . . . . . . . . . . . . . . . . 1
Related Publications . . . . . . . . . . . . . . . . . . . . . . . 2
WEEE Compliance Statement . . . . . . . . . . . . . . . . . . . . . 3
Interconnecting the RapidArray Network [2] 5
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
Handling RapidArray Cables . . . . . . . . . . . . . . . . . . . . . 5
ESD Precautions . . . . . . . . . . . . . . . . . . . . . . . . 5
Bend Radii . . . . . . . . . . . . . . . . . . . . . . . . . 6
Connecting RapidArray Cables . . . . . . . . . . . . . . . . . . . 6
Disconnecting RapidArray Cables . . . . . . . . . . . . . . . . . . 7
Procedure 1: To disconnect a RapidArray cable . . . . . . . . . . . . . 7
Cabling the Topology . . . . . . . . . . . . . . . . . . . . . . . 8
Preparing to Cable Your System . . . . . . . . . . . . . . . . . . . 8
Routing and Securing the Cables for Your System . . . . . . . . . . . . . . 9
Procedure 2: To route and secure RapidArray cables . . . . . . . . . . . . 9
HR6–6425–F Cray Private iii

Cray XD1™RapidArray Interconnect Topologies
Page
Cabling Direct-connect Topologies [3] 11
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Direct-connect Topology . . . . . . . . . . . . . . . . . . . . . 11
Equipment Required . . . . . . . . . . . . . . . . . . . . . . 12
Time Required . . . . . . . . . . . . . . . . . . . . . . . . 12
Installation Order . . . . . . . . . . . . . . . . . . . . . . . 12
Direct-connect Topology: Two Chassis . . . . . . . . . . . . . . . . . . 12
Direct-connect Topology: Three Chassis . . . . . . . . . . . . . . . . . . 14
Direct-connect Topology: Four Chassis . . . . . . . . . . . . . . . . . . 17
Direct-connect Topology: Five Chassis . . . . . . . . . . . . . . . . . . 20
Direct-connect Topology: Six Chassis . . . . . . . . . . . . . . . . . . 25
Direct-connect Topology: Seven Chassis . . . . . . . . . . . . . . . . . 30
Direct-connect Topology: Eight to Thirteen Chassis . . . . . . . . . . . . . . 35
Eight- to Thirteen-Chassis Connections . . . . . . . . . . . . . . . . . 35
Set A Connections . . . . . . . . . . . . . . . . . . . . . . 35
Set B Connections . . . . . . . . . . . . . . . . . . . . . . . 43
Cabling Fat Tree Topologies: Introduction [4] 51
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
Base Configurations and Supported Configurations . . . . . . . . . . . . . . 52
External Switch Chassis . . . . . . . . . . . . . . . . . . . . . . 52
Number of Switch Chassis . . . . . . . . . . . . . . . . . . . . . 53
Switch Chassis Port Numbering . . . . . . . . . . . . . . . . . . . 53
Equipment Required . . . . . . . . . . . . . . . . . . . . . . . 54
Cabling a 12-Chassis Fat Tree [5] 55
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Port Groups (Fabrics) . . . . . . . . . . . . . . . . . . . . . . . 57
Installation Order . . . . . . . . . . . . . . . . . . . . . . . . 57
Port Mapping Details . . . . . . . . . . . . . . . . . . . . . . . 57
Fabric A . . . . . . . . . . . . . . . . . . . . . . . . . . 57
iv Cray Private HR6–6425–F

Contents
Page
Fabric B . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Fabric C . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Fabric D . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Cabling a 24-Chassis Fat Tree [6] 65
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Port Groups (Fabrics) . . . . . . . . . . . . . . . . . . . . . . . 67
Installation Order . . . . . . . . . . . . . . . . . . . . . . . . 67
Port Mapping Details . . . . . . . . . . . . . . . . . . . . . . . 67
Fabric A . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Fabric B . . . . . . . . . . . . . . . . . . . . . . . . . . 69
Fabric C1 . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Fabric C2 . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Fabric D1 . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Fabric D2 . . . . . . . . . . . . . . . . . . . . . . . . . . 76
Cabling a 36-Chassis Fat Tree [7] 79
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
Cable Inventory . . . . . . . . . . . . . . . . . . . . . . . . . 81
Port Groups (Fabrics) . . . . . . . . . . . . . . . . . . . . . . . 82
Installation Order . . . . . . . . . . . . . . . . . . . . . . . . 83
Port Mapping Details . . . . . . . . . . . . . . . . . . . . . . . 83
Fabric A . . . . . . . . . . . . . . . . . . . . . . . . . . 84
Fabric B . . . . . . . . . . . . . . . . . . . . . . . . . . 87
Fabric C . . . . . . . . . . . . . . . . . . . . . . . . . . 90
Fabric D . . . . . . . . . . . . . . . . . . . . . . . . . . 93
Fabric E . . . . . . . . . . . . . . . . . . . . . . . . . . 96
Fabric F . . . . . . . . . . . . . . . . . . . . . . . . . . 99
Cabling a 48-Chassis Fat Tree [8] 103
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
Cable Inventory . . . . . . . . . . . . . . . . . . . . . . . . . 105
HR6–6425–F Cray Private v

Cray XD1™RapidArray Interconnect Topologies
Page
Port Groups (Fabrics) . . . . . . . . . . . . . . . . . . . . . . . 105
Installation Order . . . . . . . . . . . . . . . . . . . . . . . . 107
Port Mapping Details . . . . . . . . . . . . . . . . . . . . . . . 107
Fabric A . . . . . . . . . . . . . . . . . . . . . . . . . . 108
Fabric B . . . . . . . . . . . . . . . . . . . . . . . . . . 111
Fabric C . . . . . . . . . . . . . . . . . . . . . . . . . . 114
Fabric D . . . . . . . . . . . . . . . . . . . . . . . . . . 117
Fabric E . . . . . . . . . . . . . . . . . . . . . . . . . . 120
Fabric F . . . . . . . . . . . . . . . . . . . . . . . . . . 123
Fabric G . . . . . . . . . . . . . . . . . . . . . . . . . . 126
Fabric H . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Configuring Nonstandard Fat Trees [9] 133
Choosing the Base Configuration . . . . . . . . . . . . . . . . . . . . 133
Example 1: Base configuration for a 28-chassis system . . . . . . . . . . . . 133
Depopulation Rules . . . . . . . . . . . . . . . . . . . . . . . . 133
Depopulating Cray XD1 Chassis . . . . . . . . . . . . . . . . . . . 133
Example 2: 28-chassis system: removing chassis from 48-chassis configuration . . . . 134
Depopulating Switch Chassis: General . . . . . . . . . . . . . . . . . 134
Example 3: 8 switch chassis selected from 24-chassis configuration . . . . . . . 134
Depopulating Cables . . . . . . . . . . . . . . . . . . . . . . 134
Depopulating 24-port Switch Chassis . . . . . . . . . . . . . . . . . 134
Minimum Number of 144-port Switch Chassis . . . . . . . . . . . . . . . 134
Depopulating Leaf Blades in 144-port Switch Chassis . . . . . . . . . . . . . 134
Minimum Number of Cray XD1 Chassis . . . . . . . . . . . . . . . . . 135
Systems with 24-port Switches . . . . . . . . . . . . . . . . . . . 135
Example 4: Minimum number of chassis with 24-port switches . . . . . . . 135
Systems with 144-port Switches . . . . . . . . . . . . . . . . . . 136
Example 5: Minimum number of chassis with 144-port switches . . . . . . . 136
Cabling Remaining Components . . . . . . . . . . . . . . . . . . . 136
vi Cray Private HR6–6425–F

Contents
Page
Appendix A ID Information 137
Recording ID Information . . . . . . . . . . . . . . . . . . . . . . 137
Chassis IDs . . . . . . . . . . . . . . . . . . . . . . . . . 137
Switch Chassis IDs . . . . . . . . . . . . . . . . . . . . . . . 139
Glossary 141
Index 145
Tables
Table 1. Related Publications . . . . . . . . . . . . . . . . . . . . 3
Table 2. Minimum bend radii for RapidArray cables . . . . . . . . . . . . . 6
Table 3. Port mapping for a 2-chassis direct-connect system . . . . . . . . . . . 13
Table 4. Port mapping for a 3-chassis direct-connect system . . . . . . . . . . . 15
Table 5. Port mapping for a 4-chassis direct-connect system . . . . . . . . . . . 18
Table 6. Port mapping for a 5-chassis direct-connect system . . . . . . . . . . . 21
Table 7. RapidArray cables for 6-chassis direct-connect system . . . . . . . . . . 25
Table 8. Port mapping for a 6-chassis direct-connect system . . . . . . . . . . . 25
Table 9. RapidArray cables for a 7-chassis direct-connect system . . . . . . . . . . 30
Table 10. Port mapping for a 7-chassis direct-connect system . . . . . . . . . . . 30
Table 11. RapidArray cables for an 8- to 13-chassis direct-connect system . . . . . . . 35
Table 12. Port mapping for a 13-chassis direct-connect system–SetA ........ 36
Table 13. Port mapping for an 8-chassis direct-connect system—SetB ........ 43
Table 14. Port mapping for a 9-chassis direct-connect system—SetB......... 45
Table 15. Port mapping for a 10-chassis direct-connect system—SetB ........ 46
Table 16. Port mapping for an 11-chassis direct-connect system—SetB ........ 47
Table 17. Port mapping for a 12-chassis direct-connect system—SetB ........ 49
Table 18. Switch chassis in standard base fat tree configurations . . . . . . . . . . 53
Table 19. RapidArray cables for a 12-chassis fat tree system . . . . . . . . . . . 55
Table 20. Fat tree topology port groups: 12 chassis . . . . . . . . . . . . . . 57
Table 21. Port mapping for a 12-chassis fat tree system—Fabric A . . . . . . . . . 58
Table 22. Port mapping for a 12-chassis fat tree system—Fabric B . . . . . . . . . 59
HR6–6425–F Cray Private vii

Cray XD1™RapidArray Interconnect Topologies
Page
Table 23. Port mapping for a 12-chassis fat tree system—Fabric C . . . . . . . . . 61
Table 24. Port mapping for a 12-chassis fat tree system—Fabric D . . . . . . . . . 62
Table 25. RapidArray cables for a 24-chassis fat tree system . . . . . . . . . . . 65
Table 26. Fat tree topology port groups: 24 chassis . . . . . . . . . . . . . . 67
Table 27. Port mapping for a 24-chassis fat tree system—Fabric A . . . . . . . . . 68
Table 28. Port mapping for a 24-chassis fat tree system—Fabric B . . . . . . . . . 69
Table 29. Port mapping for a 24-chassis fat tree system—Fabric C1 . . . . . . . . . 71
Table 30. Port mapping for a 24-chassis fat tree system—Fabric C2 . . . . . . . . . 73
Table 31. Port mapping for a 24-chassis fat tree system—Fabric D1 . . . . . . . . . 74
Table 32. Port mapping for a 24-chassis fat tree system—Fabric D2 . . . . . . . . . 76
Table 33. RapidArray cables for a 36-chassis fat tree system . . . . . . . . . . . 81
Table 34. Fat tree topology port groups: 36 chassis . . . . . . . . . . . . . . 83
Table 35. Port mapping for a 36-chassis fat tree system—Fabric A . . . . . . . . . 84
Table 36. Port mapping for a 36-chassis fat tree system—Fabric B . . . . . . . . . 87
Table 37. Port mapping for a 36-chassis fat tree system—Fabric C . . . . . . . . . 90
Table 38. Port mapping for a 36-chassis fat tree system—Fabric D . . . . . . . . . 93
Table 39. Port mapping for a 36-chassis fat tree system—Fabric E . . . . . . . . . 96
Table 40. Port mapping for a 36-chassis fat tree system—Fabric F . . . . . . . . . 99
Table 41. RapidArray cables for a 48-chassis fat tree system . . . . . . . . . . . 105
Table 42. Fat tree topology port groups: 48 chassis . . . . . . . . . . . . . . 106
Table 43. Port mapping for a 48-chassis fat tree system—Fabric A . . . . . . . . . 108
Table 44. Port mapping for a 48-chassis fat tree system—Fabric B . . . . . . . . . 111
Table 45. Port mapping for a 48-chassis fat tree system—Fabric C . . . . . . . . . 114
Table 46. Port mapping for a 48-chassis fat tree system—Fabric D . . . . . . . . . 117
Table 47. Port mapping for a 48-chassis fat tree system—Fabric E . . . . . . . . . 120
Table 48. Port mapping for a 48-chassis fat tree system—Fabric F . . . . . . . . . 123
Table 49. Port mapping for a 48-chassis fat tree system—Fabric G . . . . . . . . . 126
Table 50. Port mapping for a 48-chassis fat tree system—Fabric H . . . . . . . . . 129
Table 51. Chassis IDs (direct-connect systems) . . . . . . . . . . . . . . . 137
Table 52. Chassis IDs (fat tree systems) . . . . . . . . . . . . . . . . . 138
viii Cray Private HR6–6425–F

Contents
Page
Table 53. Switch Chassis IDs . . . . . . . . . . . . . . . . . . . . 140
Figures
Figure 1. WEEE compliance statement . . . . . . . . . . . . . . . . . 4
Figure 2. RapidArray cable connector . . . . . . . . . . . . . . . . . . 6
Figure 3. RapidArray cable connection . . . . . . . . . . . . . . . . . 7
Figure 4. RapidArray cable bundles . . . . . . . . . . . . . . . . . . 10
Figure 5. Direct-connect topology–high-level . . . . . . . . . . . . . . . 12
Figure 6. Direct-connect topology: 2 chassis . . . . . . . . . . . . . . . . 14
Figure 7. Direct-connect topology: 3 chassis . . . . . . . . . . . . . . . . 17
Figure 8. Direct-connect topology: 4 chassis . . . . . . . . . . . . . . . . 20
Figure 9. Direct-connect topology: 5 chassis . . . . . . . . . . . . . . . . 24
Figure 10. Direct-connect topology: 6 chassis . . . . . . . . . . . . . . . 29
Figure 11. Direct-connect topology: 7 chassis . . . . . . . . . . . . . . . 34
Figure 12. Direct-connect topology: 8 to 13 chassis—SetA ........... 42
Figure 13. Direct-connect topology: 8 to 13 chassis—SetB............ 50
Figure 14. Fat tree topology . . . . . . . . . . . . . . . . . . . . . 51
Figure 15. Port numbers on 24-port switch chassis . . . . . . . . . . . . . . 53
Figure 16. Leaf blade and port numbers on 144-port switch chassis . . . . . . . . . 54
Figure 17. Fat tree topology: 12 chassis . . . . . . . . . . . . . . . . . 56
Figure 18. Fat tree topology: 24 chassis . . . . . . . . . . . . . . . . . 66
Figure 19. Logical view of 36-chassis fat tree configuration . . . . . . . . . . . 79
Figure 20. Cabinet layout of 36-chassis system (front view) . . . . . . . . . . . 80
Figure 21. Cabinet layout of 36-chassis system (rear view) . . . . . . . . . . . . 81
Figure 22. Port groups and port mapping rules for 36-chassis system . . . . . . . . 82
Figure 23. Logical view of 48-chassis fat tree configuration . . . . . . . . . . . 103
Figure 24. Cabinet layout of 48-chassis system (front view) . . . . . . . . . . . 104
Figure 25. Cabinet layout of 48-chassis system (rear view) . . . . . . . . . . . . 104
Figure 26. Port groups and port mapping rules for 48-chassis system . . . . . . . . 106
HR6–6425–F Cray Private ix

Preface
The information in this preface is common to Cray documentation provided with
this software release.
Accessing Product Documentation
With each software release, Cray provides books and man pages, and in
some cases, third-party documentation. These documents are provided in the
following ways:
CrayDoc The Cray documentation delivery system that allows you to
quickly access and search Cray books, man pages, and in some
cases, third-party documentation. Access this HTML and PDF
documentation via CrayDoc at the following locations:
•The local network location defined by your system
administrator
•The CrayDoc public website: docs.cray.com
Man pages Access man pages by entering the man command followed by the
name of the man page. For more information about man pages,
see the man(1) man page by entering:
%man man
Third-party documentation
Access third-party documentation not provided through
CrayDoc according to the information provided with the
product.
HR6–6425–F Cray Private xi

Cray XD1™RapidArray Interconnect Topologies
Conventions
These conventions are used throughout Cray documentation:
Convention Meaning
command This fixed-space font denotes literal items, such as file
names, pathnames, man page names, command names, and
programming language elements.
variable Italic typeface indicates an element that you will replace with a
specific value. For instance, you may replace filename with the
name datafile in your program. It also denotes a word or
concept being defined.
user input This bold, fixed-space font denotes literal items that the user
enters in interactive sessions. Output is shown in nonbold,
fixed-space font.
[ ] Brackets enclose optional portions of a syntax representation for
a command, library routine, system call, and so on.
... Ellipses indicate that a preceding element can be repeated.
name(N) Denotes man pages that provide system and programming
reference information. Each man page is referred to by its name
followed by a section number in parentheses.
Enter:
%man man
to see the meaning of each section number for your particular
system.
xii Cray Private HR6–6425–F

Preface
Reader Comments
Contact us with any comments that will help us to improve the accuracy and
usability of this document. Be sure to include the title and number of the
document with your comments. We value your comments and will respond to
them promptly. Contact us in any of the following ways:
E-mail:
[email protected]
Telephone (inside U.S., Canada):
1–800–950–2729 (Cray Customer Support Center)
Telephone (outside U.S., Canada):
[phone] (Cray Customer Support Center)
Mail:
Customer Documentation
Cray Inc.
1340 Mendota Heights Road
Mendota Heights, MN 55120–1128
USA
Cray User Group
The Cray User Group (CUG) is an independent, volunteer-organized
international corporation of member organizations that own or use Cray Inc.
computer systems. CUG facilitates information exchange among users of Cray
systems through technical papers, platform-specific e-mail lists, workshops, and
conferences. CUG memberships are by site and include a significant percentage
of Cray computer installations worldwide. For more information, contact your
Cray site analyst or visit the CUG website at www.cug.org.
HR6–6425–F Cray Private xiii

Cray XD1™RapidArray Interconnect Topologies
Cray XD1 Support
Obtain support for the Cray XD1 product in either of the following ways:
Telephone:
1–888–279–2729 (Cray XD1 Customer Support Center)
Through the CRInform website:
http://crinform.cray.com/xd/
Note: Use the contact information provided here if you have a support
agreement with Cray. If, however, you have a support agreement with
a third-party organization that is a Cray channel partner, contact that
organization instead: do not contact Cray directly.
xiv Cray Private HR6–6425–F

Introduction [1]
This chapter describes the intended audience for this manual and its scope, and
lists the related publications.
1.1 Who Should Read This Manual
This manual is intended for a systems engineer or technician who has
experience in computer system installation in a computer room with a controlled
environment.
1.2 Scope of This Manual
This manual describes how to physically interconnect all the chassis of one
Cray XD1 system to implement the supported system topologies. It gives general
instructions for handling RapidArray cables, preparing to cable the system,
and routing and securing cables. It includes complete details for cabling every
supported direct-connect topology and for cabling the supported base fat tree
topologies. It also describes the general rules for cabling the supported fat tree
topologies that derive from the base configurations by depopulating them.
This manual does not describe how to configure the software aspects of a
topology. For information about configuring the logical topology of the system
during commissioning and about managing the topology subsequently, see Cray
XD1 System Administration (S–2430).
For hardware maintenance procedures, see the Field Replacement Procedures
that are packaged with replacement parts. Note that the Cray XD1 product
warranty requires that only Cray service personnel, Cray-authorized service
providers, or Cray-trained customers maintain Cray XD1 hardware. See the
http://crinform.cray.com/xd/ website for information on Cray XD1
training programs and service support.
1.3 How This Manual is Organized
This manual consists of the following chapters and appendix:
•Interconnecting the RapidArray Network, Chapter 2, page 5
HR6–6425–F Cray Private 1

Cray XD1™RapidArray Interconnect Topologies
Provides guidelines on handling, connecting, disconnecting, and cabling
RapidArray topologies.
•Cabling Direct-connect Topologies, Chapter 3, page 11
Provides port mapping details and interconnection diagrams for cabling the
direct-connect topologies that are supported in the current release.
•Cabling Fat Tree Topologies: Introduction, Chapter 4, page 51
Provides a general description of fat tree configurations, identifies the
supported configurations, describes the external switch chassis, and lists the
necessary equipment for cabling fat trees.
•Cabling a 12-Chassis Fat Tree, Chapter 4, page 51
Cabling a 24-Chassis Fat Tree, Chapter 6, page 65
Cabling a 36-Chassis Fat Tree, Chapter 7, page 79
Cabling a 48-Chassis Fat Tree, Chapter 8, page 103
Provide instructions and port mapping details for cabling the standard base
fat tree topologies.
•Configuring Nonstandard Fat Trees, Chapter 9, page 133
Provides rules for configuring other supported fat tree topologies by
depopulating a standard base fat tree topology.
•ID Information, Appendix A, page 137
Provides a Chassis ID form and a Switch Chassis ID form for you to record
your chassis and switch chassis IDs. You will need this information when
you commission your system.
1.4 Related Publications
Table 1, page 3 lists the Cray XD1 publications that supplement the contents of
this manual.
2 Cray Private HR6–6425–F