Dell EMC ECS EX Series Installation instructions

ECS EX-Series
Hardware Guide
302-005-081
04 Rev 2
July 2019

Copyright ©2018-2019 Dell Inc. or its subsidiaries. All rights reserved.
Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS-IS.” DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND
WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED
IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE.
Dell Technologies, Dell, EMC, Dell EMC and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property
of their respective owners. Published in the USA.
Dell EMC
Hopkinton, Massachusetts 01748-9103
1-508-435-1000 In North America 1-866-464-7381
www.DellEMC.com
2ECS EX-Series Hardware Guide

5
7
EX-Series Hardware Overview 9
Introduction................................................................................................ 10
Rack and node host names..........................................................................10
Switches 13
Dell EMC S5148F switch............................................................................. 14
Front-end switch pair..................................................................... 14
Back-end switch pair......................................................................15
Front-end and back-end switch connections..................................16
EX300 Platform 19
EX300 hardware components.................................................................... 20
EX300 configurations .................................................................................21
EX300 upgrade paths................................................................................. 24
EX300 server..............................................................................................24
Server front view...........................................................................26
Server rear view............................................................................ 28
EX300 disk drives.......................................................................................29
EX300 power cabling..................................................................................30
EX300 iDRAC cabling................................................................................. 39
EX300 network cabling............................................................................... 41
Network connections between multiple ECS appliances in a single site ..... 47
EX3000 Platform 51
EX3000 hardware components.................................................................. 52
EX3000 configurations...............................................................................53
EX3000 upgrade paths...............................................................................55
EX3000 server........................................................................................... 56
Server front view...........................................................................57
Server rear view............................................................................. 61
EX3000 disk drives.....................................................................................63
EX3000 power cabling................................................................................63
EX3000 iDRAC cabling............................................................................... 74
EX3000 network cabling.............................................................................78
Third-Party Rack Requirements 87
Third-party rack requirements....................................................................88
Figures
Tables
Chapter 1
Chapter 2
Chapter 3
Chapter 4
Chapter 5
CONTENTS
ECS EX-Series Hardware Guide 3

Contents
4ECS EX-Series Hardware Guide

Dell EMC S5148F switch ports.................................................................................... 14
Front-end switches..................................................................................................... 14
Back-end switches......................................................................................................15
Connections between front-end and back-end switches within an EX-Series rack......17
Back-end switch connections between EX-Series racks............................................. 18
Front-end switch connections to customer switches (example)................................. 18
EX300 minimum and maximum configurations............................................................22
EX300 server physical dimensions..............................................................................26
EX300 server chassis front view ................................................................................26
Left control panel ...................................................................................................... 27
Status LEDs decoded view......................................................................................... 27
Right control panel..................................................................................................... 28
EX300 server chassis rear view ................................................................................. 28
EX300 disk drive in carrier..........................................................................................30
EX300 single-phase AC power cabling .......................................................................33
ECSv3 740xd Single Phase AC Cabling Diagram ........................................................34
Three-phase Delta AC power cabling .........................................................................35
ECSv3 740xd Three Phase Delta AC Cabling Diagram................................................ 36
Three-phase WYE AC power cabling ..........................................................................37
ECSv3 740xd Three Phase Wye AC Cabling Diagram................................................. 38
Fox switch iDRAC ports..............................................................................................39
iDRAC cabling.............................................................................................................40
Front-end and back-end switch connections to an EX300 node................................. 42
Node ports on front-end switches.............................................................................. 43
Back-end switch, front-end switch, and iDRAC ports on an EX300 node................... 43
Node ports on back-end switches.............................................................................. 43
EX300 node network port cabling connections...........................................................44
EX300 node network cable labeling............................................................................ 45
EX300 network cabling...............................................................................................46
Linear or Daisy Chain topology....................................................................................47
Split-brain topology.................................................................................................... 47
Inter-rack switch connectivity - linear topology (daisy-chain) between EX-Series
racks...........................................................................................................................48
Inter-rack switch connectivity - linear topology (daisy-chain) between an EX-Series
rack and a Gen2 U-Series, D-Series, or C-Series rack................................................ 48
Ring topology............................................................................................................. 49
Inter-rack switch connectivity - ring topology............................................................ 49
Star topology............................................................................................................. 50
Inter-rack switch connectivity - star topology............................................................50
EX3000S minimum and maximum configurations for single node chassis................... 53
EX3000D minimum and maximum configurations for dual node chassis..................... 54
EX3000 server front view in rack............................................................................... 57
EX3000 external chassis view ................................................................................... 58
EX3000 internal chassis view..................................................................................... 58
External view of server sled A in a EX3000D dual node chassis with two sleds...........59
Front-panel features and indicators............................................................................59
EX3000D server rear view in rack............................................................................... 61
Back-panel features and indicators............................................................................. 61
EX3000 disk drive in carrier........................................................................................63
PDU outlet numbers................................................................................................... 64
PDU single-phase diagram..........................................................................................66
EX3000S single-phase AC power cabling .................................................................. 67
EX3000D single-phase AC power cabling .................................................................. 68
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
FIGURES
ECS EX-Series Hardware Guide 5

PDU three-phase diagram.......................................................................................... 69
EX3000S three-phase delta AC power cabling .......................................................... 70
EX3000D three-phase delta AC power cabling ...........................................................71
EX3000S three-phase WYE AC power cabling........................................................... 72
EX3000D three-phase WYE AC power cabling........................................................... 73
EX3000S iDRAC cabling............................................................................................. 75
EX3000D iDRAC cabling............................................................................................. 77
Front-end and back-end switch connections to an EX3000S node.............................79
Front-end and back-end switch connections to an EX3000D node............................ 80
Node ports on front-end switches..............................................................................80
Back-end switch, front-end switch, and iDRAC ports on an EX3000S node............... 81
Node ports on back-end switches............................................................................... 81
EX3000 node network port cabling connections........................................................ 82
EX3000 node network cable labeling.......................................................................... 83
EX3000S network cabling.......................................................................................... 84
EX3000D network cabling.......................................................................................... 85
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
Figures
6ECS EX-Series Hardware Guide

Rack ID 1 to 50 ........................................................................................................... 10
Default node names..................................................................................................... 11
Switch port numbers...................................................................................................14
Switch port number.................................................................................................... 15
EX300 hardware components.................................................................................... 20
EX300 configurations ................................................................................................ 23
Standard features of EX300 servers.......................................................................... 25
Decoding of LEDs in light bar......................................................................................27
Server Panel, Ports, and Slots.................................................................................... 28
EX300 PDU cabling .................................................................................................... 31
EX300 2U PDU cabling ...............................................................................................31
EX300 node iDRAC port to BE1 port mapping............................................................ 39
EX3000 hardware components.................................................................................. 52
EX3000S single node chassis configurations .............................................................55
EX3000D dual node chassis configurations ............................................................... 55
EX3000 physical dimensions...................................................................................... 56
Server indicators, buttons, or connectors.................................................................. 59
Server indicators, buttons, or connectors...................................................................62
EX3000S PDU cabling................................................................................................64
EX3000D PDU cabling................................................................................................64
EX3000S node iDRAC port to BE1 port mapping........................................................ 74
EX3000D node iDRAC port to BE1 port mapping........................................................ 76
Legend for Back-end switch, front-end switch, and iDRAC ports on EX30000S node
....................................................................................................................................81
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
TABLES
ECS EX-Series Hardware Guide 7

Tables
8ECS EX-Series Hardware Guide

CHAPTER 1
EX-Series Hardware Overview
lIntroduction........................................................................................................ 10
lRack and node host names................................................................................. 10
ECS EX-Series Hardware Guide 9

Introduction
This guide describes the hardware components that make up the ECS appliance
Generation 3 (Gen3) hardware models.
ECS Gen3 appliance series
The ECS Gen3 appliance series include:
lEX300 series: A dense object storage solution of hyper-converged nodes for small
to medium-sized ECS deployments. With different drive sizes and the flexibility of
single node addition, this platform can scale from 60 TB RAW to 1.5 PB RAW per
rack.
lEX3000 series: An ultra-dense object storage solution of hyper-converged nodes
for medium to large-sized ECS deployments. This platform starts at a 2.2 PB RAW
minimum configuration and scales to 8.6 PB RAW per rack.
Note: In this document, the term node is used interchangeably with server , and the
term appliance refers to a cluster of nodes running ECS software.
Hardware generations
ECS appliances are characterized by hardware generation.
Gen3
lEX300 Gen3 models featuring 1 TB, 2 TB, 4 TB, or 8 TB disks (12 HDD per 2U
node) became available in August 2018.
lEX3000 Gen3 models featuring 12 TB disks (4U chassis with single or dual node
configurations) became available in August 2018.
Gen2
For documentation on Gen2 hardware, see the
Dell EMC ECS D- and U-Series Hardware
Guide .
lU-Series Gen2 models featuring 12 TB disks became available in March 2018.
lThe D-Series was introduced in October 2016 featuring 8 TB disks. D-Series
models featuring 10 TB disks became available March 2017.
lThe original U-Series appliance (Gen1) was replaced in October 2015 with second
generation hardware (Gen2).
Rack and node host names
Lists the default rack and node host names for an ECS Appliance.
The default rack IDs and color names are assigned in installation order as shown in the
following table.
Table 1 Rack ID 1 to 50
Rack
ID
Rack color Rack
ID
Rack color Rack
ID
Rack color
1 red 18 carmine 35 cornsilk
2 green 19 auburn 36 ochre
3 blue 20 bronze 37 lavender
EX-Series Hardware Overview
10 ECS EX-Series Hardware Guide

Table 1 Rack ID 1 to 50 (continued)
Rack
ID
Rack color Rack
ID
Rack color Rack
ID
Rack color
4 yellow 21 apricot 38 ginger
5 magenta 22 jasmine 39 ivory
6 cyan 23 army 40 carnelian
7 azure 24 copper 41 taupe
8 violet 25 amaranth 42 navy
9 rose 26 mint 43 indigo
10 orange 27 cobalt 44 veronica
11 chartreuse 28 fern 45 citron
12 pink 29 sienna 46 sand
13 brown 30 mantis 47 russet
14 white 31 denim 48 brick
15 gray 32 aquamarine 49 avocado
16 beige 33 baby 50 bubblegum
17 silver 34 eggplant
Nodes are assigned node names based on their order within the server chassis and
within the rack itself. The following table lists the default node names.
Table 2 Default node names
Node Node name Node Node name
1 provo 9 boston
2 sandy 10 chicago
3 orem 11 houston
4 ogden 12 phoenix
5 layton 13 dallas
6 logan 14 detroit
7 lehi 15 columbus
8 murray 16 austin
Nodes that are positioned in the same slot in different racks at a site have the same
node name. For example, node 4 is called ogden, assuming that you use the default
node names.
The getrackinfo command identifies nodes by a unique combination of node name
and rack name. For example, node 4 in rack 1 is identified as ogden-red and can be
pinged using its NAN resolvable (through mDNS) name: ogden-red.nan.local.
EX-Series Hardware Overview
ECS EX-Series Hardware Guide 11

EX-Series Hardware Overview
12 ECS EX-Series Hardware Guide

CHAPTER 2
Switches
lDell EMC S5148F switch.....................................................................................14
ECS EX-Series Hardware Guide 13

Dell EMC S5148F switch
The EX300 and EX3000 appliances both use the Dell EMC S5148F for the front-end
pair of switches and for the pair of back-end switches. Note that customers have the
option of using their own front-end switches instead of the Dell EMC S5148F
switches. The Dell EMC S5148F switches are required for the back-end pair.
Figure 1 Dell EMC S5148F switch ports
Front-end switch pair
Dell EMC offers an optional HA pair of front-end 25 GbE S5148F switches for
customer network connection to the rack with two 100 GbE virtual link trunking (VLT)
cables per HA pair. These switches are referred to as the Hare (FE2) and Rabbit (FE1)
switches.
Customers can use their own front-end switch pair (10/25 GbE for EX300 and 25 GbE
for EX3000) via the Dell EMC Request for Product Qualification (RPQ) process. In
this case, the customer must provide the appropriate VLT cables, SFPs, or external
connection cables.
Figure 2 Front-end switches
Rabbit Switch (FE1)
Hare Switch (FE2)
1
48464442403836343230
28
262422
20
18
1614121084 62
3 5 7 9 11 13 15 17 19 21 23 25 27 29 3531 33 37 39 41 43 45 47
1
48464442403836343230
28
262422
20
18
1614121084 62
3 5 7 9 11 13 15 17 19 21 23 25 27 29 3531 33 37 39 41 43 45 47
49
50
51 53
52 54
50 52 54
49 51 53
Table 3 Switch port numbers
Switch Port number Description
Hare 1-16 Data network ports connected to nodes (10/25 GbE)
17-40 Not designated
41-48 Customer uplink ports (10/25 GbE)
Switches
14 ECS EX-Series Hardware Guide

Table 3 Switch port numbers (continued)
Switch Port number Description
49-50 VLT ports (100 GbE)
51-54 Customer uplink ports (100 GbE)
Rabbit 1-16 Data network ports connected to nodes (10/25 GbE)
17-40 Not designated
41-48 Customer uplink ports (10/25 GbE)
49-50 VLT ports (100 GbE)
51-54 Customer uplink ports (100 GbE)
Back-end switch pair
Dell EMC provides two 25 GbE S5148F back-end switches (BE1 and BE2) with two
100 GbE VLT cables. These switches are referred to as the Hound (BE2) and Fox
(BE1) switches.
In the following diagram, all labeled ports relate to an ECS virtual data center (VDC) in
which all racks/nodes are EX-Series (Gen3 hardware), with the exception of ports 39
and 40. Ports 39 and 40 are only used in the scenario where there is Gen2 hardware
series integration with EX-Series hardware in the VDC. When Gen2 hardware is mixed
with EX-Series hardware, ports 39 and 40 are the only ports used for connectivity.
All iDRAC cables from nodes and all front-end switch management cable connections
route to the Fox (BE1) switch.
Figure 3 Back-end switches
Fox Switch (BE1)
Hound Switch (BE2)
1
48464442403836343230
28
262422
20
18
1614121084 62
3 5 7 9 11 13 15 17 19 21 23 25 27 29 3531 33 37 39 41 43 45 47
1
4846444240383634323028
262422
20
18
1614121084 62
3 5 7 9 11 13 15 17 19 21 23 25 27 29 3531 33 37 39 41 43 45 47
49 51 53
49 51 53
50 52 54
50 52 54
Table 4 Switch port number
Switch Port number Description
Hound 1-16 Private network ports connected to nodes (10/25 GbE)
17-40 Not designated.
41-44 In from EX-Series rack when the ECS system has more than one rack (10/25 GbE)
Switches
ECS EX-Series Hardware Guide 15

Table 4 Switch port number (continued)
Switch Port number Description
45-48 Out to EX-Series rack when the ECS system has more than one rack (10/25 GbE)
49-50 VLT ports (100 GbE)
51-54 Not designated (100 GbE)
Fox 1-16 Private network ports connected to nodes (10/25 GbE)
17-32 iDRAC ports
33 To Rabbit (FE1) switch
34 To service tray in front
35 To Hare (FE2) switch
36 Open for rear service connectivity
37-38 Not designated
39 In from Gen2 Turtle switch
40 Out to Gen2 Turtle switch
41-44 In from EX-Series rack when the ECS system has more than one rack (10/25 GbE)
45-48 Out to EX-Series rack when the ECS system has more than one rack (10/25 GbE)
49-50 VLT ports (100 GbE)
51-54 Not designated (100 GbE)
Front-end and back-end switch connections
The front-end switch management ports connect to back-end switch ports via two
CAT6 cable and two 1GBaseT SFP. These two cables and two SFP are used for Dell
EMC switches. If you are deploying in a third party rack with customer switches, or
using customer switches in a Dell EMC rack, these two cables and two SFP are not
required.
The connection between the front-end switch ports and back-end switch ports are as
follows:
lHare (FE2) to Fox (BE1)
lRabbit (FE1) to Fox (BE1)
The connections are shown with green lines in the following diagram.
Switches
16 ECS EX-Series Hardware Guide

Figure 4 Connections between front-end and back-end switches within an EX-Series rack
For back-end switch connections between EX-Series racks, port 41 on the back-end
switches is used for the inbound connection and port 45 is used for the outbound
connection. These ports are used for linear and ring topology rack-to-rack
connectivity. For more information, see Network connections between multiple ECS
appliances in a single site on page 47.
Switches
ECS EX-Series Hardware Guide 17

Figure 5 Back-end switch connections between EX-Series racks
Figure 6 Front-end switch connections to customer switches (example)
Switches
18 ECS EX-Series Hardware Guide

CHAPTER 3
EX300 Platform
lEX300 hardware components............................................................................ 20
lEX300 configurations ........................................................................................ 21
lEX300 upgrade paths.........................................................................................24
lEX300 server..................................................................................................... 24
lEX300 disk drives.............................................................................................. 29
lEX300 power cabling......................................................................................... 30
lEX300 iDRAC cabling.........................................................................................39
lEX300 network cabling.......................................................................................41
lNetwork connections between multiple ECS appliances in a single site .............47
ECS EX-Series Hardware Guide 19

EX300 hardware components
The EX300 ECS appliance includes the following hardware components.
Table 5 EX300 hardware components
Component Description
40U rack Titan D racks that include:
lGen3 0U PDUs supporting single phase, three-phase delta, and three-phase WYE
lFront and rear doors
lRacking by Dell EMC manufacturing
In addition to the Dell EMC-racked EX300 appliance, the EX300 nodes can be installed in
customer-provided racks. For more information on third-party racking requirements, see the
ECS EX300 Third-Party Rack Installation Guide .
Back-end (BE) switches for
private network connection
lTwo Dell EMC S5148F 25 GbE 1U ethernet switches with 48 x 25 GbE SFP ports and 6 x
100 GbE uplink ports.
l2 x 100 GbE VLT cables per HA pair.
Front-end (FE) switches for
customer public network
connection
lTwo optional Dell EMC S5148F 25 GbE 1U ethernet switches can be obtained for network
connection or the customer can provide their own 10 GbE or 25 GbE HA pair for the front
end.
lIf the customer provides their own front-end switches, they must supply all VLT cables,
SFPs, or external connection cables.
lIf Dell EMC S5148F 25 GbE front-end switches are used, the 25 GbE ports are configured
to run at 10 GbE to connect to the EX300 nodes, and 2 x 100 GbE VLT cables are
provided.
Nodes lMinimum number of nodes per rack is 5 with increments of 1 node up to a maximum of 16
nodes.
lHDD sizes can be 1 TB, 2 TB, 4 TB, or 8 TB. (All drive sizes are the same in the node.)
lWithin a Dell EMC manufactured rack delivered from the factory, all nodes within the rack
are of the exact same drive size. For node upgrades in the field, nodes with other sized
drives are allowed within the rack.
lTwelve SATA hard disk drives (HDDs) in each node.
l480 GB M.2 (BOSS) system disk in each node.
l64 GB RAM per node.
lSingle 8-core SkyLake CPU per node. Xeon Bronze 3106 8 core/8 thread-11MB L3,
1.7GHz, 85W.
l4x 16GB RDIMM, 2667MT/s, Dual Rank, x4 Data Width.
lDual 750W Platinum power supply (hot swappable).
lEach node has 4 x 10 GbE networking.
EX300 Platform
20 ECS EX-Series Hardware Guide