Cambricon MLU-X1000 User manual

MLU-X1000 MLU extender
Product Manual
V0.2.0
Preliminary
2020.07.10

Cambricon ®
Copyright © 2020 Cambricon Corporation i
1. Preface..........................................................................................................................................................1
1.1. Copyright Declaration.....................................................................................................................1
1.2. Versioning...........................................................................................................................................2
1.3. Update history...................................................................................................................................2
2. Overview ......................................................................................................................................................3
3. Product Specification Overview ...........................................................................................................4
3.1 Overview of Product Specification Parameters......................................................................4
3.2 Overview of structural specifications .........................................................................................4
3.3 Overview of electrical specifications ..........................................................................................5
3.4 Summary of heat dissipation specifications ............................................................................5
4. Component Profile ...................................................................................................................................7
4.1 CMX-BB1 ............................................................................................................................................7
4.2 CMX-PA4 ............................................................................................................................................9
4.3 CMX-PDB............................................................................................................................................9
4.4 CMX-LINKB ..................................................................................................................................... 10
4.5 CMX-IBB........................................................................................................................................... 10
4.6 Front panel ...................................................................................................................................... 11
4.7 Back panel ....................................................................................................................................... 12
5. Electrical specifications......................................................................................................................... 13
5.1 PCIE topology description.......................................................................................................... 13
5.2 CCLINK interface description..................................................................................................... 14
5.3 Power Interface Description....................................................................................................... 16
6. BMC management system.................................................................................................................. 18
6.1 BMC functional description........................................................................................................ 18
Director

Cambricon ®
Copyright © 2020 Cambricon Corporation ii
7. Heat dissipation specifications........................................................................................................... 19
7.1 Description of the heat dissipation environment ............................................................... 19
7.2 Wind-resistance curve of MLU-X1000 system.................................................................... 20
7.3 MLU-X1000 Thermal Simulation Model...............................................错误!未定义书签。
8. Optional components........................................................................................................................... 21
8.1 PCIE High Speed Cable ............................................................................................................... 21
8.2 CCLINK High Speed Cable ......................................................................................................... 21
8.3 Network............................................................................................................................................ 21
8.4 Hard hard disk................................................................................................................................ 22
9. Cambricon NeuWare development environment .................................................................... 23

C ambricon ®
Copyright © 2020 Cambricon Corporation 1
1. Preface
1.1. Copyright Declaration
Disclaimer
Cambricon Technologies Corporation Limited(hereinafter referred to as "Cambricon ") does not represent,
guarantee (express, implied or statutory) or guarantee the information contained in this document and expressly
waives any and all implied guarantees of saleability, ownership, non-aggression of intellectual property or
applicability for a specific purpose, and cambricon does not assume any liability arising from the application or
use of any product or service. cambricon shall not be liable for any breach of contract, damages, costs or
problems arising from :(1) any way of using cambricon products contrary to this Guide; or (2) customer product
design.
Limitation of liability
In no case shall Cambricon be liable for any damage caused by the use or inability to use this Guide
(including but not limited to damage such as loss of profits, business disruption and loss of information), even
if Cambricon has been advised that such damage may be suffered. Although the customer may suffer any
damage for any reason, according to the terms and conditions of sale of the products of the Cambricon, the
total and cumulative liability of Cambricon to the customer for the products described in this Guide shall be
limited.
Accuracy of information
The information provided in this document is owned by Cambricon and Cambricon reserves the right to
make any changes to this document information or to any products and services without notice. The information
contained in this guide and all other information of the Cambricon documents cited in this guide are provided
"as is ". Cambricon does not guarantee the accuracy or completeness of information, texts, patterns, links or
other items contained in this guide. Cambricon may make changes to this Guide or to the products described
in this Guide without notice, but does not undertake to update this Guide.
The performance tests and grades listed in this guide are to be measured using a specific chip or computer
system or component. After such tests, the results shown in this guide reflect the general performance of
Cambricon products. Any difference in system hardware or software design or configuration will affect actual
performance. As mentioned above, Cambricon does not represent, warrant or guarantee that the products
described in this Guide will apply for any particular purpose.Cambricon does not represent or guarantee testing
all parameters of each product.The customer is solely responsible for ensuring that the product is suitable and
applicable to the application of the customer plan and for performing the necessary tests on the application,

Cambricon ®
Copyright © 2020 Cambricon Corporation 2
with a view to avoiding the default of the application or product.
The fragility of customer product design can affect the quality and reliability of Cambricon products and
lead to additional or different circumstances and/or requirements beyond the scope of this guide.
Notice of Intellectual Property
The Cambricon and Cambricon symbols are trademarks and/or registered trademarks of Cambricon
Technologies Corporation Limited in the United States and other countries. Other companies and product
names shall be trademarks of the respective companies associated with them.
This guide is copyrighted and protected by the provisions of copyright laws and treaties worldwide.This
guide can not be reproduced, reworked, modified, published, uploaded, published, transmitted or distributed
in any way without the prior written permission of Cambricon. Except for the customer's right to use this guide
information and products, according to this guide, Cambricon does not grant any other express or implied
rights or permits. It is doubtful that the Cambricon does not grant any (express or implied) rights or permits
to the customer based on any patent, copyright, trademark, trade secret or any other Cambricon intellectual
property or ownership.
Copyright Declaration
© Cambricon Technologies Corporation Limited reserves all rights.
1.2. Versioning
1Table 1.1 Version Record
Document
name MLU-X1000 MLU extender Product Manual
Version
number V0.2.0
Author Cambricon
Date created 2020.07.10
1.3. Update history
V0.2.0
Update time:
Update:
- Initial version

Cambricon ®
Copyright © 2020 Cambricon Corporation 3
2. Overview
MLU-X1000 MLU extender is a construction unit of artificial intelligence supercomputing. The
extender inherits 4 MLU290-M5 intelligent processing cards, and provides up to 2 POPs of adaptive
precision computing power. The supercomputing system from 4 cards to 16 cards is constructed by using
the Cambrian CCLink inter chip direct connection technology, which provides a highly agile, highly reliable
and high-performance computing foundation for the Artificial Intelligence Computing Center.

Cambricon ®
Copyright © 2020 Cambricon Corporation 4
3. Product Specification Overview
3.1 Overview of Product Specification Parameters
MLU-X1000 MLU extender Specification Parameters are as follows :
1Table 3.1 MLU-X1000 Specification Parameters
Specification indicators
Note
Model
MLU-X1000
Core architecture
Cambricon MLUv02
Core frequency
1GHz
Integer speed (INT8)
2048 TOPS (Dense)
Calculation accuracy support
INT16,INT8,INT4,FP32,FP16
Video decoding
Support
Memory capacity
128GB
Memory width
16384 bits
Memory bandwidth
4096GB/s
ECC protection
Yes
System interface
2* PCI Express 4.0x16
CCLINK external interface
8Ports
CCLINK interface bandwidth
8*100 GB /S
TDP power consumption
2300W
Heat dissipation scheme
Air-cooled, compatible with liquid-cooled
3.2 Overview of structural specifications
The structure specifications of the MLU-X1000 MLU extender are as follows:

Cambricon ®
Copyright © 2020 Cambricon Corporation 5
2Table 3.2 Structural Specification for MLU-X1000
Specification indicators
Note
Shape
437mm*87mm*735mm
Weight
29Kg
Package Shape
1000mm*635mm*230mm
Package Weight
39Kg
3.3 Overview of electrical specifications
MLU-X1000 MLU extender electrical specifications as follows:
3Table 3.3 Electrical Specification for MLU-X1000
Specification indicators
Note
System interface
PCIE Gen 4X 16
Number of PCIE ports
2Ports
PCIE bandwidth
128GB /s
Number of CCLINK ports
8Ports
CCLINK bandwidth
800GB /s
BMC management interface
IPMI V2.0
Host management interface
SMBUS
Input voltage
AC100-127V,60/50Hz,Max. Output Power 1250W,
AC200-210V,60/50Hz,Max. Output Power 2700W,
AC210-240V,60/50Hz,Max. Output Power 3000W
DC240V,Max. Output Power 3000W(China mainland only)
When voltage is below AC200V，both PSUs must be
supplied at the same time.
3.4 Summary of heat dissipation specifications
The heat dissipation specification of MLU-X1000 MLU extender is as follows:
4Table 3.4 Heat dissipation specifications of MLU-X1000
Specification indicators
Note
Working temperature
0℃-35℃, altitude of 900m below
Working humidity
20%RH-85%RH

Cambricon ®
Copyright © 2020 Cambricon Corporation 6
Storage temperature
-40℃—75℃
Storage humidity
5%RH-95%RH
Noise SDP @23℃, sound power ≤7.2 bels
Working altitude ≤3000 m (900-3000m, for each increase of 300 m
supported working temperature drop 1℃)

Cambricon ®
Copyright © 2020 Cambricon Corporation 7
4. Component Profile
4.1 CMX -BB 1
CMX -BB 1 is the baseboard which carries MLU290-M5 Intelligent processing card. Each CMX -BB 1
can carry 4 MLU290-M5 Intelligent processing cards. The details are shown in the following figure:
1Figure 4.1 CMX -BB1 graphic
1Table 4.1 CMX -BB1 Description
Serial
Note
Serial
Note

Cambricon ®
Copyright © 2020 Cambricon Corporation 8
number
number
1
CCLINK-0A &0B
16
OAM MODULE 2
2
CCLINK-2A &2B
17
OAM MODULE 1
3
CCLINK-1A &1B
18
OAM MODULE 3
4
CCLINK-1A &1B
19
F AN 4
5
PCIE 0
20
F AN 3
6
PCIE 1
21
F AN 2
7
IPMI
22
F AN 1
8
UID
23
F AN 0
9
COM HUB0
24
PCIE SWITCH 0
10
COM HUB1
25
PCIE SWITCH 1
11
COM HUB2
26
54V POWER BUSBAR
12
AC INDICATOR
27
HANDLE 0
13
FRONT PANEL CONN.
28
HANDLE 1
14
PDB MGT.CONN.
29
FRONT PCIE CONN.
15
OAM MODULE 0

Cambricon ®
Copyright © 2020 Cambricon Corporation 9
4.2 CMX -PA4
CMX -PA4 is a PCIE board, which is placed on the host server and provides Mini SAS HD interface for
connection with MLU-X1000.The details are shown in the following figure:
2Figure 4.2 CMX -PA4 graphic
2Table 4.2 CMX -PA4 Description
Serial
number Note
Serial
number Note
1
mini SAS HD CONN.
3
PCIE GOLDEN FINGER
2
PCIE RETIMER
4.3 CMX -PDB
CMX -PDB is the power distribution board.The details are shown in the following figure:
3Figure 4.3 CMX -PDB graphic
3Table 4.3 CMX -PDB Description
Serial
number Note
Serial
number Note

Cambricon ®
Copyright © 2020 Cambricon Corporation 10
1
54V POWER BUSBAR
5
SSD POWER CONN.0
2
PSU CONN.0
6
SSD POWER CONN.1
3
PSU CONN.1
7
PDB MGT.CONN.
4
INTRUTION
8
12V POWER BUSBAR
4.4 CMX -LINKB
CMX -LINKB is passive connection board.The details are shown in the following figure:
4Figure 4.4 CMX -LINK B graphic
4Table 4.4 CMX -PDB Description
Serial
number Note
Serial
number Note
1
SSD MGT.CONN.0
5
OCULINK 2
2
SSD MGT.CONN.1
6
OCULINK 3
3
OCULINK 0
7
IBB CONN.
4
OCULINK 1
8
FRONT PCIE CONN.
4.5 CMX -IBB
CMX-IBB is the backplane of Infiniband card. Each CMX-IBB can place two Infiniband cards.The details
are shown in the following figure:

Cambricon ®
Copyright © 2020 Cambricon Corporation 11
5Figure 4.5 CMX -IBB graphic
5Table 4.5 CMX-IBB Description
Serial
number Note
Serial
number Note
1
IBB CONN.
3
IB SLOT 1
2
IB SLOT 0
4.6 Front panel
The front panel of the chassis is shown as follows:
6Figure 4.6 Front panel of chassis
6Table 4.6 Description of front panel of chassis
Serial
number Note
Serial
number Note
1
Switching keys
7
SSD 1
2
UID keys
8
SSD 2
3
Reset button
9
SSD 3
4
PSU 0
10
NIC 0
5
PSU 1
11
NIC 1

Cambricon ®
Copyright © 2020 Cambricon Corporation 12
6
SSD 0
4.7 Back panel
The rear panel of the chassis is shown as follows:
7Figure 4.7 Rear panel of chassis
7Table 4.7 Description of rear panel of chassis
Serial
number Note
Serial
number Note
1
PCIE 0
10
CCLINK-3B
2
PCIE 1
11
IPMI
3
CCLINK-0A
12
UID
4
CCLINK-0B
13
COM HUB 0
5
CCLINK-2A
14
COM HUB 1
6
CCLINK-2B
15
COM HUB 2
7
CCLINK-1A
16
AC INDICATOR
8
CCLINK-1B
17
POWER CORD 0
9
CCLINK-3A
18
POWER CORD 1

Cambricon ®
Copyright © 2020 Cambricon Corporation 13
5. Electrical specifications
5.1 PCIE topology description
MLU-X1000 MLU extender uses 2 miniSAS HD interfaces to connect with the host server, and there
are 2 PCIE switching chips to connect the PCIE devices inside.PCIE interconnection topology is shown as
follows:
PCIe Switch
Host Server
PCIe Switch
NVMe
NIC
NVMe
NIC
reserved
1Figure 5.1 PCIE Connection topology
PCIE signal rate is 16 Gbps, and the cable loss is controlled within 15 dB @8GHz. It is recommended
to use 1 meter cable with a diameter of 30 AWG.
The pins of the miniSAS HD connectors used by PCIE interfaces are defined as follows:

Cambricon ®
Copyright © 2020 Cambricon Corporation 14
1Table 5.1 PCIE Interface pin definition
miniSAS HD pin Note Pin internal processing
RX [15:0]P/N PCIE input signal
External AC coupling
capacitance
TX [15:0]P/N PCIE output signal
External AC coupling
capacitance
SMCLK SMBUS interface clock signal 4.7 KΩpull-up to 3.3 V
SMDAT SMBUS interface data signal 4.7 KΩpull-up to 3.3 V
PERST# Reset signal
REFCL K P/N PCIE clock signal
PRESENT Opposite side in position detection signal 4.7 KΩpull-up to 3.3 V
5.2 CCLINK interface description
MLU-X1000 MLU extender is equipped with 4 MLU290-M5 Intelligent processing cards, each card
has 6 CCLINK ports. Among them, 4 ports are used for internal interconnection and 2 ports are used for
external interconnection. The CCLink interconnection topology between the internal cards is as follows:

Cambricon ®
Copyright © 2020 Cambricon Corporation 15
QSFP-DD
MLU290-0MLU290-1
MLU290-2 MLU290-3
QSFP-DD
QSFP-DD
QSFP-DD
QSFP-DD
11
2
5
5
2
4
4
25
25
4
4
11
3
0
3
0
3
0
3
0
QSFP-DD QSFP-DD
QSFP-DD
2Figure 5.2 CCLINK internal connection topology
CCLINK interconnection between extenders refer to the following figure:
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
Rack Rack
四卡Server QSFP-DD
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
MLU290-0
SerDes 3
MLU290-0
SerDes 0
MLU290-2
SerDes 3
MLU290-2
SerDes 0
MLU290-1
SerDes 3
MLU290-1
SerDes 0
MLU290-3
SerDes 3
MLU290-3
SerDes 0
3Figure 5.3 External CCLINK connection reference
The signal rate of CCLINK is 50 Gbps, and the cable loss is controlled within 10 dB @12.5GHz. It is
recommended to use 1 meter cable with a diameter of 30 AWG or 2 meter cable with a diameter of 28
AWG .
CCLINK interface uses QSFP DD connectors whose pins are defined as follows:

Cambricon ®
Copyright © 2020 Cambricon Corporation 16
2Table 5.2 CCLINK Interface pin definition
QSFP-DD pins Note Internal processing of
pins
RX [8:1]P/N
SERDES signal input with
AC coupling
capacitance inside
External AC coupling
capacitance is not
required
TX [8:1]P/N
SERDES signal output with AC coupling
capacitance inside
External AC coupling
capacitance is not
required
SCL I2C interface clock signal of optical module 4.7 KΩpull-up to 3.3 V
SDA I2C interface data signal of optical module 4.7 KΩpull-up to 3.3 V
ModPrsL Optical module in position signal output 4.7 KΩpull-up to 3.3 V
ModSelL Selection signal of optical module, default pull-
up inside
1KΩpull-down to
GND
ResetL
Reset signal, low level effective
4.7 KΩpull-up to 3.3 V
IntL
Interrupt signal of optical module, OC gate, low
level indicates an interrupt signal
4.7 KΩpull-up to 3.3 V
InitMode Initialization mode 1KΩpull-down to
GND
VccRx,VccRx1,Vcc1,Vcc2
VccTx ,VccTx1
Power signal
5.3 Power Interface Description
MLU-X1000 MLU extender Input Power Requirements:
3Table 5.3 MLU-X1000 Input Power Supply Specifications
Input voltage
Max. Input Current
AC 100-127V,60/50Hz
9.85 A-12.5A
AC 200-210V,60/50Hz
12.8-13.5A
AC 210-240V,60/50Hz
12.5-14.5A
DC 240V (China mainland only)
12.5A
MLU-X1000 MLU extender is able to reduce power consumption adjustment for instantaneous power
changes above the µs level. The power regulator can support power fluctuations within the ms level
(e.g .1.2 x TDP).

Cambricon ®
Copyright © 2020 Cambricon Corporation 17
4Table 5.4 EDPp specifications of MLU-X1000
EDP
Duration
TBD
TBD