RadiSys ATCA-4616 Service manual

Reference
COMPUTE PROCESSING MODULE
ATCA-4616
ATCA-4618
ATCA-4648
March 2012 007-03446-0000

Revision history
Version Date Description
-0000 March 2012 First edition.
©2012byRadiSysCorporation.Allrightsreserved.
RadisysisaregisteredtrademarkofRadiSysCorporation.AdvancedTCA,ATCA,andPICMGareregisteredtrademarksofPCIIndustrial
ComputerManufacturersGroup.
Allothertrademarks,registeredtrademarks,servicemarks,andtradenamesarethepropertyoftheirrespectiveowners.

3
Table of Contents
Preface ................................................................................................................................................ 7
About this manual........................................................................................................................................7
Where to get more product information .......................................................................................................7
About related Radisys products...................................................................................................................8
Standards information .................................................................................................................................8
Related documents......................................................................................................................................8
Electrostatic discharge ..............................................................................................................................10
Notational conventions ..............................................................................................................................10
Chapter 1: Product Overview.......................................................................................................... 11
Introduction................................................................................................................................................11
Major features...........................................................................................................................................11
Supported external interfaces....................................................................................................................12
Specification compliance ...........................................................................................................................13
Product options..........................................................................................................................................14
Chapter 2: Hardware Description.................................................................................................... 15
Introduction................................................................................................................................................15
Functional block diagram...........................................................................................................................16
ATCA-46xx front panel components..........................................................................................................17
Front panel connectors .........................................................................................................................18
Front panel LEDs..................................................................................................................................19
Reset and hot swap switches ...............................................................................................................20
Headers and jumpers ...........................................................................................................................20
Rear panel connectors ..............................................................................................................................21
Alignment keys .....................................................................................................................................21
Zone 1 connector..................................................................................................................................21
Zone 2 connectors................................................................................................................................21
Zone 3 connectors................................................................................................................................22
ATCA-46xx board components..................................................................................................................23
Heatsinks..............................................................................................................................................24
Major components ................................................................................................................................24
Intel® Xeon® E5-2400 family processor...............................................................................................25
Memory.................................................................................................................................................27

4
Table of Contents
Intel C600 series Platform Controller Hub (PCH) .................................................................................29
IPMI controller.......................................................................................................................................33
CPU Complex (CC) FPGA....................................................................................................................34
IPMI FPGA............................................................................................................................................36
Intel I350 quad GbE Ethernet controller................................................................................................36
Mellanox dual 40GbE controller............................................................................................................36
Clock synthesizer subsystem ...............................................................................................................37
Reset subsystems ................................................................................................................................37
Watchdog timers...................................................................................................................................39
Power subsystems................................................................................................................................40
Trusted Platform Module (TPM)............................................................................................................42
MXM type A video module (optional)....................................................................................................43
1.8” Solid State Drive (SSD) module (optional) ....................................................................................43
eUSB Embedded Flash module (optional)............................................................................................44
Chapter 3: Software/Firmware Description.................................................................................... 45
Introduction................................................................................................................................................45
System BIOS.............................................................................................................................................45
System BIOS features ..........................................................................................................................45
BIOS setup menus................................................................................................................................45
RAS support .........................................................................................................................................58
IPMC functions ..........................................................................................................................................61
Software/Firmware Update Support ..........................................................................................................61
Operating System Support ........................................................................................................................62
Chapter 4: Operation and Maintenance.......................................................................................... 63
Introduction................................................................................................................................................63
Hot Swap of the CPM ................................................................................................................................63
IPMI-Over-LAN ..........................................................................................................................................63
Configuring IPMI-over-LAN access.......................................................................................................63
Serial-Over-LAN ........................................................................................................................................65
Establishing a SOL session ..................................................................................................................66
Firmware and software upgrade................................................................................................................67
Overview of firmware updates ...................................................................................................................68

5
Table of Contents
Chapter 5: Troubleshooting and Repair......................................................................................... 69
Introduction................................................................................................................................................69
Field Replaceable Units (FRUs) ................................................................................................................69
FRU information areas used.................................................................................................................69
CPM and FRU device IDs.....................................................................................................................70
CPM replacement procedures...................................................................................................................71
Removing the CPM...............................................................................................................................71
Removing the CPM board cover...........................................................................................................72
Installing the CPM board cover.............................................................................................................72
Installing the CPM.................................................................................................................................72
Memory module replacement procedures .................................................................................................73
Adding or replacing memory modules ..................................................................................................73
MXM module installation/replacement procedures....................................................................................75
Installing an MXM module ....................................................................................................................75
Removing an MXM module ..................................................................................................................76
eUSB module installation/replacement procedures...................................................................................76
Installing an eUSB module ...................................................................................................................77
Removing an eUSB module .................................................................................................................77
Troubleshooting Topics .............................................................................................................................77
General troubleshooting tips.................................................................................................................77
Symptoms and recommended actions..................................................................................................78
Sensor alarm troubleshooting...............................................................................................................79
Appendix A: Specifications............................................................................................................. 80
Standards and interfaces...........................................................................................................................80
Environmental specifications .....................................................................................................................81
Safety specifications..................................................................................................................................82
Mechanical dimensions .............................................................................................................................82
Electromagnetic compatibility (EMC).........................................................................................................83
Network Equipment Building Standard (NEBS).........................................................................................84
Additional compliance................................................................................................................................84
Mean time between failures (MTBF)..........................................................................................................85
Environmental assumptions..................................................................................................................85
General assumptions............................................................................................................................85
General notes .......................................................................................................................................85

6
Table of Contents
Appendix B: IPMI Commands and Managed Sensors .................................................................. 86
IPMI command interfaces..........................................................................................................................86
IPMI commands.........................................................................................................................................86
OEM command descriptions.................................................................................................................89
Managed sensors ......................................................................................................................................95
Types of sensors ..................................................................................................................................95
IPMI Sensors ........................................................................................................................................96
Appendix C: Pinouts and Mapping.............................................................................................. 108
Front panel connectors............................................................................................................................108
COM serial connector .........................................................................................................................108
Dual USB connectors .........................................................................................................................108
Dual Ethernet connectors ...................................................................................................................109
Mini-DisplayPort connector.................................................................................................................109
Backplane interfaces ...............................................................................................................................110
Backplane connectivity summary........................................................................................................110
Zone 1 P10 connector pinout..............................................................................................................111
Zone 2 J20 connector pinout ..............................................................................................................112
Zone 2 J23 connector pinout ..............................................................................................................112
RTM interface pinout ...............................................................................................................................113
Zone 3 J30 connector pinout ..............................................................................................................113
Zone 3 J31 connector pinout ..............................................................................................................113
Onboard switches, headers, and connectors ..........................................................................................114
Onboard switches...............................................................................................................................114
Onboard headers................................................................................................................................114
Onboard connectors ...........................................................................................................................115

7
Preface
About this manual
ThismanualdescribestheATCA‐46xx,acomputeprocessingmodule(CPM),whichisfully
compliantwithAdvancedTCA®(ATCA®).TheCPMisdesignedtobeincorporatedintoHigh
Availability(HA)systemssuchastheRadisysplatformsSYS‐6006andSYS‐6010.
UsethismanualasahardwarereferencefortheoperationandmaintenanceoftheATCA‐46xx
CPM.Themanualalsoprovidesinformationontheelectrical,themechanical,andthe
environmentalaspectsoftheATCA‐46xxCPM.Thematerialpresentedhereisnot
introductory;itisassumedthatyouarealreadyfamiliarwiththeintendeduseoftheATCA‐
46xxCPMinyourorganization’sATCAplatform.
Thesimplifiednames“CPM”and“module”willbeusedinplaceof“ATCA‐46xxCPM”forthe
bodytextintheremainderofthismanual.
Note:Thesoftwarematerialsincesoftwarerelease3.2.0nowresidesintheSoftwareGuide
forManagementProcessorsandGeneralComputingProcessorsandtheCommandLine
InterfaceReference.ThesemanualsconsolidatethesoftwareinformationfortheATCA
modules.
Where to get more product information
VisittheRadisyswebsiteatwww.radisys.comforproductinformationandotherresources.
Downloads(manuals,releasenotes,software,etc.)areavailableat
www.radisys.com/downloads.
SeethefollowingresourcesforinformationontheCPMnotdescribedinthismanual:
•Installationandinitialsetupinstructions.TheATCA‐4xxxComputeProcessingModule
InstallationGuideprovidesthestepsforinstallingtheCPMintoashelfandcompletingthe
initialconfiguration.
•Platformhardwareinformation.TheCPMisincorporatedintoplatformsystemssuchas
theRadisysplatformsSYS‐6002,SYS‐6014,andSYS‐6016.Forinformationaboutthe
platformsandtheirshelfhardware,seetheappropriatePlatformHardwareInstallation
GuideandthePlatformHardwareReference.EachInstallationGuideprovidesthesteps
forinstallingandsettinguptheplatform’sshelfandeachReferencedescribesthe
platform’sfeaturesandoperation.
•Commandlineinterface(CLI)referenceinformation.TheCommandLineInterface
ReferencedescribesthemasterCLIanditscommandmodesandservesasareferencefor
commandsyntaxandoptions.Whenreferencedinthismanual,thesimplifiednameofCLI
Referencewillbeused.

Preface
8
•Softwarereferenceinformation.TheSoftwareGuideforManagementProcessorsand
GeneralComputingProcessorsdescribessoftwareconceptsandservesasareferencefor
proceduralandusageinformation.Whenreferencedinthismanual,thesimplifiedname
ofSoftwareGuidewillbeused.
•ShelfManagerinformation.TheShelfManagementSoftwareReferencedescribesthe
architectureandtheoperationoftheShelfManager.TheShelfManagertypicallyrunson
theSCMandcontrolsandmonitorsoperationsontheshelf.
•Updateinformation.FirmwareandsoftwareupdatesmaybeavailablefortheCPM
componentsfromtimetotime.ForinformationonupdatingcomponentsontheCPMand
othermodules,seetheFirmwareandSoftwareUpdateInstructions.
About related Radisys products
TheATCA‐46xxCPMispartofthefollowingRadisysplatforms:SYS‐6002andSYS‐6014/6016.
ForinformationontheATCAproductfamilyandotherRadisysproducts,seetheRadisysWeb
siteatwww.radisys.com.
Standards information
ForinformationaboutthePCIIndustrialComputerManufacturersGroup(PICMG®)andthe
AdvancedTCAstandard,consultthePICMGWebsitehttp://www.picmg.org).
Related documents
AdvancedSwitchingCoreArchitectureSpecificationRevision1.0,AdvancedSwitching
InterconnectSpecialInterestGroup,December2003.
IEC60950‐1:2005(SecondEdition),InternationalElectrotechnicalCommission(www.iec.ch)
AdditionallyevaluatedtoEN60950‐1:2006/A11:2009;National.Differencesspecifiedinthe
CBTestReport.
InformationTechnology‐SerialAttachedSCSI‐1.1(SAS‐1.1),ANSI/INCITS417‐2006
UL60950‐1:2007,2ndEdition,(InformationTechnologyEquipment‐Safety‐Part1:General
Requirements)
CSAC22.2No.60950:2007,2ndEdition,(InformationTechnologyEquipment‐Safety‐Part1:
GeneralRequirements)
DDR3SDRAMVLPRDIMMMT36JBZS51272PY–4GB,Micron.
GR‐1244‐COREClocksfortheSynchronizedNetwork:CommonGenericCriteria,Issue2,
Telcordia,December2000.
TheI2CBusSpecificationVersion2.1,PhilipsSemiconductor,January2000.
IEEEStd1149.1‐2001TestAccessPortandBoundary‐ScanArchitecture,IEEEComputer
Society,June23,2001.

Preface
9
IEEEStd802.3‐2002Telecommunicationsandinformationexchangebetweensystems—Local
andmetropolitanareanetworks—Specificrequirements,Part3:Carriersensemultipleaccess
withcollisiondetection(CSMA/CD)accessmethodandphysicallayerspecifications,IEEE
ComputerSociety,March8,2002.
IntelligentPlatformManagementInterfaceSpecificationv1.5,Revision2.0,IntelCorporation;
HewlettPackardCompany,NECCorporation,andDellComputerCorporation.
LinuxPAMModuleswebsite.http://www.kernel.org/pub/linux/libs/pam/modules.html
MSP20B01BBackplaneExternalProductSpecificationRevision1.0,Intel,August31,2001.
PICMG3.0AdvancedTelecommunicationsComputingArchitectureR3.0,PCIIndustrial
ComputerManufacturersGroup,March24,2008
PICMG3.1R1.0Specification,Ethernet/FibreChannelforAdvancedTCASystems,PICMG,
January22,2003
PICMGAMC.0R2.0AdvancedMezzanineCardBaseSpecification,PCIIndustrialComputer
ManufacturersGroup,November15,2006
PM8380QuadSMX3GQuadSATA/SASMux/Demuxfor3G,PMC‐2031101,Issue8,PMC‐
Sierra,April2005
SerialATARevision2.5,SerialATAInternationalOrganization,October27,2005
PlatformManagementFRUInformationStorageDefinitionv1.0,Revision1.13.
IntegratedRAIDforSASUser’sGuide,
http://www.lsi.com/DistributionSystem/AssetDocument/files/docs/techdocs/storage_stand_
prod/sas/ir_sas_ug.pdffromLSILogicCorporation.

Preface
10
Electrostatic discharge
WARNING!Thisproductcontainsstatic‐sensitivecomponentsandshouldbehandledwithcare.
Failuretoemployadequateanti‐staticmeasurescancauseirreparabledamagetocomponents.
Electrostaticdischarge(ESD)damagecanresultinpartialorcompletedevicefailure,
performancedegradation,orreducedoperatinglife.ToavoidESDdamage,thefollowing
precautionsarestronglyrecommended.
•KeepeachcarrierinitsESDshieldingbaguntilyouarereadytoinstallit.
•Beforetouchingacarrier,attachanESDwriststraptoyourwristandconnectitsotherend
toaknownground.
•Handlethecarrieronlyinanareathathasitsworkingsurfaces,floorcoverings,andchairs
connectedtoaknownground.
•Holdcarrieronlybyitsedgeandmountinghardware.AvoidtouchingPCBcomponents
andconnectorpins.
ForfurtherinformationonESD,visitwww.esda.org.
Notational conventions
This manual uses the following conventions
Allnumbersaredecimalunlessotherwisestated.
BoldText Akeyword.
ItalicText File,function,andutilitynames.
MonoText Screentextandsyntaxstrings.
BoldMonoText Acommandtoenter.
ItalicMonoText Variableparameters.
Brackets[] Commandoptions.
Curlybraces{}Agroupedlistofparameters.
Verticalline|An“OR”inthesyntax.Indicatesachoiceofparameters.

1
Chapter
11
Product Overview
Introduction
TheATCA‐46xxComputeProcessingModule(CPM)isahigh‐end,general‐purposecomputing
modulethatprovidesmulti‐coreprocessingpowerandmultipledata‐storageoptionswithina
singleAdvancedTelecommunicationsComputingArchitecture(ATCA)slot.
Theremainingsectionsinthischapterpresentthemajorfeatures,specificationscompliance,
andproductoptionsthatapplytotheATCA‐46xxCPM.
Major features
ThefollowingmajorfeaturesapplytotheATCA‐46xxCPM:
•DualIntel®Xeon®E5‐2400family64‐bitmulti‐coreprocessorsusing32‐nmprocess
technology
•IntelC600seriesPlatformControllerHub(PCH)
• MultipleGbEinterfaces
•Fabricinterfacesupporting40GbEconnections
• IntelligentPlatformManagementController(IPMC)
•CPUComplexFPGA(CCFPGA)
• Redundant64MbSPIBootFlashdevices
•eUSBFlashMemorymodules(optional)
•TrustedPlatformModule(TPM)
•MXMgraphicsmodule(optional)
• OnboardSATASSDdrives(optional)

1
Product Overview
12
Supported external interfaces
TheATCA‐46xxCPMsupportsbothinternalandexternalinterfaces.Internalinterfacesinclude
thebusesandcommunicationprotocolsthatarefullycontainedwithintheCPMbladeorare
includedwithinthefrontpanel,backplane,orRTMexternalinterfaces.Thefollowingexternal
interfacesaresupportedfortheATCA‐46xxCPM:
•Frontpanelinterfaces:
•DualUSBconnectors(TypeA)
•RJ‐45serialportconnector(RS‐232,COM1)
•DualRJ‐45GbEconnectors
•MiniDisplayPortconnector(whenoptionalMXMvideomoduleisinstalled)
•Resetpushbutton
•HotSwapextractionswitch(partofejectorhandle)
•LEDindicators
•BluehotswapLED
•Redoramberoutofservice(OOS)LED
•Green/amberuser‐defined(APP)LED
•GreenHDDactivityLED
•Green/amberLink/Speed/ActivityLEDs(eachBase/Fabricinterface)
•Backplaneinterfaces(ATCAZone2connectors)
•RTMinterface(ATCAZone3connectors)

1
Product Overview
13
Specification compliance
TheATCA‐46xxCPMcomplieswiththefollowingspecifications:
•PCIIndustrialComputersManufacturersGroup(PICMG)3.0R2.0ECN0002Advanced
TelecommunicationsComputingArchitecture(ATCA)specification
•PICMG3.1R2.0EthernetoverATCA(Options1and9)specification
•Europeanrequirementsforhazardousmaterials(ROHS6/6 )
• Mechanicalandenvironmentalspecifications:
•CE
•FCCClassA
•VCCI‐A
•cUL
•NEBSLevel3(designedtomeet)
•Safetyspecifications:
•USA‐UL60950‐1
•Canada‐CSA22.2#60950‐1
•EU‐EN60950‐1
•Other‐IEC60950‐1
• ElectromagneticCompatibility(EMC)specifications:
• Emissions;radiated/conducted(FCCPart15andEN55022:2006)
• Immunity;ESD(EN61000‐4‐2),radiated(EN61000‐4‐3),fasttransient/burst(EN
61000‐4‐4),surgevoltages(EN61000‐4‐5),conducted(EN61000‐4‐6),magneticfield
(EN61000‐4‐8)

1
Product Overview
14
Product options
TheATCA‐46xxCPMhasthefollowingproductoptions:
• A4616‐CPU‐Base‐Thebasiclow‐powerCPMwith10GFabricinterface,dualIntelXeonsix
coreprocessors,andnoinstalledmemory.
• A4618‐CPU‐Base‐Thebasichigh‐powerCPMwith10GFabricinterface,dualIntelXeon
eightcoreprocessors,andnoinstalledmemory.
• A4648‐CPU‐Base‐Thebasichigh‐powerCPMwith40GFabricinterface,dualIntelXeon
eightcoreprocessorsandnoinstalledmemory.
• A4600‐MEM‐xxGB‐AmemorykitconsistingoftwelveyGBDDR3VLPregisteredDIMM
(RDIMM)modulesthatprovidesatotalofxxGBofRDIMMmemoryfortheCPM.
• A4600‐eUSB‐32GB‐AmemoryexpansionoptionwithtwoeUSBNANDFlashmodules
withacapacityof16GBpermodule.
• A4600‐DSSDMXM‐M‐Amassstorageoptionwithtwo1.8“SolidStateDisk(MLCSSD)
modulesof64GBcapacityeach.TheSSDmodulesmountonadualdrivecarrierthat
connectsthroughtheMXMconnectortotheonboardSATAportsoftheCPM.
Foracurrentlistingofproductoptions,visittheATCA‐46xxproductpageatwww.radisys.com.

2
Chapter
15
Hardware Description
Introduction
TheATCA‐46xxComputeProcessingModule(CPM)usesanumberofhardwarecomponents
toimplementthefunctionsrequiredofanATCAnode.Themajorhardwarecomponentsin
theATCA‐46xxCPMareasfollow:
•DualE5‐2400familyprocessorsmountedinFCLGA1356sockets
•IntelC600seriesPlatformControllerHub(PCH)chipthatsupportsthemajorI/O
functionalityontheCPM.
•SocketsforsixregisteredDIMM(RDIMM)orLoadReducedDIMM(LRDIMM)memory
modulesperprocessorortwelvemodulestotal.SupportedRDIMMsandLRDIMMs
include800,1066,or1333MHzDDR3modulesof1,2,4,8,or16GBcapacityforatotalof
upto96GBperprocessoror192GBtotalforthemodule.
•IntelI350quadGigabitEthernetcontrollerthatsupportstwoGbEEthernetports
connectedtotheBaseInterfacechannelsandGbEEthernetportsroutedtotheCPMfront
panelortheRTMinterface.
•AMellanoxdual40GbEcontrollerthatprovidestwo40GbEthernetportsfortheCPM
fabricinterface.
•HeatsinkstodissipateheatgeneratedbytheE5‐2400familyprocessors,thePCH,andthe
40GbEcontroller.
•Frontpanelconnectorsforserial,video,USB,andEthernet.
•FrontpanelLEDsthatindicateCPMconditionandstatusinformation.
•Zone1(P10),Zone2(J20andJ23),andZone3(J30andJ31)connectorstothebackplane
andRTM.
• (Optional)MXM3.0typeAvideomodule
• (Optional)Oneortwo1.8”microSATASSDdrivesmountedinanMXMDSSDmoduletray
• (Optional)OneortwoeUSBFlashmodules

2
Hardware Description
16
Functional block diagram
Figure 1isafunctionalblockdiagramthatindicatesmajorhardwarecomponentsoftheCPM.
Figure 1. ATCA-46xx Functional Block Diagram
x8 (Gen 3)
1000Base-T to
Base Interface
40G-KR4,10G-KR,
10G-KX4,1000Base-KX to
Fabric Interface
Serial to RTM
USB 2.0 to RTM
COM 1
Optional Video MXM Module
Front
Panel
Reset
Button
Reset
x4 (Gen 2)
Digital
Video
Mini
Di spl ay
Port
x16 PCIe to RTM
RTM-Link
Port 80
Debug
Header
TPM
x16 (Gen 3)
Dual
USB
RJ45
DDR3 VLP RDIM Ms
CH. C
CH. B
CH. A
QPI
DDR3 VLP RDIM Ms
CPU1
CPU0
CH. C
CH. B
CH. A
Optional Dual SSD MXM Module
COM 2
CPM
ATCA-46xx
1000Base-T
3G SAS to RTM
Dual
RJ45
Intel I350
Quad GbE
SMGII/SerDes to RTM
Mellanox
CX3 – Dual 40G
BIOS
Flash
BIOS
Flash
MXM 3.0
Type A Module
SPI LPC
DMI2
USB 2.0
C600 Series
Platform
Controller
Hub (PCH)
SAS
(G)
SATA
(6G)
CPU
Complex
FPGA
ME Flash
SPI
IPMC
Debug
SOL
IPMC
Xeon®
E5-2400
Family CPU
PCIe Gen 3
DDR3
DMI2 PCIe Gen 3
DDR3
Xeon®
E5-2400
Family CPU
1.8"
SSD
1.8"
SSD
x16 (Gen 2)
M
X
M
Fash
eUSB
Flash
eUSB
l
Optional Modules

2
Hardware Description
17
ATCA-46xx front panel components
Thefollowingsectionsusetext,figures,andliststoidentifythephysicalfeaturesoftheCPM.
Figure 2showstheCPMfrontpanelandcallsoutthemajorfeatures.
Figure 2. Front Panel Components
Thumbscrew
Ejector Latch
HDD LED
OOS LED
PWR LED
APP LED
H/S LED
Reset Button
Ejector Latch
Thumbscrew
Video (MiniDP)
Connector
Serial (COM)
Port
Ethernet Ports A,B
(1000Base-T)
USB Ports 0 & 1
Base/Fabric Channel
Status LEDs

2
Hardware Description
18
Front panel connectors
Thereareconnectorsforfourseparateinterfacesonthefrontpanel.Pluggingintothe
connectorsisstraightforward,buttheunderlyinginterfacesneedsomeexplanation.
Theserial(COM)RJ45connectorisanRS232serialinterfacewiththepinoutlistedinTable 39
onpage 108.
TheUSB0andUSB1connectorssupportUSB2.0transactions.AUSBcableconnectedtoa
singledeviceupto5metersawaycanbeusedwiththefrontpanelUSBconnectors.Transfers
atupto480Mbpsandcontinuousloadcurrentsupto500mAaresupportedwiththeseUSB
ports.RefertoTable 40onpage 108fortheUSBconnectorpinout.
TheminiDisplayPortconnectorcanbeconnectedtoadigitalmonitoriftheMXMporthasa
videomoduleinstalled.Refertothevideomoduledocumentationforoperationdetailsfor
thisoption.RefertoTable 42onpage 109fortheconnectorfigureandpinoutlistingofthe
miniDisplayPortconnector.Duringnormaloperationthereisnoneedtoattachamonitorto
thisconnector.
ThetwofrontpanelEthernetconnectorsprovideinterfacestoGbEportswithapeakavailable
bandwidthof100Mbpsor1Gbps.Figure 3showsoneofthefrontpanelEthernetconnectors
andcallsoutthePortStatusandLinkStatusLEDsthatarepartoftheconnector.
Figure 3. Front Panel Ethernet Connectors
Table 1liststhemeaningsassignedtothelightcolor/activityofeachLEDontheEthernet
connector.
Table 1. Front Panel Ethernet Connector LEDs
LED Designation Indication Meaning
Port Status LED ████ Steady Green Port enabled
████ Steady Amber Port in standby mode
No light Port disabled
Link Status LED ████ Steady Green Linked at 1 Gbps peak bandwidth
████Blinking Green Activity at 1 Gbps peak bandwidth
████ Steady Amber Linked at 10/100 Mbps peak bandwidth
████Blinking Amber Activity at 10/100 Mbps peak bandwidth
██ LED off No link
Port Status LED
Link Status LED

2
Hardware Description
19
Front panel LEDs
ThefrontpanelLEDscanbeseparatedintotwomajorgroups;theedgeLEDsalongtheleft
(bottom)edgeofthefrontpanelandtheBase/FabricchannelstatusLEDs.
Table 2describesthestatusandactivityLEDsalongtheleft(bottom)edgeofthefrontpanel.
TheIPMCusesGPIOpinstocontrolthehotswapandpowerLEDs.TheIPMCsuppliesdefault
statesfortheLEDsandrespondstosensorreadings,GPIOinputs,andIPMIcommandsfrom
otherentitiestochangeLEDstates.
Table 2. Front Panel Edge Activity/Status LEDs
LED Designation Indication Meaning
HDD (Hard Disk
Drive) LED
████Short Green blink HDD being accessed
████ LED off No HDD activity, or not installed
OOS
(Out-of-Service)
LED
████ Steady Amber LED LED color and On/Off state controlled by the
IPMC and user-defined application.
████ Steady Red LED
████ LED off Normal operation
PWR
(Health)
LED
████ Steady Green LED Power ON, health good
████ Steady Amber LED Power ON, health not good
████ LED off Power OFF
APP
(Customer-defined
application) LED
████ Steady Green LED Controlled by the IPMC, with functionality
defined by the system implementera
████ Steady Amber LED
████ LED off
H/S
(Hot Swap Status)
LEDb
████Short Blue blink M5, FRU deactivation request or
M6, FRU deactivation in process
████ Steady Blue LED M1, FRU inactive; ready for hot swap
████|Long Blue blink M2, FRU activation request
████
LED off
M0, FRU not installed, or
M3, FRU activation in process, or
M4, FRU active
aThe user application can control LED color and illumination using the Set FRU LED State IPMI
command. LED illumination can be turned on or off, the LED can be configured to blink, or the
lamp test function can be enabled. To use the command, specify the FRU ID, LED ID (which is
“1” for the OOS LED), LED function, LED on duration, and illumination color. Command usage is
described in the PICMG specification, FRU LED Control commands, section 3.2.5.6.
bLED state and blink frequency controlled by the IPMC.

2
Hardware Description
20
Table 3liststhemeaningsassignedtothelightcolor/activityofeachBase/FabricLED.
Note:TheFabricchannelLEDscanbeeithergreenoramberwhenlinkedorindicatingactivity
at10Gbps.Thisisbecauseinoneconfiguration10Gbpsisthelowrangeoutputfromthe
controllerwhileinanotherconfigurationitisthehighrangeoutput.TheLEDindicatesthe
low/highrangeoutput,nottheactuallinkspeed.
Reset and hot swap switches
TheCPMfrontpanelResetbutton(switch)isrecessedandcannormallybepressedonlywith
athin,pointedobjectsuchasapencilorstylus.AcalloutinFigure 2pointsouttheReset
buttonontheCPMfrontpanel.TheResetbuttonperformsaplatformresetoftheCPM.A
platformresetreturnsallregistersanddevices(excepttheIPMC)totheirdefaultstate.
Theejectorlatchesandthumbscrewsareconsideredhotswaphardwarecomponents.Both
thumbscrewsmustbeunscrewedinordertoremovetheCPMfromitsslot.Thebottomlock
andejectorswitchmustbedisengagedinordertosignaltotheIPMCthataCPMhotswapis
desired.TheIPMCthencontrolsthehotswapLEDandmonitorstheprocess.
Headers and jumpers
RefertoAppendixC,Onboardswitches,headers,andconnectors,onpage 114fortables
detailingtheheaderandjumpercallouts.
Table 3. Base/Fabric Channel LEDs
Channel Indication Meaning
Base Channel 1
or
Base Channel 2
████ Steady Green Linked at 1 Gbps peak bandwidth
████Blinking Green Activity at 1 Gbps peak bandwidth
████ Steady Amber Linked at 10/100 Mbps peak bandwidth
████Blinking Amber Activity at 10/100 Mbps peak bandwidth
██ LEDs off Channel not configured or not in use
Fabric Channel 1
or
Fabric Channel 2
████ Steady Green Linked at 10/40 Gbps peak bandwidth
████Blinking Green Activity at 10/40 Gbps peak bandwidth
████ Steady Amber Linked at 1/10 Gbps peak bandwidth
████Blinking Amber Activity at 1/10 Gbps peak bandwidth
██ LEDs off Channel not configured or not in use