Digital Equipment DECmpp12000 User manual

DECmpp12000/SxModel100
ParallelDiskArray
ReferenceManual
Part Number: EK–DECAB–RM. B01
September 1992
This document provides a complete description of the DECmpp 12000/Sx
Parallel Disk Array hardware, its installation and service procedures.
Revision/Update Information: This document has been revised for
DECmpp Version 1.1.
Operating System and Version: ULTRIX Version 4.2A.
Future releases may require higher
versions.
Software Version: DECmpp 12000/Sx Version 1.1.
Digital Equipment Corporation
Maynard, Massachusetts

First Printing, January 1992
Revised, September 1992
The information in this document is subject to change without notice and should not be construed
as a commitment by Digital Equipment Corporation. Digital Equipment Corporation assumes no
responsibility for any errors that may appear in this document.
The software described in this document is furnished under a license and may be used or copied
only in accordance with the terms of such license.
NOTICE—Class A Computing Device:
This equipment generates, uses, and may emit radio frequency energy. The equipment has been
type tested and found to comply with the limits for a Class A computing device pursuant to Subpart
J or Part 15 of FCC rules, which are designed to provide reasonable protection against such radio
frequency interference when operated in a commercial environment. Operation of this equipment in
a residential area may cause interference; in which case, measures taken to correct the interference
are at the user’s expense.
Restricted Rights: Use, duplication, or disclosure by the U.S. Government is subject to restrictions
as set forth in subparagraph (c)(1)(ii) of the Rights in Technical Data and Computer Software
clause at DFARS 252.227-7013.
© Digital Equipment Corporation 1992.
All Rights Reserved.
The postpaid Reader’s Comments forms at the end of this document request your critical evaluation
to assist in preparing future documentation.
The following are trademarks of Digital Equipment Corporation: DECnet, DECstation, DECsupport,
DECsystem, DECwindows, Rdb/VMS, ThinWire, TURBOchannel, ULTRIX, VAX, VAX DOCUMENT,
VMS, and the DIGITAL logo.
The following are registered trademarks of the MasPar Computer Corporation: MasPar and
the MasPar logo. The following are trademarks of the MasPar Computer Corporation: MasPar
Data Display Library (MPDDL), MasPar FORTRAN (MPF), MasPar Input/Output Channel,
MasPar Parallel Application Language (MPL), MasPar Parallel Disk Array (MPDA), and MasPar
Programming Environment (MPPE). UNIX is a registered trademark of UNIX System Laboratories,
Inc.
This document was prepared using VAX DOCUMENT, Version 2.0.

Contents
Preface ............................................................ ix
1 Parallel Disk Array Overview
1.1 Parallel Disk Array Components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–5
1.1.1 DiskArrayController ..................................... 1–6
1.1.2 DAControllerBackplane................................... 1–8
1.1.3 DABackplane ........................................... 1–9
1.1.3.1 DA Controller Interconnect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–11
1.1.3.2 Disk Canister Interconnect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–11
1.1.3.3 MultiplexerInterconnect ................................ 1–11
1.1.3.4 LightpipeInterconnect.................................. 1–11
1.1.3.5 PowerInterconnect .................................... 1–11
1.2 DiskChassis ............................................... 1–12
1.2.1 DiskCanisters........................................... 1–12
1.2.2 MUXPrintedCircuitBoard................................. 1–13
1.2.2.1 DataMultiplexing ..................................... 1–13
1.2.2.2 WriteData........................................... 1–13
1.2.2.3 SectorPulseMonitor ................................... 1–13
1.3 DPU-PDAInterfaceCable ..................................... 1–13
1.4 Power/FanTray ............................................. 1–13
1.4.1 PowerSystem ........................................... 1–15
1.4.2 Power/FanTrayIndicators.................................. 1–16
1.4.3 ExhaustFan ............................................ 1–17
2 Parallel Disk Array Installation
2.1 Parallel Disk Array Site Preparation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–1
2.1.1 PhysicalCharacteristics.................................... 2–1
2.1.1.1 Size and Service Clearance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–1
2.1.1.2 Weight.............................................. 2–1
2.1.2 Power and Cooling Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–1
2.1.3 Power and Environmental Specifications . . . . . . . . . . . . . . . . . . . . . . . 2–3
2.2 PDAInstallation ............................................ 2–4
2.2.1 Unpacking and Positioning the PDA . . . . . . . . . . . . . . . . . . . . . . . . . . 2–4
2.2.1.1 Assembling the Enclosure Skirts . . . . . . . . . . . . . . . . . . . . . . . . . . 2–6
2.2.2 ElectricalInstallation ..................................... 2–7
2.2.2.1 PrintedCircuitBoards.................................. 2–7
2.2.2.2 Installing Disk Array Controller PCBs . . . . . . . . . . . . . . . . . . . . . 2–8
2.2.3 InstallingMUXPCBs ..................................... 2–8
2.3 InstallingDiskCanisters...................................... 2–8
2.3.1 JumpersandTerminators .................................. 2–8
2.4 ConnectingDPUandPDA..................................... 2–11
2.4.1 InstallingtheDPUPCBs................................... 2–11
iii

2.5 SettingDPUJumpers ........................................ 2–15
2.6 TurningOntheDPUandPDA ................................. 2–17
3 Parallel Disk Array System Administration
3.1 Establishing PDA Communications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3–2
3.2 ControllerConfiguration ...................................... 3–5
3.3 SettingUpFileSystems ...................................... 3–7
3.3.1 DefaultPartitions ........................................ 3–7
3.4 UpgradeProcedures.......................................... 3–8
3.4.1 Upgradingto8Disks...................................... 3–8
3.4.2 Upgradingto16Disks..................................... 3–8
4 Disk Formatting
4.1 TheFORMATCommand ...................................... 4–1
4.1.1 OperationExamples....................................... 4–3
4.1.1.1 BringUpaNewBank.................................. 4–3
4.1.1.2 Bringing Up a New Bank with Flaw Data on Host . . . . . . . . . . . . 4–3
4.1.1.3 Formatting Newly Installed Disks Within an Online/Mounted
Bank ............................................... 4–3
4.1.1.4 Reformatting Online/Mounted Banks with Growth Errors
Logged.............................................. 4–4
4.2 TheMOUNTBANKCommand.................................. 4–4
4.3 TheRECONSTRUCTCommand ................................ 4–5
4.3.1 Disabling and Replacing a Drive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4–6
4.3.2 AssigningaStandbyDrive.................................. 4–6
4.3.3 ReconstructingaDrive..................................... 4–6
4.4 TheSCRUBCommand........................................ 4–8
4.5 TheSPECIFYFLAWCommand ................................. 4–9
5 Removal and Replacement Procedures
5.1 Extending the DA Controller Chassis . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–3
5.2 Replacing DA Controller PCBs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–5
5.3 ReplacingDiskCanisters...................................... 5–6
5.4 ReplacingMUXPCBs ........................................ 5–7
5.5 ReplacingtheLightpipePCB................................... 5–8
5.6 ReplacingPower/FanTray..................................... 5–9
5.7 Replacing Power Cables to the DA Backplane . . . . . . . . . . . . . . . . . . . . . . 5–12
5.8 ReplacingClockPCB......................................... 5–14
5.9 Replacing DA Controller Backplane Cabling . . . . . . . . . . . . . . . . . . . . . . . 5–15
5.9.1 Replacing PDA-DPU Interface Cable . . . . . . . . . . . . . . . . . . . . . . . . . . 5–15
5.9.2 Replacing Backplane Disk Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–17
5.10 Replacing the Lightpipe Signal Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–18
5.11 Replacing Lightpipe Power Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–19
5.12 Replacing Temperature Sensor Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–20
iv

6 Parallel Disk Array Diagnostics
6.1 LightpipeIndicatorStatus..................................... 6–1
6.2 DiagnosticProcedures ........................................ 6–3
6.3 DiagnosticEnvironment....................................... 6–3
6.3.1 AutomaticMode.......................................... 6–4
6.4 VMEAdapterTests .......................................... 6–4
6.5 PDATestPrograms .......................................... 6–4
6.5.1 Internal DA Controller Test (da_intern) . . . . . . . . . . . . . . . . . . . . . . . . 6–4
6.5.2 Read/Write Configuration Test (da_config) . . . . . . . . . . . . . . . . . . . . . . 6–4
6.5.3 Read/Write Buffer Test (da_buff) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6–4
6.5.4 MountBankTest(da_mount)................................ 6–4
6.5.5 Read/SeekTest(da_seek)................................... 6–5
6.5.6 Read/Write Disk Test (da_disk) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6–5
6.6 DAControllerTests.......................................... 6–5
6.7 StatusOperations ........................................... 6–5
6.7.1 DiskErrorLogging ....................................... 6–5
6.7.2 ErrorInformation ........................................ 6–7
6.7.3 Extended Transfer Error Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6–9
6.7.4 Command/StatusSummary................................. 6–10
7 Upgrading the Parallel Disk Array
7.1 Upgrading to Eight Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7–2
7.2 Upgrading to Sixteen Disk Drives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7–3
A Configuration Data
A.1 TheREADCONFIGCommand.................................. A–1
A.2 TheWRITECONFIGCommand................................. A–2
A.3 SystemConfigurationTable.................................... A–3
A.3.1 ControllerConfiguration ................................... A–4
A.3.2 Bank Control/Status Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . A–10
A.3.3 Disk Parameter Table Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A–15
A.3.4 BadBlockTable.......................................... A–18
A.3.5 Bank X, Disk X, System Area Configuration . . . . . . . . . . . . . . . . . . . . A–19
A.3.6 SystemAreaHomePage ................................... A–20
A.3.7 System Area RFT and GET Pages . . . . . . . . . . . . . . . . . . . . . . . . . . . . A–21
B Parallel Disk Array System Block Diagrams
B.1 Parallel Disk Array System Block Diagrams . . . . . . . . . . . . . . . . . . . . . . . B–1
C Recommended Spares List
D Disk Array Variations and Options
v

E Parallel Disk Array Reference Pages
dabinit(8).................................................. E–2
dabstat(8).................................................. E–3
dadisk(8) .................................................. E–4
dadsbl(8) .................................................. E–5
daflaw(8) .................................................. E–6
daformat(8) ................................................ E–8
dainit(8)................................................... E–10
damapchs(8)................................................ E–11
damount(8)................................................. E–12
darecon(8) ................................................. E–13
dascrub(8) ................................................. E–14
daspecflaw(8)............................................... E–16
dastat(8)................................................... E–17
dasubs(8) .................................................. E–18
daxformat(8)................................................ E–19
daxrdc(8) .................................................. E–20
daxscrub(8) ................................................ E–21
daxwrc(8).................................................. E–22
da_error_log(8).............................................. E–23
da_error_report(8) ........................................... E–24
Index
Figures
1–1 DECmpp 12000/Sx Parallel Disk Array . . . . . . . . . . . . . . . . . . . . . . . . 1–2
1–2 Parallel Disk Array, Model SMP11-AA . . . . . . . . . . . . . . . . . . . . . . . . . 1–3
1–3 Parallel Disk Array, Model SMP11-AB . . . . . . . . . . . . . . . . . . . . . . . . . 1–4
1–4 Parallel Disk Array, Model SMP11-AC . . . . . . . . . . . . . . . . . . . . . . . . . 1–5
1–5 DAControllerFrontPanel.................................. 1–6
1–6 DA Controller Slot Assignments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–7
1–7 DAControllerBackplane................................... 1–8
1–8 DA Drive Backplane (front) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–9
1–9 DADriveBackplane(rear).................................. 1–10
1–10 DiskDriveCanister....................................... 1–12
1–11 Power/FanTray .......................................... 1–14
1–12 PowerBridgeandCables................................... 1–16
1–13 Power/Fan Tray Service Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–16
2–1 Parallel Disk Array Enclosure Dimensions . . . . . . . . . . . . . . . . . . . . . 2–2
2–2 Removing Enclosure Shipping Bracket . . . . . . . . . . . . . . . . . . . . . . . . 2–4
2–3 PDAEnclosureLevelers.................................... 2–5
2–4 FrontandSideSkirts ..................................... 2–6
2–5 RearSkirt .............................................. 2–7
2–6 Disk Drive PCB (Component Side) . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–10
2–7 InsertingDiskCanister .................................... 2–11
vi

2–8 DPUCardCage.......................................... 2–12
2–9 DA Interface PCB Cable Connections . . . . . . . . . . . . . . . . . . . . . . . . . 2–13
2–10 Data Parallel Unit Card Cage Slots . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–14
2–11 DPU Backplane Jumper Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2–16
5–1 PDAEnclosure(rear)...................................... 5–2
5–2 Extending the Disk Array Controller . . . . . . . . . . . . . . . . . . . . . . . . . . 5–4
5–3 Replacing the DA Controller PCB . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–5
5–4 Power/FanTray(rear) ..................................... 5–10
5–5 Replacing the Power/Fan Tray . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5–11
5–6 PowerBridgeandCables................................... 5–13
5–7 ReplacingtheClockPCB................................... 5–14
6–1 PDAFrontIndicators...................................... 6–2
B–1 FullSystemBlockDiagram................................. B–1
B–2 Disk Array Controller Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . B–2
B–3 Disk Array Backplane Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . B–2
Tables
1RelatedDocuments ....................................... x
1–1 PDAConfigurations....................................... 1–2
1–2 DABackplaneConnectors .................................. 1–10
1–3 PowerSystemCapabilities.................................. 1–15
1–4 Backplane Power Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–15
1–5 Power/Fan Tray Service Indicators . . . . . . . . . . . . . . . . . . . . . . . . . . . 1–17
2–1 PDASpecifications........................................ 2–3
4–1 BankConfigurations ...................................... 4–7
6–1 DiagnosticPrograms ...................................... 6–3
6–2 StatusBitDefinitions ..................................... 6–7
6–3 Command-Related Error Codes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6–10
A–1 READCONFIG Command Status . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A–2
A–2 System Configuration Byte Organization . . . . . . . . . . . . . . . . . . . . . . . A–3
A–3 Controller Configuration Block Byte Organization . . . . . . . . . . . . . . . . A–4
A–4 Controller Configuration Block Bit Description . . . . . . . . . . . . . . . . . . A–5
A–5 Disk Error Log Select Bit Descriptions . . . . . . . . . . . . . . . . . . . . . . . . A–7
A–6 32-Byte Bank Control/Status Block . . . . . . . . . . . . . . . . . . . . . . . . . . . A–10
A–7 #2 Byte Bank Control/Status Block Description . . . . . . . . . . . . . . . . . . A–11
A–8 Error Checking and Correcting Bit Descriptions . . . . . . . . . . . . . . . . . A–13
A–9 BitStatusandConditions .................................. A–14
A–10 Disk Parameter Table Byte Organization . . . . . . . . . . . . . . . . . . . . . . A–15
A–11 Drive Type and Flag Bit Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . A–16
A–12 Values for Disk Parameter Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A–17
A–13 Bad Block Table Byte Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . A–18
A–14 Home Page Byte Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A–20
A–15 Home Page Byte Group Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . A–20
C–1 ParallelDiskArrayRSL ................................... C–1
D–1 DECmpp Disk Array Variations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . D–1
vii

Preface
The SMP11-Ax Parallel Disk Array (PDA) is a random access, hard disk storage
device designed to complement the DECmpp 12000/Sx and DECmpp 12000–LC/Sx
Series Massively Parallel Processing systems.
This document provides a description of the Parallel Disk Array hardware
and how to install and service it. Anyone who services the PDA and needs to
replace any components in it should read this manual and be familiar with the
procedures.
Intended Audience
This guide is for use by Digital Services personnel and by self-maintenance
customers who will be servicing the PDA system. It may also be used by PDA
system administrators.
Document Structure
This manual contains seven chapters and five appendixes:
• Chapter 1 is a general overview of the PDA configurations and components.
• Chapter 2 contains installation procedures, including connecting the PDA to
the DECmpp 12000/Sx system data parallel unit (DPU) and powering up the
PDA.
• Chapter 3 describes system administration procedures for bringing the PDA
online.
• Chapter 4 explains the disk formatting instructions.
• Chapter 5 explains how to replace the various PDA field replaceable units.
• Chapter 6 explains the indicator display and the diagnostic procedures and
tests.
• Chapter 7 describes procedures for upgrading the PDA to larger storage
configurations.
• Appendix A contains PDA configuration data tables.
• Appendix B contains system block diagrams.
• Appendix C lists the PDA recommended spare parts.
• Appendix D lists PDA option variants.
• Appendix E contains PDA-specific reference pages.
ix

Related Documents
Table 1 is a list of documents that provide additional information about the PDA
and the DECmpp 12000/Sx system.
Table 1 Related Documents
Document Title Order Number
DECmpp 12000/Sx System Overview Manual AA-PMAPB-TE
DECmpp 12000/Sx System Administration Guide AA-PKU3C-TE
DECmpp 12000/Sx Parallel VME Reference Manual EK-DECAB-PM
DECmpp 12000/Sx Hardware Installation Guide EK-DECAC-IG
x