Fujitsu M10/SPARC M10 User manual

Fujitsu M10/SPARC M10 Systems
PCI Card Installation Guide
Manual Code: C120-E710-04EN
July 2014

Copyright © 2007, 201
4
, Fujitsu Limited. All rig
h
ts reserved.
Ora le
and/or its affiliates provided te hni al input and review on portions of this material.
Ora le
and/or its affiliates and Fujitsu Limited ea h own or ontrol intelle tual property rights relating to produ ts and te hnology des ribed in this do ument, and su h produ ts,
te hnology and this do ument are prote ted by opyright laws, patents, and other intelle tual property laws and international treaties.
This
do ument and the produ t and te hnology to whi h it pertains are distributed under li enses restri ting their use, opying, distribution, and de ompilation. No part of su h
produ t or te hnology, or of this do ument, may be reprodu ed in any form by any means without prior written authorization of Ora le and/or its affiliates and Fujitsu Limited, and
their appli able li ensors, if any. The furnishings of this do ument to you does not give you any rights or li enses, express or implied, with respe t to the produ t or te hnology to
whi h it pertains, and this do ument does not ontain or represent any ommitment of any kind on the part of Ora le or Fujitsu Limited or any affiliate of either of them.
This
do ument and the produ t and te hnology des ribed in this do ument may in orporate third-party intelle tual property opyrighted by and/or li ensed from the suppliers to
Ora le and/or its affiliates and Fujitsu Limited, in luding software and font te hnology.
Per
the terms of the GPL or LGPL, a opy of the sour e ode governed by the GPL or LGPL, as appli able, is available upon request by the End User. Please onta t Ora le and/or its
affiliates or Fujitsu Limited. This distribution may in lude materials developed by third parties. Parts of the produ t may be derived from Berkeley BSD systems, li ensed from the
University of California.
UNIX
is a registered trademark of The Open Group.
Ora le
and Java are registered trademarks of Ora le and/or its affiliates.
Fujitsu
and the Fujitsu logo are registered trademarks of Fujitsu Limited.
SPARC
Enterprise, SPARC64, SPARC64 logo and all SPARC trademarks are trademarks or registered trademarks of SPARC International, In . in the United States and other
ountries and used under li ense.
Other
names may be trademarks of their respe tive owners.
If
this is software or related do umentation that is delivered to the U.S. Government or anyone li ensing it on behalf of the U.S. Government, the following noti e is appli able:
U.S.
GOVERNMENT END USERS: Ora le programs, in luding any operating system, integrated software, any programs installed on the hardware, and/or do umentation, delivered
to U.S. Government end users are " ommer ial omputer software" pursuant to the appli able Federal A quisition Regulation and agen y-spe ifi supplemental regulations. As su h,
use, dupli ation, dis losure, modifi ation, and adaptation of the programs, in luding any operating system, integrated software, any programs installed on the hardware, and/or
do umentation, shall be subje t to li ense terms and li ense restri tions appli able to the programs. No other rights are granted to the U.S. Government.
Dis laimer:
The only warranties granted by Ora le and Fujitsu Limited, and/or any affiliate in onne tion with this do ument or any produ t or te hnology des ribed herein are those
expressly set forth in the li ense agreement pursuant to whi h the produ t or te hnology is provided.
EXCEPT
AS EXPRESSLY SET FORTH IN SUCH AGREEMENT, ORACLE OR FUJITSU LIMITED, AND/OR THEIR AFFILIATES MAKE NO REPRESENTATIONS OR WARRANTIE
S
OF ANY KIND (EXPRESS OR IMPLIED) REGARDING SUCH PRODUCT OR TECHNOLOGY OR THIS DOCUMENT, WHICH ARE ALL PROVIDED AS IS, AND ALL EXPRESS
OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING WITHOUT LIMITATION ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS
FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Unless otherwise expressly set forth in su h agreement, to the extent allowed by appli able law, in no event shall Ora le or Fujitsu Limited, and/or any of their affiliates have any
liability to any third party under any legal theory for any loss of revenues or profits, loss of use or data, or business interruptions, or for any indire t, spe ial, in idental or
onsequential damages, even if advised of the possibility of su h damages.
DOCUMENTATION
IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY IMPLIED
WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH
DISCLAIMERS ARE HELD TO BE LEGALLY INVALID.
Copyright
© 2007, 2014, Fujitsu Limited. Tous droits réservés.
Ora le
et/ou ses affiliés ont fourni et vérifié des données te hniques de ertaines parties de e omposant.
Ora le
et/ou ses affiliés et Fujitsu Limited détiennent et ontrôlent ha un des droits de propriété intelle tuelle relatifs aux produits et te hnologies dé rits dans e do ument. De
même, es produits, te hnologies et e do ument sont protégés par des lois sur le droit d’auteur, des brevets, et d'autres lois sur la propriété intelle tuelle et des traités internationaux.
Ce
do ument, le produit et les te hnologies afférents sont ex lusivement distribués ave des li en es qui en restreignent l'utilisation, la opie, la distribution et la dé ompilation.
Au une partie de e produit, de es te hnologies ou de e do ument ne peut être reproduite sous quelque forme que e soit, par quelque moyen que e soit, sans l'autorisation é rite
préalable d'Ora le et/ou ses affiliés et de Fujitsu Limited, et de leurs éventuels on édants de li en e. Ce do ument, bien qu'il vous ait été fourni, ne vous onfère au un droit et
au une li en e, exprès ou ta ites, on ernant le produit ou la te hnologie auxquels il se rapporte. Par ailleurs, il ne ontient ni ne représente au un engagement, de quelque type que
e soit, de la part d'Ora le ou de Fujitsu Limited, ou des so iétés affiliées de l'une ou l'autre entité.
Ce
do ument, ainsi que les produits et te hnologies qu'il dé rit, peuvent in lure des droits de propriété intelle tuelle de parties tier es protégés par le droit d’auteur et/ou édés sous
li en e par des fournisseurs à Ora le et/ou ses so iétés affiliées et Fujitsu Limited, y ompris des logi iels et des te hnologies relatives aux poli es de ara tères.
Conformément
aux onditions de la li en e GPL ou LGPL, une opie du ode sour e régi par la li en e GPL ou LGPL, selon le as, est disponible sur demande par l'Utilisateur Final.
Veuillez onta ter Ora le et/ou ses affiliés ou Fujitsu Limited. Cette distribution peut omprendre des omposants développés par des parties tier es. Des parties de e produit
pourront être dérivées des systèmes Berkeley BSD li en iés par l'Université de Californie.
UNIX
est une marque déposée de The OpenGroup.
Ora le
et Java sont des marques déposées d'Ora le Corporation et/ou de ses affiliés.
Fujitsu
et le logo Fujitsu sont des marques déposées de Fujitsu Limited.
SPARC
Enterprise, SPARC64, le logo SPARC64 et toutes les marques SPARC sont utilisées sous li en e et sont des marques déposées de SPARC International, In ., aux Etats-Unis et
dans d'autres pays.
Tout
autre nom mentionné peut orrespondre à des marques appartenant à leurs propriétaires respe tifs.
Si
e logi iel, ou la do umentation qui l'a ompagne, est on édé sous li en e au Gouvernement des Etats-Unis, ou à toute entité qui délivre la li en e de e logi iel ou l'utilise pour le
ompte du Gouvernement des Etats-Unis, la noti e suivante s'applique :
U.S.
GOVERNMENT END USERS: Ora le programs, in luding any operating system, integrated software, any programs installed on the hardware, and/or do umentation, delivered
to U.S. Government end users are " ommer ial omputer software" pursuant to the appli able Federal A quisition Regulation and agen y-spe ifi supplemental regulations. As su h,
use, dupli ation, dis losure, modifi ation, and adaptation of the programs, in luding any operating system, integrated software, any programs installed on the hardware, and/or
do umentation, shall be subje t to li ense terms and li ense restri tions appli able to the programs. No other rights are granted to the U.S. Government.
Avis
de non-responsabilité : les seules garanties o troyées par Ora le et Fujitsu Limited et/ou toute so iété affiliée de l'une ou l'autre entité en rapport ave e do ument ou tout
produit ou toute te hnologie dé rits dans les présentes orrespondent aux garanties expressément stipulées dans le ontrat de li en e régissant le produit ou la te hnologie fournis.
SAUF
MENTION CONTRAIRE EXPRESSEMENT STIPULEE AU DIT CONTRAT, ORACLE OU FUJITSU LIMITED ET/OU LES SOCIETES AFFILIEES A L'UNE OU L'AUTRE
ENTITE DECLINENT TOUT ENGAGEMENT OU GARANTIE, QUELLE QU'EN SOIT LA NATURE (EXPRESSE OU IMPLICITE) CONCERNANT CE PRODUIT, CETTE
TECHNOLOGIE OU CE DOCUMENT, LESQUELS SONT FOURNIS EN L'ETAT. EN OUTRE, TOUTES LES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES OU
TACITES, Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L'APTITUDE A UNE UTILISATION PARTICULIERE OU A
L'ABSENCE DE CONTREFACON, SONT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE. Sauf mention ontraire expressément stipulée dans e ontrat,
dans la mesure autorisée par la loi appli able, en au un as Ora le ou Fujitsu Limited et/ou l'une ou l'autre de leurs so iétés affiliées ne sauraient être tenues responsables envers une
quel onque partie tier e, sous quelque théorie juridique que e soit, de tout manque à gagner ou de perte de profit, de problèmes d'utilisation ou de perte de données, ou
d'interruptions d'a tivités, ou de tout dommage indire t, spé ial, se ondaire ou onsé utif, même si es entités ont été préalablement informées d'une telle éventualité.
LA
DOCUMENTATION EST FOURNIE "EN L'ETAT" ET TOUTE AUTRE CONDITION, DECLARATION ET GARANTIE, EXPRESSE OU TACITE, EST FORMELLEMENT
EXCLUE, DANS LA MESURE AUTORISEE PAR LA LOI EN VIGUEUR, Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE,
A L'APTITUDE A UNE UTILISATION PARTICULIERE OU A L'ABSENCE DE CONTREFACON.

Contents
Preface v
Chapter 1 PCI Card Mounting Rules for the SPARC M10-1 1
1.1 Prerequisites 1
1.1.1 Domain OS 1
1.1.2 System firmware XCP version 2
1.2 Maximum Number of Eac Type of Mounted PCI Card and Available
PCI Slots 2
1.2.1 If XCP2050 or later is used and Oracle Solaris 11 is installed on
all t e domains 3
1.2.2 If XCP2050 or later is used and Oracle Solaris 10 is installed on
all t e domains or if XCP2050 or later is used and Oracle Solaris
11 and Oracle Solaris 10 are mixed 6
1.2.3 XCP2044 or earlier 12
1.3 Hardware Configuration Diagram 17
Chapter 2 PCI Card Mounting Rules
for the SPARC M10-4 19
2.1 Prerequisites 19
2.1.1 Domain OS 19
2.1.2 System firmware XCP version 20
2.1.3 Number of CPUs and number of root complexes 20
2.2 Maximum Number of Eac Type of Mounted PCI Card and Available
PCI Slots 21
iii

2.2.1 If XCP2050 or later is used and Oracle Solaris 11 is installed on
all t e domains 22
2.2.2 If XCP2050 or later is used and Oracle Solaris 10 is installed on
all t e domains or if XCP2050 or later is used and Oracle Solaris
11 and Oracle Solaris 10 are mixed 26
2.2.3 XCP2044
or earlier 34
2.3 Relations ip between t e CPU Configuration and t e Number of Root
Complexes 42
Chapter PCI Card Mounting Rules for the SPARC M10-4S 47
3.1 Prerequisites 47
3.1.1 Domain OS 47
3.1.2 System firmware XCP version 48
3.1.3 Number of CPUs and number of root complexes 48
3.2 Maximum
Number of Eac Type of Mounted PCI Card and Available
PCI Slots 49
3.2.1 If XCP2050 or later is used and Oracle Solaris 11 is installed on
all t e domains 50
3.2.2 If XCP2050 or later is used and Oracle Solaris 10 is installed on
all t e domains or if XCP2050 or later
is used and Oracle Solaris
11 and Oracle Solaris 10 are mixed 54
3.2.3 XCP2044 or earlier 62
3.3 Relations ip between t e CPU Configuration and t e Number of Root
Complexes 70
Chapter 4 Factory-default Mounting Order of PCI Cards 75
Appendix A Cards that Support PCI Hot Plug and Dynamic Reconfiguration
81
Appendix B Cards that Support SR-IOV 89
Appendix C Cards that Support Direct I/O 9
Fujitsu M10/SPARC M10 Systems PCI Card Installation Guide
･
July 2014iv

Preface
This document describes the rules for mounting PCI cards that are mounted in the
SPARC M10 systems from Oracle or Fu itsu.
Fu itsu M10 is sold as SPARC M10 Systems by Fu itsu in Japan.
Fu itsu M10 and SPARC M10 Systems are identical products.
This preface includes the following sections:
■Audience
■Related
Documentation
■Text
Conventions
■Safety
Precautions
■Syntax
of the Command-Line Interface (CLI)
■Document
Feedback
Audience
This document is designed for system administrators with advanced knowledge of
computer networks and Oracle Solaris, the service engineers who are in charge of
system maintenance, and field engineers.
v

SPARC M10 Systems related documentation (*1)
Fujitsu M10/SPARC M10 Systems Getting Started Guide (*2)
Fujitsu M10/SPARC M10 Systems Quick Guide
Fujitsu M10/SPARC M10 Systems Important egal and Safety Information (*2)
Software icense Conditions for Fujitsu M10/SPARC M10 Systems
Fujitsu M10/SPARC M10 Systems Safety and Compliance Guide
Fujitsu M10/SPARC M10 Systems Security Guide
Fujitsu M10/SPARC M10 Systems/SPARC Enterprise/PRIMEQUEST Common Installation Planning Manual
Fujitsu M10/SPARC
M10 Systems Installation Guide
Fujitsu M10-1/SPARC M10-1 Service Manual
Fujitsu M10-4/Fujitsu M10-4S/SPARC M10-4/SPARC M10-4S Service Manual
PCI Expansion Unit for Fujitsu M10/SPARC M10 Systems Service Manual
Fujitsu M10/SPARC M10 Systems PCI Card Installation Guide
Fujitsu M10/SPARC M10 Systems System Operation and Administration Guide
Fujitsu M10/SPARC M10 Systems Domain Configuration Guide
Fujitsu M10/SPARC M10 Systems
XSCF Reference Manual
Fujitsu M10/SPARC M10 Systems RCI User Guide (*3)
Fujitsu M10/SPARC M10 Systems Product Notes
Fujitsu M10/SPARC M10 Systems Glossary
*1 The listed manuals are subject to change without notice.
*2 The printed manual comes with the product.
*3 This document applies specifically to the FUJ TSU M10 and FUJ TSU ETERNUS storage system.
Related Documentation
All documents for your server are available online at the following sites:
■Documents
related to Oracle software (Oracle Solaris, etc.)
http://www.oracle.com/documentation/
■Fu itsu
documents
Japanese site
http:// p.fu itsu.com/platform/server/sparc/manual/
Global site
http://www.fujitsu.com/global/services/computing/server/sparc/downloads/manual/
The following table lists documents related to the SPARC M10 systems.
Fujitsu M10/SPARC M10 Systems PCI Card Installation Guide
･
July 2014vi

Font/Symbol Meaning Example
A
aBbCc123 Indicates
what you enter, in contrast to what is
displayed on the screen.
This font is used to indicate an example of
command input.
XSCF> adduser jsmith
AaBbCc123 Indicates
the names of commands, files, and
directories displayed in computer output and on
the screen.
This font is used to indicate an example of
command input
within the relevant framework.
XSCF>showuser-P
UserName: jsmith
Privileges: useradm

auditadm
Italic Indicates the names of reference manuals. ee the SPARC M10 Systems
Installation Guide.
" " Indicates the names of chapters, sections, items,
buttons, and menus.
ee "Chapter 2 Network Connection."
Text Conventions
This document uses the following fonts and symbols to express specific types of
information.
Command syntax in the text
Though the XSCF commands have a section number of (8) or (1), it is omitted in the
text.
The Oracle Solaris commands have a section number such as (1M) in the text.
Each command has a section number in the command name when prompting users
to refer to it.
Safety Precautions
Read the following documents thoroughly before using or handling any SPARC M10
system:
■Fujitsu
M10/SPARC M10 Systems Important Legal and Safety Information
■Fujitsu
M10/SPARC M10 Systems Safety and Compliance uide
Preface vii

Syntax of the Command-Line Interface
(CLI)
The command syntax is as follows.
■A
variable that requires input of a value is in italics.
■An
optional element is enclosed in [ ].
■A
group of options for an optional keyword is enclosed in [ ] and delimited by |.
Document Feedback
If you have any comments or requests regarding this document, please contact us
from the following URL with the relevant manual number, manual title, and pages
along with specific details:
■Japanese
site
http:// p.fu itsu.com/platform/server/sparc/manual/
■Global
site
http://www.fujitsu.com/global/services/computing/server/sparc/downloads/manual/
Fujitsu M10/SPARC M10 Systems PCI Card Installation Guide
･
July 2014viii

Chapter 1
PCI Card Mounting Rules for the
SPARC M10-1
This chapter describes the maximum number of each type of mounted PCI card and
the rules for mounting PCI cards in PCI slots when mounting PCI cards in the
SPARC M10-1.
Be sure to observe these mounting rules when designing the system and when
installing a PCI card or changing the mounting location of a PCI card.
■Prerequisites
■Maximum
Number of Each Type of Mounted PCI Card and Available PCI Slots
■Hardware
Configuration Diagram
1.1 Prerequisites
■Domain
OS
■System
firmware XCP version
1.1.1 Domain OS
The maximum number of each type of mounted PCI card and the available PCI slots
may vary depending on the version of the Oracle Solaris that is installed on the
domain.
Mounting rules vary depending on whether all OS versions of the control domain,
I/O root domain, and I/O domain are Oracle Solaris
11 only, Oracle Solaris 10 only, or
a mixture of the two.
If an Oracle Solaris 10 environment is used in the following configurations, apply the
rules for Oracle Solaris 11.
■A
guest domain of an Oracle Solaris 10 environment is configured using the
virtual I/O services of a control domain or the I/O root domain of Oracle Solaris
11.
■An
Oracle Solaris 10 zone is configured on an Oracle Solaris 11 domain.
1

Note -
For details on the design of control domain, I/O root domain, and I/O domain
configurations, see the Fujitsu M10/SPARC M10 Systems Domain Configuration Guide.
If there are plans to add an I/O root domain or I/O domain of Oracle Solaris 10 after
the start of system operation, apply the rules for Oracle Solaris 10.
1.1.2 System firmware XCP version
The maximum number of each type of mounted PCI card and the slots available for
mounting may vary depending on the system firmware version. For XCP2050 or
later, see the tables in "1.2.1 If XCP2050 or later is used and Oracle Solaris 11 is
installed on all the domains" and "1.2.2
If XCP2050 or later is used and Oracle
Solaris 10 is installed on all the domains or if XCP2050 or later is used and Oracle
Solaris 11 and Oracle Solaris 10 are mixed" according to the Oracle Solaris version.
For XCP2044 or earlier, see "1.2.3 XCP2044 or earlier" regardless
of the Oracle
Solaris version.
1.2 Maximum Number of Each Type of
Mounted PCI Card and Available PCI
Slots
For the maximum number of each type of mounted PCI card and the available PCI
slots, see Table 1-1 to Table 1-6 according to the domain OS version.
■"Maximum
number mounted" in the tables means the maximum number of PCI
cards that can be mounted in the SPARC M10-1 or PCI expansion unit. The
numbers in ( ) indicate the slot numbers where cards can be mounted, among the
PCI slots of the SPARC M10-1. If there are no ( ), all of the
slots are available for
mounting. In any PCI expansion unit where cards can be mounted, all of the slots
are available for mounting.
■The
SPARC M10 has an I/O bandwidth of 8 GB/s per root complex. The
bandwidth between the PCI expansion unit and the SPARC M10 is also 8 GB/s.
The PCI cards mounted in the PCI expansion unit share that bandwidth, which
caps the performance of all the PCI cards operating at the
same time. If a
high-speed communication card requires a certain level of performance, mount
the card in a PCI slot in the SPARC M10-1 instead of mounting it in the PCI
expansion unit.
Fujitsu M10/SPARC M10 Systems PCI Card Installation Guide
･
July 20142