Sun Fire™ 15K Server Maintenance and Administration IES-421 Student Guide With Instructor Notes Sun Microsystems, Inc UBRM05-104 500 Eldorado Blvd Broomfield, CO 80021 U.S.A Sun Proprietary: Internal Use Only Revision C Copyright 2001 Sun Microsystems, Inc., 901 San Antonio Road, Palo Alto, California 94303, U.S.A All rights reserved This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any Third-party software, including font technology, is copyrighted and licensed from Sun suppliers Sun, Sun Microsystems, the Sun logo, JumpStart, OpenBoot, Solaris, Solstice DiskSuite, Sun Enterprise, SunFastEthernet, Sun Fire, Sun Management Center, SunOS, Sun Quad FastEthernet, SunSolve, SunSolve Online, SunSpectrum, Sun StorEdge, SunVTS, and Ultra are trademarks or registered trademarks of Sun Microsystems, Inc in the U.S and other countries All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc in the U.S and other countries Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc UNIX is a registered trademark in the U.S and other countries, exclusively licensed through X/Open Company, Ltd U.S Government approval might be required when exporting the product RESTRICTED RIGHTS: Use, duplication, or disclosure by the U.S Government is subject to restrictions of FAR 52.227-14(g)(2)(6/87) and FAR 52.227-19(6/87), or DFAR 252.227-7015 (b)(6/95) and DFAR 227.7202-3(a) DOCUMENTATION IS PROVIDED “AS IS” AND ALL EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS, AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID THIS MANUAL IS DESIGNED TO SUPPORT AN INSTRUCTOR-LED TRAINING (ILT) COURSE AND IS INTENDED TO BE USED FOR REFERENCE PURPOSES IN CONJUNCTION WITH THE ILT COURSE THE MANUAL IS NOT A STANDALONE TRAINING TOOL USE OF THE MANUAL FOR SELF-STUDY WITHOUT CLASS ATTENDANCE IS NOT RECOMMENDED Sun Proprietary: Internal Use Only Please Recycle Copyright 2001 Sun Microsystems Inc., 901 San Antonio Road, Palo Alto, California 94303, Etats-Unis Tous droits réservés Ce produit ou document est protégé par un copyright et distribué avec des licences qui en restreignent l’utilisation, la copie, la distribution, et la décompilation Aucune partie de ce produit ou document ne peut être reproduite sous aucune forme, par quelque moyen que ce soit, sans l’autorisation préalable et écrite de Sun et de ses bailleurs de licence, s’il y en a Le logiciel détenu par des tiers, et qui comprend la technologie relative aux polices de caractères, est protégé par un copyright et licencié par des fournisseurs de Sun Sun, Sun Microsystems, le logo Sun, Java, JumpStart, OpenBoot, Solaris, Solaris Operating Environment, Solaris Web Start, Solstice DiskSuite, Sun Cluster, Sun Enterprise, Sun Enterprise 10000, Sun FastEthernet, Sun Fire, Sun Fireplane interconnect, Sun Management Center, SunOS, Sun Quad FastEthernet, SunSolve, SunSolve Online, Sun Spectrum, Sun StorEdge A5000, Sun StorEdge T3, SunVTS, Ultra 5, et Ultra 10 sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc aux Etats-Unis et dans d’autres pays Toutes les marques SPARC sont utilisées sous licence sont des marques de fabrique ou des marques déposées de SPARC International, Inc aux Etats-Unis et dans d’autres pays Les produits portant les marques SPARC sont basés sur une architecture développée par Sun Microsystems, Inc L’accord du gouvernement américain est requis avant l’exportation du produit LA DOCUMENTATION EST FOURNIE “EN L’ETAT” ET TOUTES AUTRES CONDITIONS, DECLARATIONS ET GARANTIES EXPRESSES OU TACITES SONT FORMELLEMENT EXCLUES, DANS LA MESURE AUTORISEE PAR LA LOI APPLICABLE, Y COMPRIS NOTAMMENT TOUTE GARANTIE IMPLICITE RELATIVE A LA QUALITE MARCHANDE, A L’APTITUDE A UNE UTILISATION PARTICULIERE OU A L’ABSENCE DE CONTREFAÇON CE MANUEL DE RÉFÉRENCE DOIT ÊTRE UTILISÉ DANS LE CADRE D’UN COURS DE FORMATION DIRIGÉ PAR UN INSTRUCTEUR (ILT) IL NE S’AGIT PAS D’UN OUTIL DE FORMATION INDÉPENDANT NOUS VOUS DÉCONSEILLONS DE L’UTILISER DANS LE CADRE D’UNE AUTO-FORMATION Sun Proprietary: Internal Use Only Please Recycle Table of Contents About This Course xxiii Course Goals xxiii Course Map xxiv Topics Not Covered xxv How to Use Course Materials xxvi Conventions .xxvii Icons xxvii Typographical Conventions xxviii Introducing the Sun Fire™ 15K Server 1-1 Objectives 1-1 Relevance 1-2 Additional Resources 1-2 Introducing the Sun Fire™ 15K Server 1-3 Generation Scaling 1-4 The Sun Fire Systems 1-6 System Enclosures 1-6 Slot Boards 1-7 Slot Boards 1-7 System Controller Boards 1-7 System Configurations 1-8 Cabinets 1-9 Sun Fire 15K I/O Support 1-11 Interdomain Networking 1-11 Sun Fire 15K Server Peripherals 1-12 Advanced RAS Features 1-13 Exercise: Training Lab Guided Tour 1-14 Preparation 1-14 Task 1-14 Exercise Summary 1-15 Check Your Progress 1-16 Sun Proprietary: Internal Use Only v Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Sun Fire™ 15K Server Architecture 2-1 Objectives 2-1 Relevance 2-2 Additional Resources 2-2 Architecture Overview 2-3 The Sun Fire 15K Bus Architecture 2-4 Address Bus 2-4 Data Bus 2-4 Interconnect Levels 2-5 The Address Interconnect 2-6 Data Interconnect 2-7 Sun™ Fireplane Interconnect 2-8 Memory Coherency 2-10 Snoopy Coherency 2-10 Scalable Shared Memory 2-11 System Components 2-12 Board Sets 2-13 System Board Set 2-14 Control Board Set 2-16 System Boards 2-18 System Board Operational Overview 2-19 CPU and Memory Configuration 2-20 Memory Configuration Rules 2-22 System Board LEDs 2-24 Sun Fire 15K I/O Support 2-25 hsPCI I/O Board Operational Overview 2-26 hsPCI I/O Assembly Slot Assignments 2-27 hsPCI I/O Assembly Status LEDs 2-28 MaxCPU Board 2-30 MaxCPU Board Components and Status LEDs 2-31 Sun Fire Link Board 2-33 Sun Fire Link Board Components and Status LEDs 2-34 Sun StorEdge™ S1 2-36 StorEdge S1 Switch and Indicators 2-37 StorEdge S1 Daisy-Chain Configuration 2-39 Expander Board 2-40 The System Controller 2-42 System Controller Components 2-43 The System Controller Faceplate 2-44 The System Controller LEDs and Controls 2-45 System Control Board LEDs 2-45 System Controller Peripheral Board LEDs 2-48 System Controller Physical Locations 2-51 Centerplanes 2-52 Sun Fireplane Interconnect 2-52 Power Centerplane 2-54 vi Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Fan Backplane 2-55 Carrier Plates 2-56 Carrier Plate Label 2-58 Electrical Specifications 2-59 Processor Cabinet Power System 2-59 Specifications 2-60 Input Power Requirements 2-61 Power Distribution 2-62 AC Power Supplies 2-63 Power Supply LEDs 2-63 Installing Power Cables 2-65 System Power On and Power Off 2-67 Powering On the Sun Fire 15K Server 2-67 Powering Off the Sun Fire 15K Server 2-68 Processor Cabinet Cooling System 2-69 Fan Trays 2-70 FrameManager 2-72 FrameManager Front Panel 2-73 Physical Locations 2-75 Exercise: Sun Fire 15K Server Component Identification 2-77 Preparation 2-77 Tasks 2-77 Exercise: Sun Fire 15K FRU Removal and Installation 2-80 Preparation 2-80 Tasks 2-82 Exercise: Powering the Platform On and Off 2-85 Preparation 2-85 Tasks 2-85 Exercise Summary 2-86 Exercise: Sun Fire 15K Server Component Identification 2-87 Task Solutions 2-87 Exercise: Sun Fire 15K Server FRU Removal and Installation 2-90 Task Solutions 2-90 Exercise: Powering the Platform On and Off 2-93 Task Solutions 2-93 Check Your Progress 2-94 Sun Fire™ 15K System Controller Architecture 3-1 Objectives 3-1 Relevance 3-2 Additional Resources 3-2 System Controller Architecture Overview 3-3 Introducing the System Controller 3-4 System Controller Hardware Complex 3-5 CP1500 Board 3-7 Sun Proprietary: Internal Use Only vii Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Control Board 3-9 System Controller Peripheral (SCPER) Board 3-11 Centerplane Support Board 3-12 System Controller-to-Platform Interfaces 3-13 Management Networks (MANs) 3-14 Console Bus 3-21 I2C Bus 3-22 System Clock 3-23 System Controller Software 3-25 SMS Capabilities 3-25 SMS Startup 3-27 SMS Daemons 3-30 Message Logging Daemon 3-31 SMS Startup Daemon 3-33 Hardware Access Daemon 3-36 Management Network Daemon 3-38 FRU Access Daemon 3-41 Failover Management Daemon 3-42 Platform Configuration Database Daemon 3-43 Task Management Daemon 3-44 Domain Status Monitoring Daemon 3-45 Environmental Status Monitoring Daemon 3-46 OpenBoot PROM Support Daemon 3-47 Key Management Daemon 3-48 Domain X Server 3-50 Domain Configuration Administration Server 3-51 System Controller Environment Variables 3-53 SMS File System Structure 3-54 SMS Installation 3-57 Manually Installing the System Management Services Software 3-57 Configuring the System Controller 3-59 Changing the Configuration During the Initial Startup 3-59 Configuring the Management Network 3-60 The smsconfig Script 3-61 Using the smsconfig Script 3-64 Configuring the Name Services 3-68 Logging In To The System Controller 3-69 Using the telnet Command 3-69 Using the Serial Port 3-69 Exercise: Configuring the System Management Services 3-71 Preparation 3-71 Task 1: Installing and Configuring SMS Software 3-71 Task 2: Logging In To the Actual System Controller 3-71 Exercise Summary 3-74 viii Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Exercise: Configuring the System Management Services 3-75 Task Solutions 3-75 Task Solutions 3-75 Check Your Progress 3-78 Configuring the Sun Fire™ 15K Platform .4-1 Objectives 4-1 Relevance 4-2 Additional Resources 4-2 Architecture Overview 4-3 Sun Fire 15K Administrative Privileges 4-4 Managing Administration Groups 4-5 Adding Administrators 4-8 Group Privileges 4-11 Platform Administrator Group 4-11 Platform Operator Group 4-13 Platform Service Group 4-14 Domain Administrator Group 4-15 Domain Configuration Group 4-16 Superuser Privileges 4-17 ACL 4-18 Platform Administration Tasks 4-19 Administrative Commands 4-20 Displaying Platform Configuration 4-23 The smsversion Command 4-24 The showplatform Command 4-25 The showboards Command 4-30 The showcomponent Command 4-32 Monitoring Platform Environmentals and Status 4-34 The showenvironment Command 4-34 The showlogs Command 4-39 Setting Up the Platform 4-41 The setupplatform Command 4-41 The setdate Command 4-43 The setdefaults Command 4-45 Powering Platform Components On and Off 4-46 The poweron Command 4-46 The poweroff Command 4-48 Updating the Firmware 4-50 The flashupdate Command 4-51 Examples of the flashupdate Command 4-52 Backing Up and Restoring the SMS Environment 4-53 The smsbackup Command 4-53 The smsrestore Command 4-54 Re-initializing the System Controller 4-55 The resetsc Command 4-55 Sun Proprietary: Internal Use Only ix Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Exercise: Platform Monitoring and Configuration 4-56 Preparation 4-56 Task 1: Configuring Administration Groups 4-56 Task 2: Monitoring the Platform 4-57 Task 3: Configuring Domain ACLs 4-58 Task 4: Updating Flash PROM Images 4-58 Task 5: Backing Up and Restoring the SMS Environment 4-59 Exercise Summary 4-60 Exercise: Platform Monitoring Configuration 4-61 Task Solutions 4-61 Task Solutions 4-62 Task Solutions 4-63 Task Solutions 4-63 Task Solutions 4-64 Check Your Progress 4-65 Configuring Sun Fire™ 15K Domains 5-1 Objectives 5-1 Relevance 5-2 References 5-2 Architecture Overview 5-3 Sun Fire 15K Domains 5-4 Static and Dynamic Domains 5-4 Domain Configuration 5-5 DCUs 5-5 Domain Configuration Requirements 5-6 Configuring Static Domains 5-7 The addtag Command 5-8 The deletetag Command 5-9 The addboard Command 5-10 The deleteboard Command 5-13 The moveboard Command 5-16 The setobpparams Command 5-19 Domain Configuration Example 5-21 The Virtual Keyswitch 5-24 The setkeyswitch Command 5-24 Displaying the Virtual Keyswitch Setting in Domain 5-27 Accessing the Domain Console 5-28 The console Command 5-28 Displaying the Domain Devices 5-31 The showdevices Command 5-31 Resetting the Domain 5-34 The reset Command 5-34 The OpenBoot PROM Device Tree 5-36 OBP Device Tree 5-37 x Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C SOCN**** (set of communicating expanders) A set of expanders that includes one domain set, plus any other domain set that has at least one split expander in common Therefore, the set of expanders that can communicate with one another, transitively closed The set of expanders that must be either in or out of a degraded mode as a unit split expander In the Sun Fire 15K server, a boardset that has Slot in one domain and Slot in another SRAM (static random access memory) A type of high-speed memory device used for Ecache modules SRD (shared resource domain) A Sun Fire 15K domain that is permitted to send and receive a restricted set of transactions to and from other domains (its client domains), thus allowing it to facilitate and control interdomain communication For example, this allows a WCI board to provide clustering services to a set of domains SRDC (shared resource domain client) A Sun Fire 15K domain that uses the interdomain communication provided by an SRD SRD slot A centerplane slot in which one or both of the CPU and I/O boards is in an SRD SSM (scalable shared memory) A mode of the Sun Fireplane interconnect that allows multiple Sun Fireplane buses to be connected together SSM configuration (scalable shared memory configuration) A collection of domains joined together by an interconnect An extension of the Sun Fireplane protocol that allows multiple snoop domains to communicate standalone diagnostics Diagnostics tools, such as POST and scan, that run in the system when the Solaris Operating Environment is not running starvation A condition in which a device never gets to make a request because it is continuously pre-empted by other devices Glossary-28 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C STB (secondary transfer buffer) A structure in the Sun Fire 15K server’s SDI ASICs that stores a temporary copy of a cache line pending writing it to the home memory steering Signals going to an arbiter or mux chip to tell it where a transaction should go These are the signals that must be received correctly for lockstep chips to remain in lockstep Sun Fire The marketing and customer name for the Sun Fire family of servers The family comprises the Sun Fire 3800, Sun Fire 48x0, Sun Fire 4810, and Sun Fire 6800 servers Sun Fire 3800 server An eight-processor system that can either be used as a separate standalone system or installed in a rack It holds two Slot boards and two Slot boards Sun Fire 48x0 server A 12-processor system It holds three Slot boards and two Slot boards Sun Fire 4810 server A 12-processor system installed in a rack All components are accessible from the front of the rack It holds three Slot boards and two Slot boards Sun Fire 6800 server A 24-processor system installed in a rack It holds six Slot boards and four Slot boards Sun Fire family A family of servers using a common set of system boards and ASICs system board The board containing up to four UltraSPARC III processors, Ecache modules, and four memory banks Formerly called the CPU/memory board system controller The system controller consists of the system controller board and the system controller software The system controller provides communication pathways for console traffic and other data that needs to be passed between the system controller and the system The system controller software monitors and controls the system, manages hardware, and configures domains Sun Proprietary: Internal Use Only Glossary and Acronyms Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Glossary-29 system controller board A board containing a microSPARC™ processor, which oversees operation of the system and provides clocks and the console bus system controller software The main application that performs all of the system controller hardware management functions T TargID (target ID) A number that identifies the target of a write and that target’s buffer number, sent in response to a write transaction so as to give the writer permission to send the data TB Terabyte of capacity = 240 = 1,099,511,627,776 bytes Tbyte Terabyte 1024 x 1024 x 1024 x 1024 bytes A 40-bit address space TOD See virtual time-of-day (TOD) TTransID (target transaction ID) An identifier used to deliver a TargID to a Fireplane bus device U UE (uncorrectable error) An error, such as two bad bits in the same memory word, that cannot be corrected UltraSPARC III processor The SPARC V9 processor used in all systems comprising the Sun Fire family of systems Internally known as the Cheetah US III See UltraSPARC III processor V victim A line which can no longer be held in a cache because the space is needed for a different line If it has been modified and must be written back to memory, it is a dirty victim Glossary-30 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C virtual domain keyswitch The system controller provides a virtual keyswitch for each domain The setkeyswitch command controls the position of the virtual keyswitch for each domain virtual time of day (TOD) The Sun fire TOD/NVRAM chip is located on the system controller board The system controller multiplexes the physical TOD chip to provide TOD services for each domain and for the system controller VRAM Video RAM W WATransID (working address transaction ID) An ATransID made up by an SSM home agent or slave agent WB See WriteBack WBIO See WriteBlockIO W{B}IO An abbreviation for either WIO or WBIO WCI board (WildCat (Sun Fire) interface board) The unofficial name for the CPU/memory/WCI board Also called WIB WDTransID (working data transaction ID) A DTransID sent with read data to respond to a WATransID WIB (WildCat (Sun Fire) interface board) Also called CPU/memory/WCI board or just WCI board In the Sun Fire 15K server, this board is used for clustering connections using its parallel fiber-optic links WIB SRD An SRD that contains a WIB Allows IDN between SRDCs within as well as between Sun Fire 15K chassis Sun Proprietary: Internal Use Only Glossary and Acronyms Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Glossary-31 WildCat WildCat interface boards (WCI boards, or WIBs) that connect multiple Sun Fire systems into large servers using SSM and CMR (see CMR, SSM) The WCI board also allows any Sun Fire systems (including the Sun Fire 15K server) to be connected as a cluster WIO See WriteIO working TransID (working transaction ID) In the Sun Fire 15K server, a transaction ID using a device ID made up by an SSM agent to run a transaction on a Sun Fireplane bus Working TransIDs may be ATransIDs, TTransIDs, or DTransIDs WRI (write invalidate) A transaction in UPA devices (Spitfire/Blackbird) that corresponds to WriteStream WriteBack A Sun Fireplane transaction to move a dirty line back to memory WriteBlockIO A Sun Fireplane bus transaction asking to write a 64-byte block to the noncacheable address space WriteIO A Sun Fireplane bus transaction asking to write a smaller-than-64-byte block to the noncacheable address space WriteStream A Sun Fireplane bus transaction to write an entire cache line and invalidate an old copies WS See WriteStream WTargID (working target ID) A TargID made up by an SSM request agent to give the expander that originally requested a write transaction WTTransID (working target transaction ID) A TTransID responding to a WATransID Glossary-32 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C X XIR A non-maskable interrupt request to the UltraSPARC III processor used for error reset Sun Proprietary: Internal Use Only Glossary and Acronyms Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Glossary-33 Index Symbols ! symbol B-24 # symbol B-24 && symbol B-24 /etc/bootparams file B-12, B-36 /etc/bootparamsfile B-9 /etc/dfs/dfstab command B-36 /etc/dfs/dfstab file B-13, B-36 /etc/ethers file B-10 /etc/hostname.idnn F-15 /etc/hosts file B-10 /etc/inet/ntp.conf 5-55 /etc/system 9-61 /platform/SUNW,Ultra-Enterpr ise-10000/kernel/drv/idn.con f F-17 /tftpboot directory B-11 /usr/sbin/in.rarpd daemon B-9 /var/adm/messages 5-56 add_to_install_server command B-20 addboard Command 5-10 Adding Administrators 4-8 Address Bus 2-4 addtag Command 5-8 Administration Groups 4-5 Administrative Commands 4-20 admn 4-5 Attachment Point status, Dynamic Reconfiguration 7-24 availability of Serengeti 1-13 Available Component List 4-18 B benefits Dynamic Reconfiguration 7-3 board set 2-13 boot net - install command B-38 C A dmn 4-5 AC power distribution 2-61 ACL 4-18 Add Tag command 8-45 add_install_client command B-34 capabilities 8-3 centerplane IDN F-3 Centerplane support board 2-16 centerplane support board 2-43 cfgadm command 7-22 Sun Proprietary: Internal Use Only Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Index-1 coherence directory cache (CDC) 2-11 Coherency 2-10 commands /etc/dfs/dfstab B-36 add_install_client B-34 add_to_install_server B-20 boot net - install B-38 cfgadm 7-22 domain_status IDN F-16 flashupdate 4-52 format 5-57, 5-60, 5-64 hostreset 9-38 ifconfig IDN F-15 modify_install_server B-20 modinfo F-18 modload F-18 modunload F-18 netstat IDN F-32 prtconf 5-57 prtdiag 5-57 setobpparams 5-22 show component 4-32 showboards 4-32 showenvironment 4-34 showlog 4-39 showobpparams 5-22 showplatform 4-25 showsc 4-34 snoop F-32 sysid 5-22 telnet 3-69 tip 3-70 component numbering front 2-75, 2-76 components system, powering on and powering off 4-50 Condition status, Dynamic Reconfiguration 7-26 configuration NTP 2.6 5-55 Index-2 configuration file for Internet Protocol Multipathing 6-41 configuration information eeprom command 5-57 format command 5-57 prtconf command 5-57 prtdiag command 5-57 Control board 2-16 controller board 2-43 Course xxiii CP1500 (CPU) board 2-43 D daemons /usr/sbin/in.rarpd B-9 rpc.bootparamd B-9 daemons, in.mpathd 6-42 Data Bus 2-4 DCU 5-5 Delete Tag command 8-45 deleteboard Command 5-13 deletetag Command 5-9 Device Tree 5-36 agent ID 5-41 Components 5-37 CPU and Memory Locations 5-42 I/O Card Locations 5-45 Physical Device Mapping 5-40 DIMM Slot Assignments 2-20 directories /tftpboot B-11 DLPI IDN F-4 Doamin Console tilde commands 5-29 Doamins Resetting a Domain 5-34 Domain Log Files 5-56 domain idprom.image 5-22 SSP message logs 5-56 domain administrator 4-4, 4-15 domain configuration 4-16 domain configurator 4-4 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Domain Console console command 5-28 domain_status IDN F-16 Domains 5-4 commands 5-7 Configuration 5-5 Configuration Requirements 5-6 Domain Configuration Units 5-5 MAN Interface 5-52 ndd man_get_hostinfo Command 5-58 NTP 5-55 Solaris Operating Environment 5-50 Static and Dynamic Domain 5-4 View System Configuration through Solaris Operating Environment 5-57 domains moving physical resources between 7-34 domainstop 9-45 Domais Time of Day Clock command 5-53 DR 7-1 Detaching Permanent Memory 7-15 Dynamic Attachment Points 7-25 moving physical resources between domains 7-34 Procedures 7-29 rcfgadm 7-22 replacing CPU/memory board 7-29 I/O Board 7-32 SMS Commands 7-17 driver IDN F-17 idn F-4, F-18 dstop 9-45 dump hardware 9-46 Dynamic Attachment Point status, Dynamic Reconfiguration 7-25 Dynamic Reconfiguration 7-1, 8-43 benefits 7-3 hot-pluggable hardware 7-14 I/O boards 7-10 multipathed I/O 7-10 overview 7-3 status Attachment Point 7-24 Condition 7-26 Dynamic Attachment Point 7-25 Occupant 7-26 Receptacle 7-26 Type 7-25 E eeprom configuration information 5-57 environmental and platform commands list of 4-50 showboards 4-32 showcomponent 4-32 showenvironment 4-34 showlogs 4-39 showplatform 4-25 showsc 4-34 F features reliability, availability, and serviceability 1-13 files /etc/bootparams B-9, B-12, B-36 /etc/dfs/dfstab B-13, B-36 /etc/ethers B-10 /etc/hosts B-10 configuration for Internet Protocol Multipathing 6-41 idn.conf F-17 idprom.image 5-22 rules B-23 sysidcfg B-16 firmware updates 4-50 Firmware Updats 4-50 flashupdate command 4-51 flashupdate command 4-52 format Command 5-60 format command 5-57, 5-60, 5-64 Frame Manager 2-72 Sun Proprietary: Internal Use Only Index Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Index-3 H hardware hot-pluggable 7-14 requirements of Internet Protocol Multipathing 6-37 views of 8-28 hardware dump 9-46 hash symbol B-24 hostname.idnn F-15 hostreset 9-38 hot-pluggable hardware 7-14 hpost -D option 9-46 hsPC 1-7 hsPCI 2-14 host 9-44 I I/O boards 7-10 I/O Controllers hsPCI I/O 2-26 hsPCI I/O Slot Assignments 2-27 hsPCI I/O Status LEDs 2-28 PCI I/O Board Operational Overview 2-26 support 2-25 I/O devices, configuring for detach 7-7 I/O mapping 5-45 IDN 1-11, 1-13, F-3 DLPI F-4 domain_status F-16 driver F-17 idn.conf F-17 interface F-15 IP tools F-17 IPv6 F-3 kstat F-32 loading idn driver F-18 ndd F-18 netstat F-32 operation F-5 performance F-3, F-32 snoop F-32 statistics F-32 Index-4 idn driver F-4 idn.conf F-17 changing F-18 idn-smr-size F-17 idprom.image 5-22 ifconfig IDN F-15 in.mpathd daemon 6-42 Interconnect 2-7 InterDomain Networking F-3 Interdomain Networking 1-11 interface IDN F-15 statistics F-32 IDN snoop F-32 Internet Protocol Multipathing (IPMP) Alternate Pathing and Dynamic Reconfiguration interaction with 6-59 automating IPMP configuration in IPv4 6-56 in IPv6 6-58 configuration file 6-41 hardware requirements 6-37 network failover 6-47 software requirements 6-37 IP IDN F-17 IPMP Configuration File 6-41 Configuration in IPv4 6-56 Configuring in IPv6 6-57 Configuring Standby 6-47 Dynamic Reconfiguration Interaction 6-59 Features 6-34 Group 6-38 Hardware Requirements 6-37 ifconfig Status Flags and Subcommands 6-43 mpathd 6-39, 6-42 Network Failover 6-40 Software Requirements 6-37 IPv6 IDN F-3 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C J JumpStart boot services B-7 boot, system identification services B-4 configuration services B-4 definition B-3 installation services B-4 process B-9 Device Paths 6-12 Features 6-4 Logical Devices 6-13 Software 6-16 Software/Hardware Support 6-6 Terms and Definitions 6-7 vHCI 6-9 MTU F-32 multipathed I/O 7-10 Multipathing I/O/MPxIO 6-3 K N kstat IDN F-32 L log file domain message 9-12, F-3, F-4, F-9, F-10, F-16, F-17, F-18 log files SSP 5-56 M mapping, I/O 5-45 mask IDN F-5 MaxCPU board 2-14 Memory Configuration 2-20 Memory Configuration Rules 2-22 message SSP logs 5-56 meta-disk 6-12 modify_install_server command B-20 modinfo F-18 modload F-18 modunload F-18 moveboard Command 5-16 MPxIO architecture 6-9 Automatic Failover 6-24 Automatic Path Discovery 6-15 Commands 6-25 Configuration File 6-15 ndd IDN F-18 netstat IDN F-32 network IDN F-3 InterDomain F-3 network failover with Internet Protocol Multipathing 6-47 NIS B-10 NIS+ B-10 NTP configuration 2.6 5-55 number of CPUs supported 1-5 O OBP idprom.image 5-22 setobpparams 5-22 showobpparams 5-22 Occupant status, Dynamic Reconfiguration 7-26 P panic 9-37 PDSM 8-34 performance IDN F-3, F-32 Sun Proprietary: Internal Use Only Index Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Index-5 physical resources, moving between domains 7-34 physical view 8-28 pictures of system hardware 8-28 platadmn 4-5 platform setting up 4-41 Platform Administration Tasks 4-19 platform administrator 4-4 Platform Administrator Group 4-11 Platform Configuration commands 4-23 platform operator 4-4, 4-13 platform service 4-14 platform service personnel 4-4 platoper 4-5 platsvc 4-5 powering on and powering off system components 4-50 poweroff command 4-48 poweron command 4-46 prtconf Command 5-59 prtconf command 5-57 prtdiag command 5-57 R RARP B-9 RAS Features 1-13 RAS features 1-13 rcfg 4-5 reboot request 9-36 Receptacle status, Dynamic Reconfiguration 7-26 recordstop 9-45 redmode 9-38 reliability of Serengeti 1-13 reset 9-38 reset Command 5-34 resetsc Command 4-55 resources, moving physical between domains 7-34 Reverse Address Resolution Protocol B-9 rpc.bootparamd daemon B-9 rstop 9-45 rules file B-23 Index-6 S Scalable Shared Memory (SSM) 2-11 Serengeti reliability, availability, serviceability features 1-13 serviceability of Serengeti 1-13 setdate command 4-43 setdefaults command 4-45 Setkeyswitch command 8-45 setkeyswitch Command 5-24 setobpparams 5-22 setobpparams Command 5-19 setting up the platform 4-41 setupplatform 4-41 Shared Memory Region F-3 showboards command 4-30 showboards command 4-32 showcomponent command 4-32 showcomponent command 4-32 showdevices Command 5-31 showenvironment command 4-34 showenvironment command 4-34 showkeyswitch 5-27 showlogs command 4-39 showlogs command 4-39 showobparams 5-22 showplatform command 4-25 showplatform command 4-25 showsc command 4-34 Slot Boards 1-7 Slot Boards 1-7 SMR F-3 configuring F-5 SMS user 4-9 smsbackup 4-53 smsrestore 4-54 smsversion Command 4-24 snoop F-32 Snoopy Coherency 2-10 software requirements for Internet Protocol Multipathing 6-37 Solaris 5-50 SSP message logs 5-56 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C statistics IDN F-32 Status and Environmental functions 4-34 STREAMS IDN F-4 Sun 2-4 Sun Explorer 9-4 Sun Fire 15K Bus Architecture 2-4 Sun Fire 15K Bus Architecture 2-4 Sun Fire 15K Server Architecture 2-1 Sun Fire 15K Server Interconnect Levels 2-5 Sun Fire 15K Server Peripherals 1-12 Sun Fire family member 1-8 Sun Fire link board 2-14 Sun Fireplane Interconnect 2-8 Sun Fireplane interconnect 2-8 Sun Management Center 8-3 Add board 8-39 Add Tag command 8-45 Agents 8-4 Alarm Monitoring 8-23 Capabilities 8-3 Component Layers 8-4 Console 8-4 Delete board 8-39 Delete Tag command 8-45 Details window 8-19 Discovery Manager 8-15 Domain Administration Commands 8-45 Dynamic Reconfiguration 8-43 groups 8-9 Hardware Summary 8-25 Installing Sun Fire 15K Server 8-6 Logical View 8-25 Move board 8-39 Platform Administration 8-39 Platform Config Reader 8-18 Platform Config Reader Properties 8-21 Platform/Domain State Management 8-34 Port Address 8-8 Power off components 8-39 Power on components 8-39 selecting the Platform icon 8-17 Server 8-4 Setkeyswitch command 8-45 SMS Commands from Sun Management Center 8-38 Sun Fire 15K Domain 8-32 Topology Composites 8-12 SunInstall B-9 SunVTS 9-3 SunVTS online validation test suite 9-4 superuser 4-4, 4-17 swap space, configuring for detach 7-16 symbols ! B-24 # B-24 && B-24 sysid 5-22 sysidcfg file B-16 syslog SSP message logs 5-56 System Board Operational Overview 2-19 System Board Set Block Diagram 2-15 System Boards 2-18 CPU and Memory Configuration 2-20 LED’s 2-24 Operational Overview 2-19 Physical Location 2-75 System Components 2-12 system components, powering on and powering off 4-50 System Controller 2-42, 3-4, 3-71, 3-75 Components 2-43 Faceplate 2-44 LEDs and Controls 2-45 Physical Locations 2-51 Reset button 2-48 system controller 1-7 System controller peripheral board 2-16 system controller peripheral board 2-43 T telnet command 3-69 testing SunVTS 9-3 tip command 3-70 Sun Proprietary: Internal Use Only Index Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Index-7 Type status, Dynamic Reconfiguration 7-25 U UltraSPARC™ III 1-3 UltraSPARC III processor 2-18 updates, firmware 4-50 V Virtual Keyswitch setkeyswitch command 5-24 showkeyswitch command 5-27 W watchdog 9-38 Worksheet #1 9-70 Worksheet #2 9-71 Worksheet #3 9-72 X xir 9-38 Index-8 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C [...]... 8-2 Additional Resources 8-2 Introducing Sun Management Center 8-3 Sun MC Capabilities 8-3 How Sun MC Works on Sun Fire 15K Servers 8-4 Sun MC, Sun Fire 15K Server Agents 8-5 Installing Sun MC Software on a Sun Fire 15K Server 8-6 xiv Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights... Number 80 5-7 362 ● Sun Fire™ 15K Systems Platform Administration Manual, Part Number 80 5-7 373 ● Sun Fire™ 15K System Site Planning Guide, Part Number 80 6-3 510 Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C Introducing the Sun Fire™ 15K Server Introducing the Sun Fire™ 15K Server. .. reference to the course goals Sun Fire Architecture Introducing the Sun Fire 15K Server Sun Fire 15K Configuration Installation and Server Architecture Sun Fire 15K Platform Configuration Sun Fire 15K System Controller Architecture, Maintenance and Configuration Configuring the Sun fire 15K Platform Configuring the Sun Fire 15K Domains Sun Fire 15K Server Administration and Troubleshooting Multipathing... D-2 Access Doors and Side Panels D-3 Top Cap Assembly D-4 Kick Plate Assembly D-5 System Board Assemblies and Carrier Plates D-6 Fan Tray Cooling Components D-17 Power Supplies and Air Filters D-18 XOPTIONS D-20 Sun Enterprise™ 10000 Server- to -Sun Fire™ 15K Server Dictionary E-1 Daemons E-2 Commands E-3 Configuration... Introducing the Sun Fire™ 15K Server Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C 1-7 System Configurations System Configurations Table 1-1 summarizes the maximum configuration of each Sun Fire server family member Table 1-1 Sun Fire Server Family Comparison Sun Fire Sun Fire Sun Fire™ Sun Fire Sun Fire 15000 3800 Server 48x0 Server 4810 Server 6800 Server Server... Versions 8-7 Network Port Configuration 8-8 Groups and Security 8-9 Sun MC Groups 8-1 0 Sun Fire Administrative Groups 8-1 1 Sun Fire 15K Topology Composites 8-1 2 Discovering the Sun Fire 15K Server 8-1 5 Detailed View 8-1 6 Managing the Platform From Sun MC 8-1 7 Config Reader Module 8-1 8 Sun Fire 15K Platform Details Window 8-1 9 Views... 15K Server Introducing the Sun Fire™ 15K Server The Sun Fire 15K server (Figure 1-1 ) succeeds the Sun Enterprise™ 10000 high-end server and has the largest platform in the Sun Fire server family The Sun Fire server family succeeds the Sun Enterprise™ 3000–10000 group of servers Figure 1-1 Sun Fire 15K Server With I/O Expansion Rack The Sun Fire 15K server uses the UltraSPARC™ III (or later) central... Tab 8-2 5 Physical View of the Sun Fire 15K Platform 8-2 8 Logical View of the Sun Fire 15K Platform 8-3 0 Logical View of a Sun Fire 15K Domain 8-3 2 Platform/Domain State Management (PDSM) 8-3 4 Selecting PDSM 8-3 4 Running SMS Commands From PDSM 8-3 8 Platform Administration 8-3 9 Domain Administration 8-4 0 Powering On and Powering Off a Board 8-4 2 Dynamic... F-33 Issue F-33 Configuration F-33 Solution F-33 xx Sun Proprietary: Internal Use Only Sun Fire™ 15K Server Maintenance and Administration Copyright 2001 Sun Microsystems, Inc All Rights Reserved Enterprise Services, Revision C The xcidnhelp Command F-35 Check Your Progress F-36 Glossary and Acronyms Glossary-1 Index Index - 1 Sun. .. Tasks 8-5 4 Exercise Summary 8-5 6 Exercise: Sun MC Review 8-5 7 Task Solutions 8-5 7 Exercise: Sun Fire 15K Monitoring Tasks 8-6 1 Task 1 Solutions 8-6 1 Task 2 Solutions 8-6 3 Task 3 Solutions 8-6 4 Exercise: Sun Fire 15K Administrative Tasks 8-6 5 Task 1 Solutions 8-6 5 Check Your Progress 8-6 7 Troubleshooting Sun Fire™ 15K Servers