PowerScale Hardware Installation-SSP - Course Guide
PowerScale Hardware Installation-SSP - Course Guide
HARDWARE
INSTALLATION
COURSE GUIDE
PARTICIPANT GUIDE
PowerScale Hardware Installation-SSP1
Installation Engagement 5
Customer Engagement 5
Job Roles 6
Installation Phases 7
Onsite Activity 8
Installation Engagement
Customer Engagement
There are several steps in acquiring a PowerScale cluster. Each step has
specific team members who engage with the customer. For example,
when designing a system, a Solution Architect (SA) works with the
customer, determines their specific needs, and documents what the
solution looks like.
After the product purchase, shipment, and delivery to the customer site,
the installation and implementation of a PowerScale cluster begins. The
result of the SA engagement are specific customer requirements that are
used by Customer Engineers (CE) and Implementation Specialists (IS) to
install and configure the cluster. Before the installation phase, all design
decisions have been made.
Job Roles
There are four job roles that are associated with PowerScale hardware
installation and implementation process.
1: Customer Engineer
2: Project Manager
3: Implementation Specialist
4: Solution Architect
Installation Phases
1: During the install, the components are unpacked and racked. Nodes
are connected to the back-end switches, power is added, and front-end
network cables are connected between the cluster and customer network.
The Customer Engineer or CE performs these tasks.
2: Depending on the role, the CE may perform the cluster build also. The
cluster build is achieved when the system is powered on, the PowerScale
Configuration Wizard has been launched and the information added.
Onsite Activity
Installation References
The PowerScale Info Hub has links to specific OneFS software, hardware,
and troubleshooting pages. Each specific OneFS software version info
hub has documents for installation-related areas.
1: The cables that are required are a single CAT5/CAT6 network patch
cord, to directly connect your laptop to the node. USB-to-serial adapter,
preferably one that uses the Prolific 2303 Chipset.
Safety
1: You can install racks in raised or nonraised floor data centers capable
of supporting that system. It is your responsibility to ensure that the data
center floor can support the weight of the system. A fully populated rack
with A2000 chassis’ weighs about 3,500 lbs (1,590 kg). Titan-HD is the
preferred rack that is used to install A2000. If the floor is rated at less than
3,500 lbs, then additional care and planning must be taken. Some data
center floors have different static load vs. dynamic (rolling) load
specifications, and sectional weight and load point limits. It becomes
important while moving preracked solutions around the data center.
2: If you install PowerScale nodes in a rack that is not bolted to the floor,
use both front and side stabilizers. Installing PowerScale nodes in an
unbolted rack without these stabilizers could cause the rack to tip over,
potentially resulting in bodily injury. Use only approved replacement parts
and equipment.
5: The AC supply circuit for PowerScale nodes must supply the total
current that is specified on the label of the node. All AC power supply
connections must be properly grounded. Connections that are not directly
connected to the branch circuit, such as nodes that are connected to a
power strip, must also be properly grounded. Do not overload the branch
circuit of the AC supply that provides power to the rack holding
PowerScale nodes. The total rack load should not exceed 80% of the
branch circuit rating. For high availability, the left and right sides of any
rack must receive power from separate branch feed circuits. To help
protect the system from sudden increases or decreases in electrical
power, use a surge suppressor, line conditioner, or uninterruptible power
supply or UPS.
2 Failure to heed these warnings may also void the product warranty. Only
trained and qualified personnel should install or replace equipment.
Electrostatic Discharge
1: Clean Work Area: Clear the work area of items that naturally build up
electrostatic discharge.
• Before touching a component, put one hand firmly on the bare metal
surface.
• After removing components from the anti-static bag, do NOT move
around the room or touch furnishings, personnel, or surfaces.
• If you must move around or touch something, first put the component
back in the anti-static bag.
SolVe Overview
SolVe Online
Select each panel for a description about using SolVe Online and
generating a procedure.
Home
The SolVe home page lists all top-level products available to generate
appropriate documents. Tabs include Advisories, Product Support
Newsletters, Service Topics, Tools, and Support pages. The My Content
tab contains any procedure routes you accessed.
New Route
When selecting a top-level product, SolVe Online starts the menu for a
new route.
Product Topics
Procedure Generator
Generator Steps
Step 2 asks for the usage information, and step 3 shows the procedure to
generate.
Generating the document may take a few minutes. Once complete, the
PDF is downloaded, and you return to the home page.
Procedure Routes
SolVe Online retains a history of the procedure routes you accessed and
can be downloaded again. An email notice comes to your inbox as
another way to download.
SolVe Desktop
This video demonstrates how to download, install, and use the SolVe
desktop app.
Movie:
Audio Script:
We're going to show you how to download, install, and then navigate the
solved desktop using the executable. So let's go to dell.com support and
we're going to want to sign in, so when I click in, sign in here. It's going to
take me to where I need to enter my credentials if I'm a partner or a
customer. I'm going to use my signing credentials here. If I'm an employee
of Dell, I'm going to click sign in here. There was a sign in. I will see a
search bar here at the top and I'm going to type in solve desktop. It hit
enter and it will bring up a page with search results and what I want to do
is I want to click on these, solve desktop executable. So as I click on that
my executable should kick off here and I will see it populate here at the
bottom of my screen because I'm using Google Chrome. Once that's
finished, click the executable and let's let it run. OK, so I'm going to go
through the steps here. I'm going to click next. I'm going to install. It's a
fairly quick install, so let's let this finish really quickly. And I'm going to
launch myself, desktop executable here, let's finish. Now what it's doing is
it's asking me to accept the end user license agreement. You can read the
entirety of this agreement by choosing the scrollbar here on the right hand
side and then clicking except. A popup comes up saying that I need to
authorize the reason that we're doing this is because we need to know if
you are a partner, an employee or a customer by using single sign on, we
understand who you are and so by clicking OK it's going to go to the site.
It's going to give us a key chain token telling us who we are. Are we
employ your partner or a customer as I get that key chain file, I'm going to
click on it and you'll notice that my solve desktop. Since I am now
authenticated as an employee, if you're a partner, if you're a customer,
you're going to see this as either a partner or a customer. You'll notice
here that it populates with the product generators that are available to me
as an employee. I see more generators than a partner or customer would.
It's a subset of these generators. Depending on the access of for these
particular products. Now you also see a pop-up come up its release notes.
These are release notes about the product generators within the solve
desktop application. You can read through those and you can also click
close. However, if you wanted to review those again, we always have the
option to go in and see those again by just clicking up here on your health
file an using the release notes here.
only available to employees at this time, so you can toggle between views
between a water employee would see what a partner would see. I want a
customer would see. We also have the Dell security and the technical
advisories listed here and they are broken out by product and by years.
We also have the surface topics. Again you can search for the service
topics by product when you click on this. We also have tools and forms.
These are available and again this will depend on whether you're going to
play you partner or customer. And we have options and we also have the
help files.
I've chosen the radio button option and let's click next. Now it's telling me
that these alerts are actually going to be shown in my popup, so these will
be part of my generator procedure. And we're going to get to the last panel
here. This is where we actually need to generate the procedure. It's going
to take all the radio button options that I choose is going to compile that
into a single step by step generated document. I can choose where to put
the document if I want to save it to a different location. I can click on the...
buttons and I can save it to my desktop so I can save it and I can rename
it to whatever I need to. So if I click save, let's just do that and we're going
to click generate. This is again is going to compile all my information and
it's going to give me that step-by-step procedure in a PDF format. So now
my PDF is going to open. And there it is. So now we have the generated
step-by-step procedure.
We were at the Plex off generator. We went down and installation and
upgrade path and these are the radio button options that I chose gives me
my date. It gives me my feedback and as I scroll through this document
you'll be able to see that I have tasks that I needed to perform. I have
information in here that's going to be relevant for the task that I'm
performing. It gives me my step-by-step information as I go through this
document. So I've generated procedure and that's how you navigate
through a path. So one final thing within the solved desktop application I
do have feedback available. If I click on contact support. This feedback is
an area where you can provide information and also attach files if you
need to. This will be sent to solve feedback. At dell.com you will get a
response with a case number associated with it for tracking purposes. So
please feel free to reach out to us with any issues, concerns at solve
feedback at dell.com.
The installation process starts before you arrive at the customer site.
When planning an installation, there are a few items that you must know
before you arrive.
IP Address Verification
Ensure you discuss with the customer the plan for the spacing of the Gen6
chassis4.
4 All Gen6 chassis are 4U and the recommended maximum number that
can be installed in a standard 19" rack is 12. The chassis are installed with
additional space necessary for switches or cabling. Up to ten chassis can
fit in a 42U rack. Keep in mind that Gen6 nodes that are based on the
High and Ultra compute modules contain high-line only (240 V) power
supplies. When used in an environment where only low-line power (120 V)
is available, two rack-mounted step-up transformers are required per
Gen6 chassis. Each transformer consumes 2U additional rack space per
chassis and thus reduces the amount of space available for nodes. The
PowerScale A300, A3000, H700, and H7000 are newer nodes that reuse
the same hardware architecture as the Isilon Gen6 platforms with minor
changes. 4U chassis, available as standard (1 m rack compatible) and
deep (Titan-D/HD rack equivalent). Up to 80 3.5” storage HDDs per
chassis, and 2 2.5” cache SSDs per node.
Heavier nodes5
Pairs of step-up transformers6
Ethernet backend7
1U accelerator nodes and Secure Remote Services gateway servers8
Serial Number
Serial Number
The video demonstrates how to access the A100 serial number. See the
student guide for the audio script.
Audio Script:
For A100 accelerator nodes, you must remove the face plate from the
front of the node. Press both latches simultaneously until they click, then
remove the face plate. Locate the black plastic tab on the upper left of the
node and slide it out. The serial number is printed on the blue label. When
you are done, slide the tab back in and replace the face plate.
Service Tag
The service tag is in the front of the system or on a sticker on the chassis
of the system. The mini–Enterprise Service Tag (EST) is found on the
back of the system. Dell uses the information to route support calls to the
appropriate personnel.
1: Pull out the tag in front to view the Express Service Code and Service
Tag.
5: Service Tag
Generate the appropriate guide using SolVe. The guide explains the
required tools, unpacking, and building the rack.
The rack should have dual power supplies with a power distribution that
allows load balancing and switches between the two if there is an outage.
Use a rack cabinet that has dual power distribution units, one on each
side.
Titan Racks
Third-party racks
The rail kit is compatible with rack cabinets with the following hole types:
The A2000, A3000, H5600, and H7000 are deep chassis nodes, and can
use the third-party rack solution.
The customer is responsible for bolting the rack to the floor. If a third-party
rack is used, be sure to secure the rack to the subfloor with a stabilizer
bracket or some other method. Use both front and side stabilizers when
installing nodes in a rack that is not bolted to the floor. Installing
equipment in an unbolted rack without these stabilizers could cause the
rack to tip over, potentially resulting in bodily injury. Use only approved
replacement parts and equipment.
2: Sometimes, the trim strips are unattached from the cabinet, or were
removed to detach the shipping brackets. Once the cabinet is secured to
the floor stabilization brackets, install the lower trim strip to the bottom
front of the cabinet.
3: The seismic bracket is installed on the front, back, and sides of the
cabinet.
4: The anti-move bracket is installed on the front and back of the cabinet.
Once the rack is built, you are ready to unpack the components. Before
installing any equipment, inspect it to ensure that no damage occurred
during transit. Remove all components from the shipping package and
inspect the components for any sign of damage.
Ensure that you have sufficient clearance around the rack cabinet. If
components are still packed onto a pallet, you need approximately eight ft
After you have built the rack, you will want to repack and return the
shipping material as it is reused for cost and environmental reasons.
Leave the job site of the customer as clean as possible, or cleaner than it
was when you arrived.
Step one
Lay each of the outer sleeves flat, then fold it lengthwise before collapsing
the three sections.
Step two
Step three
- Stack the two folded outer sleeves above the ramp sections.
- Apply the two collar sections to either side of the pallet; hold them in
place with the package hood.
Step four
The next step is to attach power cables to the power distribution units on
each side of the rear of the cabinet. Most configurations require four PDUs
(2 per side, mounted one above the other).
Cabinet requirements13
PDU configuration14
40U-P cabinet PDUs do not include a power On/Off switch. Ensure that
the circuit breakers on each PDU are UP, and in the OFF position until
ready to supply AC power to the unit.
cords to support the maximum configurations, and are likely to have extra
cords as part of your shipment.
15 If your site requires external grounding (for example, to a common
grounding network beneath the site floor), you can use the grounding lugs
that are provided on each of the lower power distribution panels of the
cabinet.
Sliding Rails
After the rack cabinet is built, you can begin installing the hardware.
Building the rack includes unpacking the node, verifying contents, and
repacking the shipping material.
Sliding Rails
The first step is to attach the sliding rails. A sliding rail system is used to
attach the node or chassis to the rack or cabinet and allows easy access
to the components. The sliding rail kit is compatible with rack cabinets with
the following hole types:
Adjustable Rails
1U, 2U, and 4U rails for nodes and chassis adjust in length from 24 to 36
inches to accommodate various cabinet depths. The rails are not left-
specific or right-specific and can be installed on either side of the rack.
The video demonstrates installing the rails for a Gen6 chassis. See the
student guide for the video transcript.
Pre-Threaded Holes
The video demonstrates installing the rail kit in a rack with prethreaded
holes. See the student guide for the video transcript.
Considerations
Installing 1U Nodes
Before you begin, verify that the rail kit contains all the necessary
components. Each 1U slide rail consists of a slide bracket, an outer rail,
an intermediate rail, and an inner rail. Change the rail alignment posts if
needed. Download and view the SolVe Online procedure for the most
recent instruction details.
1: Remove the inner rails from the rail assemblies on both rails.
3: Install both the slide rails in the rack. Each assembly contains a right
and a left slide rail.
4: You are now ready to install the node on the rails in the rack, pushing in
until the slide rails are locked. Remember, the enclosure is heavy and
must be installed into or removed from a rack by two people.
5: To further secure the rail assembly and server in the cabinet, insert and
tighten a small stabilizer screw directly behind each bezel latch.
Installing 2U Nodes
The video demonstrates installing 2U nodes in the rack. See the student
guide for the video transcript.
Movie:
Installing 2U Nodes Transcript: First, verify that the rail kit contains all
the necessary components. The 2U node rail kit includes:
• Four 8-32 x 0.75-inch knurled slide rail mounting screws for securing
the slide rails to the rack or cabinet.
• Eight 8-32 x 0.25-inch shoulder alignment pins for use only in a
prethreaded rack or cabinet.
• Two 6-32 x 0.25-inch knurled chassis retaining screws for securing the
node to the rack or cabinet.
• One node retaining bracket, which provides a mounting surface for the
chassis retaining screws.
Movie transcript: Each slide rail consists of a slide bracket, an outer rail,
an intermediate rail, and an inner rail. To remove the inner rails from the
rail assemblies, fully extend the slide rails to the open and locked
positions. Press the release button on the inner slide rail, and pull it from
the intermediate slide rail until they separate.
Next, you attach the inner rails to the sides of the node. Align the large
end of the keyhole slots of the inner rail over the shoulder screws on the
side of the node chassis. It may be necessary to loosen the shoulder
screws to slide the rails on. Push the inner slide rail until it locks into place.
Tighten the shoulder screws. Then, attach the second slide rail on the
other side the same way. To attach the rail to the rack, first determine the
rack cabinet that you are using. See the Rail Kit Installation Guide for
specific instructions for different types of rack cabinets. Here, we are using
a rack cabinet with 3/8” square holes. (Note: If using a rack with
prethreaded holes, replace the preassembled step alignment pins in the
ends of the outer rails. Install the rail kit with the proper shoulder alignment
pins before proceeding to the next step.)
First, place the rear slide bracket into the back of the rack. Adjust the outer
slide rail to fit the depth of the rack cabinet. Ensure that the alignment pins
protrude through holes in the rack mounting rails and that the outer and
rear slide brackets are level. Attach to the same holes on both ends of the
rack. Place the node retaining bracket on the front of the right side rail so
that the middle hole covers the top alignment pin. Then secure the bracket
with one of the 8 to 32 x 0.75-inch knurled thumbscrews. Secure all other
ends of the rail to the rack by inserting the 8 to 32 x 0.75-inch knurled
thumbscrews. Tighten the screws. Repeat the process for the second rail.
Next, install the node in the rack. However, Do Not Continue until you
confirm that both rails are secured to the rack and all mounting screws are
in place and tightened. Failing to do so could result in injury or damage to
the node, and to avoid injury, use two people to lift and move the node.
Fully extend each intermediate slide rail until the rail is fully open and
locked into place. With a person on each side of the node, keep the node
level with the slide rails. And align the ends of the inner slide rails with the
ends of the intermediate slide rails. Slide the inner slide rails on each side
of the node into the intermediate slide rails. Then retract the slide rails until
the node is fully inserted in the rack. There is an audible click when the
node is secure. Confirm that the inner slide rails attached to the node are
inserted correctly and firmly secured to intermediate slide rails that are
attached to the rack.
Secure the node to the rack cabinet using either the 6 to 32 x 0.25-inch
knurled chassis retaining screws or retaining screws and retainer bracket
depending on node type. Tighten the screws.
Installing 4U Nodes
Before you begin, unpack and verify that the rail kit contains all the
necessary components. Each 4U slide rail consists of an inner rail, an
outer rail, and an intermediate rail. To attach the rail to the rack, first
determine the rack cabinet that you are using. See the SolVe Online guide
for specific instructions for different rack cabinets.
1: Place the rear slide bracket into the back of the rack. Adjust the outer
slide rail to fit the depth of the rack cabinet, ensuring that the alignment
pins protrude through holes in the rack mounting rails. Ensure that the
outer and rear slide brackets are level and attached to the same holes on
both ends of the rack. Secure all other ends of the rail to the rack by
inserting the 8 to 32 x 0.75-inch knurled thumbscrews. Tighten the screws.
Repeat the process for the second rail.
2: Attach a clip-on nut retainer to the third hole above the slide rail on
each side of the rack. The next step is to install the node in the rack.
However, do not continue until you confirm that both rails are secured to
the rack and all mounting screws are in place and tightened. Failing to do
so could result in injury or damage to the node. Remember to always use
multiple people to lift a 4U node. If a 4U node is shipped with hard drives
already installed, it can weigh over 285 lbs. Use of a mechanical lift is
recommended. To use the cable management tray, be sure to leave 1U
space under the node for the cable management tray. For ease of
installation, install the cable management tray before installing the main
chassis.
3: Once the node is installed in the rack, insert the drives into the node.
4: Once the drives are inserted into the node, insert the front panel.
A chassis containing drives and nodes can weigh more than 285 pounds.
Attach the chassis to a lift to install16 it in a rack.
Installing a chassis.
1. Align the chassis with the rails that are attached to the rack.
2. Slide the first few inches of the back of the chassis onto the supporting
ledge of the rails.
3. Release the lift casters and carefully slide the chassis into the cabinet
as far as the lift allows.
16If a lift is not available, you must remove all drive sleds and nodes from
the chassis before you attempt to lift it. Even when the chassis is empty,
only attempt to lift and install the chassis with multiple people.
1: Back-end Switches
• Provided by PowerScale.
• Install switches into the rack with the ports facing the rear of the rack.
• Connect each switch to separate power circuit.
• If the switch has multiple power connectors, connect each cable to a
different power circuit. Some switches have additional power
connectors to support optional redundant power supplies that may not
be installed.
• Each switch pair supports a single cluster.
• When adding Gen6 nodes to an existing Gen5 cluster, the Gen6 nodes
connect to the InfiniBand switches. InfiniBand is supported for Gen5
nodes and for mixed Gen5 and Gen6 node clusters. See the
PowerScale Node Site Preparation and Planning Guide on the
PowerScale Info Hub for more details.
• High-speed, unmanaged fabric.
• Greater range of sizes.
• Identical functionality for Gen5 and Gen6 nodes.
4: Ethernet/InfiniBand
Select each tab to learn about backend switch support for PowerScale
nodes.
The table lists the following Ethernet switches currently supported for
PowerScale back-end connectivity.
H400, A200, 25/10 GbE 25 /10 GbE 10 GbE SFP+ 10 GbE QDR
A2000 SFP28 QSFP+
10 GbE
SFP+
Installation Guides
By using SolVe online or desktop, you can generate installation guides for
any specific node or product for PowerScale. The example shows the first
step in generating an F200 node installation guide.
Install the chassis components after the chassis is racked. Select each tab
to view a short demonstration on installing the drives, drive sleds, and
compute modules.
This short video demonstrates installing drives into a drive sled and
installing the sled into a chassis. See the student guide for the video
transcript.
Compute Module
This video demonstrates how to install the compute module of a node into
a chassis. See the student guide for the video transcript.
Install Drive and Sled Transcript: For 3.5" drives, push the drive and
paddle card straight down into the empty connector. Insert the tabs on the
drive sled cover into the slots in the drive sled. For 2.5” drives, with the top
cover at an angle, insert the covers three tabs into the slots on the sled.
Next lower the open side of the cover until it is flat against the drive sled.
Slide the cover forward to lock it onto the sled. Swing the blue sled cover
latches back into place and press until you feel the latches click. Ensure
that the drive sled handle is open. With two hands, slide the drive sled into
the same bay you removed it from. Push the drive sled handle back into
the face of the sled to secure the drive sled in the bay. Swing the display
assembly back against the chassis until you feel it click into place. Align
the front bezel with the front of the chassis, then push until you feel the
bezel snap into place.
Install Compute Module Transcript: Keep the lever in the open position
until the compute module is pushed all the way into the bay. Support the
node with both hands and slide it into the node bay. Push the release
lever in against the compute module back panel. You can feel the lever
pull the module into place in the bay. If the lever does not pull the compute
module into the bay, pull the lever back into the open position. Next,
ensure that the module is pushed all the way into the bay, then push the
lever in against the compute module again. Tighten the thumbscrew on
the release lever to secure the lever in place.
The F200 has four SAS SSDs numbered from 0 to 3 and uses no SAS
expander.
The F600 drive bays 0 and 1 are empty due to the internal cabling layout
of the node. The F600 has eight NVMe SSDs that use bays 2 to 9.
The F900 has 24 vertical 2.5" NVME SSD drives that use bays 0 to 23.
1: CPU2 is available on the F600. On the F200, this area is the location of
the NVDIMM battery.
5: Disk drives. The F200 uses SAS SSDs, and the F600 uses NVMe
SSDs. Hard drives are supplied in hot swappable hard drive carriers that
fit in the hard drive slots. You can check the status indicator on the carrier
to identify a faulted hard drive.
7: Backplane. Label each hard drive before removing from the node to
ensure that the drives are returned to the same drive bay.
8: Power supply units (PSU). The node must have one PSU for normal
operation. Remove and replace only one PSU at a time in a node that is
powered on. PSUs must be of the same type and have the same
maximum output power.
9: Internal Dual SD Module (IDSDM). The F200 and F600 nodes use one
of the two micro-SD slots. The micro-SD shows up in OneFS as a USB
device (da0). isi_hwmon monitors IDSDM. IDSDM in OneFS is used for
secondary backup for PSI information and temporary storage for FW
upgrade binaries.
10: Frontend NIC. The F600 uses PCIe slot 3 for front-end connectivity,
and the F200 uses the rack network daughter card (rNDC).
F200 rNDC.
11: Backend. The backend NIC is installed in slot 1 for both the F200 and
F600. The F200 has a 25 GbE NIC while the F600 uses a 100 GbE NIC.
PowerScale offers high density with Archive and Hybrid Hard Disk Drives
nodes.
The PowerScale Archive and Hybrid nodes have two or four nodes per
chassis with five multidrive sleds per node (three to four drives per sled)
for greater drive density. The 4U chassis are available as standard (1 m
rack compatible) and deep (Titan D/HD rack equivalent) depending on
model. These nodes can have up to eighty 3.5” storage HDDs per
chassis, and two 2.5” cache SSDs per node. Archive and Hybrid nodes
have SATA and SAS support only (no NVMe).
Gen6 Sled
Front View
Node Components
1. 1 GbE 6. Multifunction
management and button
SSH port
3. External 8. Cache
network ports SSDs
4. Console 9. USB
connector connector
Compute Node
Internal Compute
The P100 and B100 nodes have 2x2.5" SAS SSD drives each. Drive bays
3 to 8 are not used and have fillers.
If the NIC is 25 GbE, then rNDC is used for the front end, otherwise it is
populated by a 1 GbE four port card, which is required for PXI in factory.
There is no 100GbE rNDC option.
Bezels in A-Series devices are accelerator node specific and may not
appear as shown. Bezels may include a keylock. All bezels include tabs
on either side that you press in to release the bezel and its latches. Push
the ends, not the middle of the bezel, press the bezel onto the latch
brackets until it snaps into place.
Movie:
Once the system is racked and stacked, move on to connecting the node
to the internal and external networks.
Network
Internal Network17
External Network18
InfiniBand19
Cables20
The graphic shows a Gen6, four node cluster with an InfiniBand back-end.
There are no special considerations when connecting to an Ethernet back-
end. The two steps are:
1. Connect an InfiniBand or Ethernet cable between the int-a port and the
switch (switch 1) for the Internal A network.
2. If the network topology supports a second internal network, connect
the int-b port to a separate network switch (switch 2) for the int-b
network.
PowerScale All-Flash nodes only support Ethernet. Each F200, F600, and
F900 node provides two ports for backend connectivity. The PCIe slot 1 is
used. F900 and F600 nodes use 100 GbE and 40 GbE ports. F200 nodes
use 10/25 GbE ports, or 40/100 GbE ports with OneFS 9.5 or later.
PowerScale Archive and Hybrid nodes replace the 10 GbE and 40 GbE
Gen6 NIC options with 10/25 GbE or 40/100 GbE NICs for front-end and
back-end networking. InfiniBand is used as an option for back-end
networking for existing clusters.
Breakout Cables
The 40 GbE and 100 GbE connections contain four individual lines of 10
GbE and 25 GbE.
Most switches support breaking out a QSFP port into four SFP ports using
a 1:4 breakout cable.
The back-end is managed automatically when the switch detects the cable
type as a breakout cable.
23Use care when handling and looping copper InfiniBand cables, and any
type of optical network cables. Bending or mishandling cables can result in
damaged and unusable cables.
External networks connect the cluster to the outside world. Subnets are
used in external networks to manage connections more efficiently.
Specifying external network subnets depends on the topology of the
network24. The Ethernet cable connects the node to the external network
so the node can communicate with external clients. Use an Ethernet cable
to connect the ext-1 port on the node to the switch for the external
network.
PowerScale nodes25 have two ports, ext-1 and ext-2, as the graphic
depicts.
The graphic shows a closer look at the external and internal connectivity.
Slot 1 is used for back-end communication on both the F200 and F600.
Slot 3 is used for the F600 2 x 10/25 or 40/100 GbE front-end network
connections.
In the F200, the rNDC can provide 10 GbE or 25 GbE connections for
front-end networking.
• OneFS 9.4.0.9 includes support for 100 GbE Ethernet option on F200.
Connecting Power
Nodes and chassis contain redundant power supplies to ensure that the
node remains powered in case a power supply fails. Connect the power
supply cables to the node power connectors, and then connect each
power supply cable to a separate power source.
• Gen6
o Compute has single power supply.26
o Node-pair provides redundant power.27
o Nodes automatically power on.28
• PowerScale All-Flash, PowerScale Archive and Hybrid Nodes
When setting up new nodes, if you are not yet ready for them to be
powered on, do not connect the power cables.
Configuration Wizard
Connect to Node
The serial console gives you serial access when you cannot or do not
want to use the network. Other reasons for accessing using a serial
connection may be for troubleshooting, site rules, a network outage, and
so on.
Serial Port29
29The serial port is a male DB9 connector. Connect a serial null modem
cable between a serial port of a local client, such as a laptop, and the
node serial port. Connect to the node designated as node 1. If no laptop
serial ports are available, use a USB-to-serial converter. Start a serial
communication utility such as Minicom (UNIX) or PuTTY (Windows).
The configuration
wizard starts
automatically when a
new node is powered
on. The wizard
provides step-by-step
guidance for
configuring a new
cluster or adding a node to an existing cluster.