Add-On Expansion Card Installation¶
The Netgate® 8300 has two expansion card slots available for additional devices such as 25 Gbit/s or 100 Gbit/s network interface cards.
The two expansion card slots have the following capabilities:
1x PCIe 3.0 x8 LP (Low Profile) slot which supports half-length low profile cards.
1x PCIe 4.0 x16 slot which supports full-height three-quarter length cards.
See also
See Input and Output Ports for additional information on the expansion card slots.
Warnings and Precautions¶
Danger
Anti-static protection must be used throughout this procedure.
Warning
Installing network interface cards which use the same driver as built-in ports on the device will cause the existing interface assignments to shift, which will affect connectivity. Reinstalling or performing a factory reset will take expansion card(s) into account when the interfaces are automatically assigned.
See Reassign Interfaces (Network Interface Cards Only) later in this document for details.
Danger
Take all appropriate precautions and exercise care when handling the exposed system board and add-on cards. There are many delicate components which can be damaged during this process. Damage caused via physical contact and electrostatic discharge while performing this installation is not covered by the warranty.
Warning
This device includes an intrusion detection sensor which operates even when the device is without power.
Opening the case on this device triggers an intrusion alarm which is logged by the BMC and is visible in the IPMI sensors. This alarm must be reset manually as described in Re-arm the Chassis Intrusion Switch.
When the intrusion alarm is active the fans run at a fixed speed of around 8500 RPM. Resetting the intrusion sensor alarm returns the fans to their profiled speed.
Required Tools and Hardware¶
Installing add-on expansion cards in the Netgate 8300 requires the following tools and hardware:
Phillips screwdriver
Anti-static grounding strap and anti-static mat for handling bare components and the 8300 system
Compatible expansion card
Installation Procedure¶
The installation procedure has many steps which are broken down into related groups in the remainder of this document. Follow all steps in the procedure carefully.
Take a Backup¶
If the system contains an existing configuration, then the first step is to take a backup of that configuration for safety.
If the existing configuration is not necessary, this section may be skipped.
There are numerous backup options covered in the pfSense software documentation section on Backup and Restore.
For the purposes of reinstalling and restoring, the easiest method is to take a local backup.
Power Off and Disconnect¶
For safety, before opening the case, the Netgate 8300 must be completely disconnected. This includes power, network cables, USB cables, serial console cables, and any other external cables or devices connected to the Netgate 8300.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Turn power off to the unit by changing the power switch on the rear of the unit to the off position.
Unplug the power cables from all installed power supply units (PSUs).
Danger
Wait at least 60 seconds after unplugging power to proceed. This ensures that all phantom power has dissipated.
The LED indicator on all installed PSUs should be off before proceeding.
Unplug all network cables, USB cables and devices, serial console connections, etc.
Dismount the Netgate 8300 from the rack
Move the Netgate 8300 to a safe work location such as an anti-static mat
Removing the Lid¶
The next portion of the procedure involves opening the device and removing the lid.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Remove the screws from the top of the case near the front of the unit using the Phillips head screwdriver.
Remove the screw from the rear side of the unit at the top left corner using the Phillips head screwdriver.
Remove the screw from the rear side of the unit at the top right corner using the Phillips head screwdriver.
Slide the top cover back away from the front panel until it stops.
Lift off the top cover and set it aside, keeping it upright to avoid damaging the top surface.
Remove the Expansion Riser Assembly¶
The add-on expansion card slots are located on a riser assembly. This riser assembly must be removed from the device to safely add or remove expansion cards.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Loosen the two captive screws which attach the riser assembly to the motherboard using the Phillips head screwdriver.
Note
These screws are captive and will not fully remove from the riser assembly. It is sufficient to loosen the screws until they no longer attach the riser assembly to the motherboard. This may be felt as a soft “click” when the screw is freely rotating and the threads are not engaged.
Remove the riser assembly retaining screw on the front of the unit using the Phillips head screwdriver.
Carefully lift the riser assembly from the motherboard slot and remove the riser assembly.
Rotating the assembly as seen in figures below can help the removal process with PCIe cards installed.
Install the Add-on Expansion Card¶
With the riser assembly removed, it is time to install the add-on expansion card.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Locate the appropriate slot for the expansion card
The expansion slot will vary depending on the card. For example, a card with a low profile bracket would most likely go in the smaller slot on the left, assuming its specifications match the slot capabilities. Some cards have alternate brackets so in those cases it is best to match the card based on its bus requirements, speed, and so on. See Input and Output Ports for the expansion slot specifications.
Loosen or remove the retaining screw from the expansion slot
Tip
It is not typically necessary to fully remove the screw as the card can be moved around it when it is loosened, but removing the screw can make installing or removing the cards easier.
Remove the expansion slot cover by sliding it away from the center of the riser assembly and lifting it out, then set it aside.
Note
The cover will not be necessary so long as there is a card in the expansion slot. Store the cover in a safe place in case it is needed in the future.
Install the add-on card into the expansion card slot by sliding it toward the center of the riser assembly until it is fully seated in its socket.
Ensure the card is properly aligned and fully inserted into the expansion card slot.
The rear of the socket has a retention clip to hold the card in place which should be engaged once the card is fully seated
The front of the card should be flush with the front of the riser assembly and aligned with the retention screw hole.
Fasten the expansion card to the riser assembly using the retaining screw and the Phillips head screwdriver.
Replace the Riser Assembly¶
With the expansion card installed in the riser assembly, replace the riser assembly back into the chassis.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Insert the riser card back into the chassis and fully seat it into the slot on the motherboard.
Replace the riser assembly retaining screw on the front of the unit using the Phillips head screwdriver.
Tighten the two captive screws which attach the riser assembly to the motherboard using the Phillips head screwdriver.
Replacing and Fastening the Lid¶
With the internal components all in place, the next step is to replace the lid and all its fasteners.
Danger
Reminder:
Anti-static protection must be used throughout this procedure.
Any hardware damage incurred during this procedure is not covered by the hardware warranty.
Align the top cover with the top of the unit, a short distance behind the front panel.
Slide the top cover toward the front of the unit into its closed position.
- # Replace the screws on the rear of the unit (left and right top corners) using
the Phillips head screwdriver.
# Replace the screws on the top of the unit using the Phillips head screwdriver.
Reconnect¶
The device is now ready to be put back into its former location.
Mount the Netgate 8300 in the rack
Plug in all network cables, USB cables and devices, serial console connections, etc.
Insert the USB memstick containing the installation media
Plug the power cables into all installed power supply units.
Turn power on to the unit by changing the power switch on the rear of the unit to the on position.
Reconnect to the serial console
Reassign Interfaces (Network Interface Cards Only)¶
If the expansion card added to the device is a network interface card, this must be accounted for in pfSense software once the card is in place.
If the network card does not utilize the same driver as the interfaces in
the base system (ice(4)
), then the interfaces can be assigned and enabled as
needed based on the information in the pfSense software documentation for
interfaces.
Network interface cards which use the same driver as built-in ports on the
device (ice(4)
) will cause the existing interface assignments to
shift, which will negatively impact connectivity as the interfaces for
WAN, LAN, and so on will suddenly be mapped to different physical ports.
There are multiple ways to work around this, depending on the state of the installation on the device.
If this is a new device or if it has no configuration that needs retained, then the easiest way to properly reassign the interfaces is to either perform a factory reset (Factory Reset Procedure) or reinstall pfSense Plus software (Reinstalling pfSense Plus Software). Either of those actions will take these expansion card(s) into account when pfSense Plus software automatically assigns the interfaces on a default configuration.
See also
See Networking Ports for details.
If the device has an existing configuration which must be adjusted to match the new interface layout, then the ports must be reassigned manually. Since GUI access is likely broken by the interfaces being moved, this may need to be performed at the console. For simple configurations this may be viable, but for more complicated configurations involving LAGG, VLANs, and so on it may be difficult.
Another option is to edit the configuration backup and adjust the interfaces manually, then perform a factory reset (Factory Reset Procedure) or reinstall pfSense Plus software (Reinstalling pfSense Plus Software) and restore the adjusted configuration.
See also
Netgate TAC may be able to assist with adjusting configurations for customers in many cases.
Re-arm the Intrusion Sensor¶
Opening the case to install the expansion card will trigger the intrusion alarm sensor, even while the device is removed from power. The intrusion alarm causes the fans to run at a higher fixed speed until the sensor is re-armed.
Once pfSense software is up and running, follow the procedure in Re-arm the Chassis Intrusion Switch to reset the sensor.