Upgrading Firmware when Adding InfiniBand to an Existing Fabric
A customer recently asked, “When adding a new InfiniBand switch to an existing fabric, should the firmware on the existing switches be upgraded to the version of the firmware on the new switch before connecting the new switch?”
It is not required for all switches in an InfiniBand network to have matching firmware. Since adding a switch often coincides with cluster downtime, that may be a natural time to update the firmware anyway.
First, get a list of your switches and the current firmware running on them. To list your switches, run ‘ibswitches’. Each switch will be listed with the GUID, the number of ports, a descriptive name, and the LID of the switch itself. Next, using the LID from each switch, run ‘mstflint -d lid-LID q’. This will query the switch, listing some details about the switch, as well as the installed firmware.
Next, to see if you want to update the firmware in your switches, start by looking at the release notes for the current release. See http://www.mellanox.com/page/
Categories
- Getting Support (5)
- Hardware (35)
- Areca Raid Arrays (3)
- InfiniBand (10)
- LSI Raid Arrays (9)
- NVIDIA Graphics Cards (1)
- Racks (1)
- Troubleshooting (8)
- Software (11)
- ACT Utilities (5)
- HPC apps & benchmarks (1)
- Linux (3)
- Schedulers (3)
- SGE / Grid Engine (1)
- TORQUE (1)
- Tech Tips (17)
Request a Consultation from our team of HPC and AI Experts
Would you like to speak to one of our HPC or AI experts? We are here to help you. Submit your details, and we'll be in touch shortly.