FYI - To anyone who finds this in the future:
The NIC I was using on both ends is a Silicom PE210G2BPI9. Since these cards were designed with a bypass mode which is enabled by default, I needed to download Silicom's driver control software (bpctl) to disable this mode. After that, the cards started showing the flapping issue with the repository-installed ixgbe package which was quite old compared to the newest one available directly from Intel. So, I installed the newest driver from Intel, which changed the issue slightly but the flapping persisted. Ultimately, I solved my issue from installing the validated ixgbe driver included in the tarball provided by Silicom, which included the aforementioned driver control software. The version I used to successfully bring up the link was ixgbe-5.9.4ms7.1.
Here are some useful links and a TL;DR:
- Retrieve the Silicom driver which matches your NIC, for me it was here: Silicom PE210G2BPI9
- Clear the system of pre-existing ixgbe drivers (assuming you have no other NICs using the driver)
- Install and run the bpctl utility to disable bypass for each port & permanently disable them through power cycles
- Make and install the ixgbe driver from version 5.9.3ms7.1, which can be found in a subfolder of the driver download directory
- Reload/run the ixgbe driver, and your system should see the NICs
- Configure networking for each port as normal
Helpful references/tools:
- https://www.reddit.com/r/homel…_bypass_mode_on_riverbed/
- https://www.reddit.com/r/homel…10ii_for_pfopnsense_also/
- https://www.reddit.com/r/homel…ell_r210_ii_oem_flashing/
- Ethtool was extremely helpful, familiarize yourself with the man page/help function