NetApp FAS2650 node panic – ONTAP 9.1

After installing a new NetApp FAS2650 recently, a bug was observed which was causing one of the nodes to panic, and restart to the LOADER A prompt. After engaging with NetApp support, the following bug was found

A PCI NMI error triggers from QLogic 16Gb FC or 10 GbE Converged Network Adapter
(CNA) ports on some storage systems, such as FAS8200, FAS2650, FAS2620,
AFF A300, or AFF A200. The issue might continue to reoccur several times. This
issue only occurs when the port pair is configured in CNA mode.
An example of an error message is displayed, as follows:
PANIC : PCI Error NMI from device(s):RPT(0,3,3):QLogic FC/10GbE CNA on
Controller.

http://mysupport.netapp.com/NOW/cgi-bin/bol?Type=Detail&Display=1026931

To resolve this, the following workaround is available:

Use the service processor to perform a system power cycle on the affected controller.

Reconfigure all unused CNA port pairs to Fibre Channel (FC) mode. Run the below commands from the Service Processor, commands below:

  1. ucadmin show –node “Affected Node” –adapter *
  2. ucadmin modify -node * -adapter * -mode fc -type target

You will need to make sure all CNA adapters are changed to fc to resolve the issue. Example below:

Before example:

*> ucadmin show

Current  Current    Pending  Pending    Admin

Adapter  Mode     Type       Mode     Type       Status

——-  ——-  ———  ——-  ———  ——-

0c     fc       target     –        –          offline

0d     fc       target     –        –          offline

0e     cna      target     fc       –          offline

0f     cna      target     fc       –          offline

Example 2/:

*> ucadmin modify -m fc -t target 0f

ucadmin modify: Mode on adapter 0f and also adapter 0e will be changed to fc.

Do you want to continue (y/n)? y

*> ucadmin show

Current  Current    Pending  Pending    Admin

Adapter  Mode     Type       Mode     Type       Status

——-  ——-  ———  ——-  ———  ——-

0c     fc       target     –        –          offline

0d     fc       target     –        –          offline

0e     cna      target     fc       –          offline

0f     cna      target     fc       –          offline

After Modify command is used

::> ucadmin show

Current  Current    Pending  Pending    Admin

Node          Adapter  Mode     Type       Mode     Type       Status

————  ——-  ——-  ———  ——-  ———  ———–

Node01            0c       fc       target     –        –          online

Node01            0d       fc       target     –        –          online

Node01            0e       fc       target     –        –          online

Node01            0f       fc       target     –        –          offline

 

Caveat: information presented in this how to guide is as is,  myself or my employer hold no responsibility to the guaranteed success of this guide