SR-IOVの使用
CentOS6.4のKVM環境で、実際に構築してみた。
Ubuntu 12.04でもテストしてみる予定。
SR-IOV operability confirmed card - SR-IOV動作確認カード
動作確認したカード
| Card | OS Version | driver | Working OS | etc |
|---|---|---|---|---|
| Intel I350-T2 | CentOS 6.4 | MLNX_OFED 2.0-3.0.0 | CentOS 6.4 Ubuntu 12.04LTS FreeBSD 10.0Beta | Ethernet work |
| Intel Gigabit Ethernet Card-ET2 | CentOS 6.4 | MLNX_OFED 2.0-3.0.0 | CentOS 6.4 Ubuntu 12.04LTS FreeBSD 10.0Beta | Ethernet work |
| Solarflare SFN5122F | CentOS 6.4 | virto_net + xnap | no test | |
| ConnectX-2 MHZH29-XTC | Ubuntu 12.04LTS | MLNX_OFED 2.0-3.0.0 | no test | |
| ConnectX-3 MCX353A-FCBT | CentOS 6.4 | MLNX_OFED 2.0-3.0.0 | CentOS 6.4 Ubuntu 12.04LTS | InfiniBand,Ethernet work |
hypervisor環境
SR-IOV対応M/B
CentOS 6.4 or Ubuntu 12.04LTS
IB stack MLNX_OFED 2.0-3.0.0
ConnextX-3
Intel I350
ConnectX-2
上記で、ConnectX-3とIntel I350を SR-IOVで使用。
/etc/modprobe.dへ、以下の二つのファイルを作成。
- igb.conf
options igb max_vfs=7
- mlx4.conf
options mlx4_core debug_level=1 port_type_array=1,2 num_vfs=8 probe_vf=8 set_4k_mtu=1 options mlx4_en udp_rss=1
認識成功したら、インターフェイスがにょきにょき生えてくる筈。
lspciで見ると以下
00:00.0 Host bridge: Intel Corporation Xeon E5/Core i7 DMI2 (rev 07) 00:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07) 00:01.1 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1b (rev 07) 00:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07) 00:02.2 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2c (rev 07) 00:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07) 00:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07) 00:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07) 00:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07) 00:11.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Virtual Root Port (rev 05) 00:16.0 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #1 (rev 05) 00:16.1 Communication controller: Intel Corporation C600/X79 series chipset MEI Controller #2 (rev 05) 00:1a.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #2 (rev 05) 00:1c.0 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 1 (rev b5) 00:1c.7 PCI bridge: Intel Corporation C600/X79 series chipset PCI Express Root Port 8 (rev b5) 00:1d.0 USB controller: Intel Corporation C600/X79 series chipset USB2 Enhanced Host Controller #1 (rev 05) 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5) 00:1f.0 ISA bridge: Intel Corporation C600/X79 series chipset LPC Controller (rev 05) 00:1f.2 SATA controller: Intel Corporation C600/X79 series chipset 6-Port SATA AHCI Controller (rev 05) 00:1f.3 SMBus: Intel Corporation C600/X79 series chipset SMBus Host Controller (rev 05) 03:00.0 Ethernet controller: QLogic Corp. 10GbE Converged Network Adapter (TCP/IP Networking) (rev 02) 03:00.1 Ethernet controller: QLogic Corp. 10GbE Converged Network Adapter (TCP/IP Networking) (rev 02) 03:00.2 Fibre Channel: QLogic Corp. 10GbE Converged Network Adapter (FCoE) (rev 02) 03:00.3 Fibre Channel: QLogic Corp. 10GbE Converged Network Adapter (FCoE) (rev 02) 04:00.0 Ethernet controller: QLogic Corp. cLOM8214 1/10GbE Controller (rev 58) 04:00.1 Ethernet controller: QLogic Corp. cLOM8214 1/10GbE Controller (rev 58) 04:00.6 Fibre Channel: QLogic Corp. 8200 Series 10GbE Converged Network Adapter (FCoE) (rev 58) 04:00.7 Fibre Channel: QLogic Corp. 8200 Series 10GbE Converged Network Adapter (FCoE) (rev 58) 05:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20) 05:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit Ethernet (rev 20) 06:00.0 Serial Attached SCSI controller: Intel Corporation C602 chipset 4-Port SATA Storage Control Unit (rev 05) 06:00.3 SMBus: Intel Corporation C600/X79 series chipset SMBus Controller 0 (rev 05) 07:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 07:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 08:10.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:10.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:10.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:10.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:11.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:11.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:11.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:11.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:12.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:12.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:12.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:12.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:13.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 08:13.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) 09:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 02) 0a:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 21) 7f:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07) 7f:08.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07) 7f:08.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07) 7f:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07) 7f:09.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07) 7f:09.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07) 7f:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07) 7f:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07) 7f:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07) 7f:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07) 7f:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07) 7f:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07) 7f:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07) 7f:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07) 7f:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) 7f:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07) 7f:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07) 7f:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07) 7f:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07) 7f:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07) 7f:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07) 7f:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07) 7f:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07) 7f:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07) 7f:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07) 7f:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07) 7f:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07) 7f:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07) 7f:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07) 7f:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07) 7f:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07) 7f:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07) 7f:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07) 7f:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07) 7f:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07) 7f:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07) 7f:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07) 7f:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07) 7f:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07) 80:00.0 PCI bridge: Intel Corporation Xeon E5/Core i7 DMI2 in PCI Express Mode (rev 07) 80:01.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 1a (rev 07) 80:02.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 2a (rev 07) 80:03.0 PCI bridge: Intel Corporation Xeon E5/Core i7 IIO PCI Express Root Port 3a in PCI Express Mode (rev 07) 80:05.0 System peripheral: Intel Corporation Xeon E5/Core i7 Address Map, VTd_Misc, System Management (rev 07) 80:05.2 System peripheral: Intel Corporation Xeon E5/Core i7 Control Status and Global Errors (rev 07) 80:05.4 PIC: Intel Corporation Xeon E5/Core i7 I/O APIC (rev 07) 82:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3] 82:00.1 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.2 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.3 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.4 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.5 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.6 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:00.7 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 82:01.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3 Virtual Function] 84:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 02) ff:08.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 0 (rev 07) ff:08.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07) ff:08.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 0 (rev 07) ff:09.0 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link 1 (rev 07) ff:09.3 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07) ff:09.4 System peripheral: Intel Corporation Xeon E5/Core i7 QPI Link Reut 1 (rev 07) ff:0a.0 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 0 (rev 07) ff:0a.1 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 1 (rev 07) ff:0a.2 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 2 (rev 07) ff:0a.3 System peripheral: Intel Corporation Xeon E5/Core i7 Power Control Unit 3 (rev 07) ff:0b.0 System peripheral: Intel Corporation Xeon E5/Core i7 Interrupt Control Registers (rev 07) ff:0b.3 System peripheral: Intel Corporation Xeon E5/Core i7 Semaphore and Scratchpad Configuration Registers (rev 07) ff:0c.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0c.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0c.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0c.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 0 (rev 07) ff:0c.7 System peripheral: Intel Corporation Xeon E5/Core i7 System Address Decoder (rev 07) ff:0d.0 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0d.1 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0d.2 System peripheral: Intel Corporation Xeon E5/Core i7 Unicast Register 0 (rev 07) ff:0d.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller System Address Decoder 1 (rev 07) ff:0e.0 System peripheral: Intel Corporation Xeon E5/Core i7 Processor Home Agent (rev 07) ff:0e.1 Performance counters: Intel Corporation Xeon E5/Core i7 Processor Home Agent Performance Monitoring (rev 07) ff:0f.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Registers (rev 07) ff:0f.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller RAS Registers (rev 07) ff:0f.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 0 (rev 07) ff:0f.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 1 (rev 07) ff:0f.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 2 (rev 07) ff:0f.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 3 (rev 07) ff:0f.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Target Address Decoder 4 (rev 07) ff:10.0 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 0 (rev 07) ff:10.1 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 1 (rev 07) ff:10.2 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 0 (rev 07) ff:10.3 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 1 (rev 07) ff:10.4 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 2 (rev 07) ff:10.5 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller Channel 0-3 Thermal Control 3 (rev 07) ff:10.6 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 2 (rev 07) ff:10.7 System peripheral: Intel Corporation Xeon E5/Core i7 Integrated Memory Controller ERROR Registers 3 (rev 07) ff:11.0 System peripheral: Intel Corporation Xeon E5/Core i7 DDRIO (rev 07) ff:13.0 System peripheral: Intel Corporation Xeon E5/Core i7 R2PCIe (rev 07) ff:13.1 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to PCI Express Performance Monitor (rev 07) ff:13.4 Performance counters: Intel Corporation Xeon E5/Core i7 QuickPath Interconnect Agent Ring Registers (rev 07) ff:13.5 Performance counters: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 0 Performance Monitor (rev 07) ff:13.6 System peripheral: Intel Corporation Xeon E5/Core i7 Ring to QuickPath Interconnect Link 1 Performance Monitor (rev 07)
virshでデバイスをdetach
SR-IOV I350
virsh nodedev-list | grep 08
virsh nodedev-dumpxml pci_0000_08_10_0
virsh nodedev-detach pci_0000_08_10_0
SR-IOV ConnectX-3
virsh nodedev-list | grep 82
virsh nodedev-dumpxml pci_0000_82_00_1
virsh nodedev-detach pci_0000_82_00_1
自分用メモ
////
// I350 Network Interface
//
// internal network interface
2: p2p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 04:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
link/ether 00:25:90:6a:52:76 brd ff:ff:ff:ff:ff:ff
vf 0 MAC 52:54:00:78:6d:dd 04:10.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) spoon FreeBSD
vf 1 MAC 72:a7:f5:5f:34:00 04:10.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) kona Ubuntu
vf 2 MAC ea:be:5b:4f:3f:bd 04:11.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) toraja Ubuntu
vf 3 MAC ea:29:14:4c:f4:b4 04:11.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) cacti Ubuntu
vf 4 MAC 76:7e:b6:4f:63:97 04:12.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01) pfSense
vf 5 MAC 26:9b:be:f0:da:8b 04:12.4 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 6 MAC 42:e2:59:3e:fd:3f 04:13.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
// host interface
3: p2p2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 04:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
link/ether 00:25:90:6a:52:77 brd ff:ff:ff:ff:ff:ff
vf 0 MAC e2:81:3b:4a:ef:0e 04:10.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 1 MAC e6:30:0d:e1:bd:fc 04:10.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 2 MAC a6:a5:91:e7:c0:16 04:11.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 3 MAC a2:5c:f5:9e:ee:fc 04:11.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 4 MAC c6:48:f5:1a:60:7e 04:12.1 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 5 MAC 52:54:00:d9:e2:e8 04:12.5 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
vf 6 MAC 52:54:00:d9:e2:e3 04:13.0 Ethernet controller: Intel Corporation I350 Ethernet Controller Virtual Function (rev 01)
////
// Intel 1000ET Quad Interface
//
// IX3010 NAT Internal Network
4: p4p1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 07:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
link/ether 90:e2:ba:08:e9:60 brd ff:ff:ff:ff:ff:ff
vf 0 MAC b2:49:eb:b8:88:f0 08:10.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 1 MAC 7a:3d:f9:2b:9d:c4 08:10.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 2 MAC 76:f5:72:b1:03:ec 08:10.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 3 MAC 86:a6:b5:d6:9c:85 08:10.6 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 4 MAC 06:3f:0b:31:a6:bd 08:11.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 5 MAC 02:2d:15:16:fb:6a 08:11.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 6 MAC 6e:90:04:15:5f:6d 08:11.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
// Internal Network interface
5: p4p2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 07:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
link/ether 90:e2:ba:08:e9:61 brd ff:ff:ff:ff:ff:ff
vf 0 MAC 7a:66:55:0a:9c:fe 08:10.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 1 MAC 4e:7a:4a:54:e5:82 08:10.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 2 MAC ce:84:8c:95:70:e7 08:10.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 3 MAC 3e:f0:24:9d:92:54 08:10.7 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 4 MAC 7a:ab:54:36:6c:b3 08:11.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 5 MAC fe:1f:f4:ac:6c:0b 08:11.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 6 MAC 82:98:2a:96:15:49 08:11.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
// flets Express netwoerk interface
6: p4p3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 09:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
link/ether 90:e2:ba:08:e9:62 brd ff:ff:ff:ff:ff:ff
vf 0 MAC 52:54:00:78:6d:de 0a:10.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01) FreeBSD spoon
vf 1 MAC 52:54:00:d9:e2:e9 0a:10.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 2 MAC 0e:69:f1:9b:03:ec 0a:10.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01) pfSense
vf 3 MAC 0a:88:07:0a:78:26 0a:10.6 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 4 MAC e2:6e:75:f5:dd:fb 0a:11.0 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 5 MAC 86:e2:5e:7c:35:0e 0a:11.2 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 6 MAC b2:d5:c8:f0:e0:32 0a:11.4 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
// flets Family network interface
7: p4p4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP qlen 1000 09:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)
link/ether 90:e2:ba:08:e9:63 brd ff:ff:ff:ff:ff:ff
vf 0 MAC 6a:b6:59:cc:9c:a7 0a:10.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01) Ubuntu kona
vf 1 MAC 7a:48:97:4b:8e:43 0a:10.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 2 MAC 7a:c7:a4:ff:a7:57 0a:10.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 3 MAC 2e:ac:f5:02:4b:fa 0a:10.7 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 4 MAC 22:40:39:4a:86:ec 0a:10.1 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 5 MAC 6e:bd:dd:2c:61:b1 0a:10.3 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
vf 6 MAC ae:c5:18:e4:d8:35 0a:10.5 Ethernet controller: Intel Corporation 82576 Virtual Function (rev 01)
59: eth4: <BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state UNKNOWN qlen 1000
link/ether 00:02:c9:a0:a9:71 brd ff:ff:ff:ff:ff:ff
vf 0 MAC 52:54:00:78:6d:e0, vlan 4095
vf 1 MAC 00:00:00:00:00:00, vlan 4095
vf 2 MAC 00:00:00:00:00:00, vlan 4095
vf 3 MAC 00:00:00:00:00:00, vlan 4095
vf 4 MAC 00:00:00:00:00:00, vlan 4095
vf 5 MAC 00:00:00:00:00:00, vlan 4095
vf 6 MAC 00:00:00:00:00:00, vlan 4095
vf 7 MAC 00:00:00:00:00:00, vlan 4095