KVM


KVM関連のメモ帳

ESXi5のInfiniBand関係がすげー残念な感じになったので移行先としてKVMの評価してみたり。
まぁ、大規模案件だとNFSの方使うからSRPは切り捨てられたんでしょう。
しかし、iSERのサポートはして欲しかった。

 環境

環境1

Ubuntu 12.04LTS + zfs ppa + kvm spice + Open vSwitch + iSCSI(iSER)
ってな環境で実験。
まずは、virsh等使わずに素状態からスタート
色々な所を参考させて頂いております。先達に感謝。

環境2

iSERでエラーがでて気持ち悪いので、以下の環境で再構築中。
Ubuntu 12.10 + zfs ppa + InfiniBand ppa + kvm spice + Open vSwitch + iSCSI(iSER)

環境3

MLNX_OFEDがUbuntu 12.04 LTS対応になった為、再度12.04で構築。
Ubuntu 12.04LTS + MLNX_OFED + kvm spice + Open vSwitch + iSCSI(iSER)

環境4

CentOS6.4 + rdo + MLNX_OFED で構築。

 kvm直叩き編

テスト環境作成

OSインストールする

kvm -name test-win -smp 2 -m 2048 -monitor telnet::4444,server,nowait \
-cdrom /rzpool/kvm-iso/win2008r2.iso -drive file=/dev/zvol/rzpool/kvm/win2008R2,if=ide,index=0,cache=writeback \
-boot order=d -daemonize -localtime -vnc port=5900

Open vSwitch環境作成


qemu-ifup/qemu-ifdownを元にovs用のスクリプト作成
ovs-ifup作成

#!/bin/sh

nic=$1

if [ -f /etc/default/qemu-kvm ]; then
    . /etc/default/qemu-kvm
fi

if [ -z "$TAPBR" ]; then
    switch=$(ip route list | awk '/^default / { print $5 }')
    if [ ! -d "/sys/class/net/${switch}/bridge" ]; then
        switch=virbr0
    fi
else
    switch=$TAPBR
fi

ifconfig $nic 0.0.0.0 up
ovs-vsctl add-port ${switch} $nic

ovs-ifdown作成

#!/bin/sh

# NOTE: This script is intended to run in conjunction with qemu-ifup
#       which uses the same logic to find your bridge/switch

nic=$1

if [ -f /etc/default/qemu-kvm ]; then
    . /etc/default/qemu-kvm
fi

if [ -z "$TAPBR" ]; then
    switch=$(ip route list | awk '/^default / { print $5 }')
    if [ ! -d "/sys/class/net/${switch}/bridge" ]; then
        switch=virbr0
    fi
else
    switch=$TAPBR
fi

ovs-vsctl del-port $switch $nic
ifconfig $nic 0.0.0.0 down

最終的な起動コマンド

kvm -name test-win \
-smp 2 \
-m 2048 \
-monitor telnet::4444,server,nowait \
-cdrom /rzpool/kvm-iso/win2008r2.iso \
-drive file=/dev/zvol/rzpool/kvm/win2008R2,if=virtio,index=0,cache=writeback \
-boot order=d \
-daemonize \
-localtime \
-vga qxl \
-spice port=5930,disable-ticketing \
-net nic,macaddr=52:54:00:1f:29:4f,model=virtio \
-net tap,ifname=tap0,script=/etc/ovs-ifup,downscript=/etc/ovs-ifdown,vhost=on 

 virt-install + virshを使う


下の実験用に作ったWindowsのvirt-install

virt-install --connect qemu:///system -n vmwin2012 -r 1024 --disk path=/home/kvm/image/server2012.qcow2,size=50 \
--cdrom /home/kvm/iso/9200.16384.WIN8_RTM.120725-1247_X64FRE_SERVER_EVAL_JA-JP-HRM_SSS_X64FREE_JA-JP_DV5.ISO \
--graphics vnc,port=5900,listen=0.0.0.0 --noautoconsole --os-type windows --os-variant win2k8 --network bridge=outnetbr0

 SR-IOV使ってみる

SR-IOVで使用してるのは、ConnectX-3とIntel I350。
ホストはUbuntu 12.04.2LTS + MLNX_OFED_LINUX 2.0.5
ゲストはUbuntu 12.04.2LTS + MLNX_OFED_LINUX 2.0.5とWindows Server 2012で実験したけど、
Windows Server 2012では、ドライバの読込が失敗して認識できず。
Ubuntu 12.04.2LTSでも、MLNX_OFED_LINUX 2.0.5をインストールしないと、InfiniBandは認識しない。

ホストでの設定

/etc/modprobe.d/mlnx.conf

# Module parameters for MLNX_OFED kernel modules
options mlx4_core port_type_array=1,2 num_vfs=8 probe_vf=4 debug_level=1

/etc/modprobe.d/igb.conf

options igb max_vfs=7

必須条件

OpenSMのバージョンは3.3.14以降でないと、ゲスト上からSMへ登録出来ないみたい。

ハマリ所

MLNX_OFED_LINUX 2.0.5のUbuntu用は、元々がRedHatのスクリプト等がベースみたいなので大分修正が必要。
例 opensmのinitスクリプトがエラーで起動しない。ib*コマンドでスクリプトの物のprefix指定が/usr/local/sbinとかになってる

詳細はそのうち書く

ホスト上のSR-IOV関係のログ

[    4.663983] Intel(R) Gigabit Ethernet Network Driver - version 4.2.16
[    4.663990] Copyright (c) 2007-2013 Intel Corporation.
[    4.664027] igb 0000:04:00.0: PCI INT A -> GSI 27 (level, low) -> IRQ 27
[    4.664040] igb 0000:04:00.0: setting latency timer to 64
[    4.664269] igb: 0000:04:00.0: igb_validate_option: max_vfs - SR-IOV VF devices set to 7
[    4.766979] pci 0000:04:10.0: [8086:1520] type 0 class 0x000200
[    4.767167] pci 0000:04:10.4: [8086:1520] type 0 class 0x000200
[    4.767307] pci 0000:04:11.0: [8086:1520] type 0 class 0x000200
[    4.767458] pci 0000:04:11.4: [8086:1520] type 0 class 0x000200
[    4.767594] pci 0000:04:12.0: [8086:1520] type 0 class 0x000200
[    4.767743] pci 0000:04:12.4: [8086:1520] type 0 class 0x000200
[    4.767879] pci 0000:04:13.0: [8086:1520] type 0 class 0x000200
[    4.768218] igb 0000:04:00.0: irq 103 for MSI/MSI-X
[    4.768227] igb 0000:04:00.0: irq 104 for MSI/MSI-X
[    4.769185] igbvf: Intel(R) Gigabit Virtual Function Driver - 2.3.2
[    4.769194] igbvf: Copyright (c) 1999-2012 Intel Corporation.
[    4.847486] igb 0000:04:00.0: Intel(R) Gigabit Ethernet Network Connection
[    4.847494] igb 0000:04:00.0: eth2: (PCIe:5.0GT/s:Width x4)
[    4.847498] igb 0000:04:00.0: eth2: MAC: 00:25:90:xx:xx:xx
[    4.847576] igb 0000:04:00.0: eth2: PBA No: 104900-000
[    4.854784] igb 0000:04:00.0: LRO is disabled
[    4.854791] igb 0000:04:00.0: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
[    4.854830] igb 0000:04:00.1: PCI INT B -> GSI 30 (level, low) -> IRQ 30
[    4.854848] igb 0000:04:00.1: setting latency timer to 64
[    4.855199] igb 0000:04:00.1: irq 105 for MSI/MSI-X
[    4.855208] igb 0000:04:00.1: irq 106 for MSI/MSI-X
[    4.935262] igb 0000:04:00.1: Intel(R) Gigabit Ethernet Network Connection
[    4.935269] igb 0000:04:00.1: eth3: (PCIe:5.0GT/s:Width x4)
[    4.935273] igb 0000:04:00.1: eth3: MAC: 00:xx:xx:xx:xx:xx
[    4.935351] igb 0000:04:00.1: eth3: PBA No: 104900-000
[    4.942571] igb 0000:04:00.1: LRO is disabled
[    4.942577] igb 0000:04:00.1: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
[    4.942621] igb 0000:81:00.0: PCI INT A -> GSI 50 (level, low) -> IRQ 50
[    4.942634] igb 0000:81:00.0: setting latency timer to 64
[    4.942688] igbvf 0000:04:10.0: enabling device (0000 -> 0002)
[    4.942722] igbvf 0000:04:10.0: setting latency timer to 64
[    4.942808] igbvf 0000:04:10.0: irq 107 for MSI/MSI-X
[    4.942816] igbvf 0000:04:10.0: irq 108 for MSI/MSI-X
[    4.942961] igb 0000:81:00.0: irq 109 for MSI/MSI-X
[    4.942970] igb 0000:81:00.0: irq 110 for MSI/MSI-X
[    4.943984] igbvf 0000:04:10.0: PF still in reset state. Is the PF interface up?
[    4.943990] igbvf 0000:04:10.0: Assigning random MAC address.
[    4.945139] 0000:04:10.0: 0000:04:10.0: PF still resetting
[    4.945605] 0000:04:10.0: eth4: Intel(R) I350 Virtual Function
[    4.945610] 0000:04:10.0: eth4: Address: 6a:fe:b0:d1:6b:03
[    4.945635] igbvf 0000:04:10.4: enabling device (0000 -> 0002)
[    4.945645] igbvf 0000:04:10.4: setting latency timer to 64
[    4.945701] igbvf 0000:04:10.4: irq 111 for MSI/MSI-X
[    4.945710] igbvf 0000:04:10.4: irq 112 for MSI/MSI-X
[    4.946913] igbvf 0000:04:10.4: PF still in reset state. Is the PF interface up?
[    4.946918] igbvf 0000:04:10.4: Assigning random MAC address.
[    4.948068] 0000:04:10.4: 0000:04:10.4: PF still resetting
[    4.948481] 0000:04:10.4: eth5: Intel(R) I350 Virtual Function
[    4.948485] 0000:04:10.4: eth5: Address: 2e:8a:77:bd:5a:a7
[    4.948509] igbvf 0000:04:11.0: enabling device (0000 -> 0002)
[    4.948518] igbvf 0000:04:11.0: setting latency timer to 64
[    4.948572] igbvf 0000:04:11.0: irq 113 for MSI/MSI-X
[    4.948581] igbvf 0000:04:11.0: irq 114 for MSI/MSI-X
[    4.949734] igbvf 0000:04:11.0: PF still in reset state. Is the PF interface up?
[    4.949739] igbvf 0000:04:11.0: Assigning random MAC address.
[    4.950930] 0000:04:11.0: 0000:04:11.0: PF still resetting
[    4.951357] 0000:04:11.0: eth6: Intel(R) I350 Virtual Function
[    4.951362] 0000:04:11.0: eth6: Address: b2:48:0d:16:71:83
[    4.951386] igbvf 0000:04:11.4: enabling device (0000 -> 0002)
[    4.951395] igbvf 0000:04:11.4: setting latency timer to 64
[    4.951450] igbvf 0000:04:11.4: irq 115 for MSI/MSI-X
[    4.951460] igbvf 0000:04:11.4: irq 116 for MSI/MSI-X
[    4.952613] igbvf 0000:04:11.4: PF still in reset state. Is the PF interface up?
[    4.952618] igbvf 0000:04:11.4: Assigning random MAC address.
[    4.953769] 0000:04:11.4: 0000:04:11.4: PF still resetting
[    4.954217] 0000:04:11.4: eth7: Intel(R) I350 Virtual Function
[    4.954222] 0000:04:11.4: eth7: Address: ba:92:2d:d4:28:0f
[    4.954246] igbvf 0000:04:12.0: enabling device (0000 -> 0002)
[    4.954255] igbvf 0000:04:12.0: setting latency timer to 64
[    4.954308] igbvf 0000:04:12.0: irq 117 for MSI/MSI-X
[    4.954318] igbvf 0000:04:12.0: irq 118 for MSI/MSI-X
[    4.955487] igbvf 0000:04:12.0: PF still in reset state. Is the PF interface up?
[    4.955492] igbvf 0000:04:12.0: Assigning random MAC address.
[    4.956640] 0000:04:12.0: 0000:04:12.0: PF still resetting
[    4.957109] 0000:04:12.0: eth8: Intel(R) I350 Virtual Function
[    4.957113] 0000:04:12.0: eth8: Address: ca:91:83:8c:3b:82
[    4.957137] igbvf 0000:04:12.4: enabling device (0000 -> 0002)
[    4.957147] igbvf 0000:04:12.4: setting latency timer to 64
[    4.957198] igbvf 0000:04:12.4: irq 119 for MSI/MSI-X
[    4.957208] igbvf 0000:04:12.4: irq 120 for MSI/MSI-X
[    4.958361] igbvf 0000:04:12.4: PF still in reset state. Is the PF interface up?
[    4.958366] igbvf 0000:04:12.4: Assigning random MAC address.
[    4.959551] 0000:04:12.4: 0000:04:12.4: PF still resetting
[    4.960040] 0000:04:12.4: eth9: Intel(R) I350 Virtual Function
[    4.960045] 0000:04:12.4: eth9: Address: a2:50:57:b3:7c:15
[    4.960068] igbvf 0000:04:13.0: enabling device (0000 -> 0002)
[    4.960078] igbvf 0000:04:13.0: setting latency timer to 64
[    4.960132] igbvf 0000:04:13.0: irq 121 for MSI/MSI-X
[    4.960143] igbvf 0000:04:13.0: irq 122 for MSI/MSI-X
[    4.961296] igbvf 0000:04:13.0: PF still in reset state. Is the PF interface up?
[    4.961301] igbvf 0000:04:13.0: Assigning random MAC address.
[    4.962451] 0000:04:13.0: 0000:04:13.0: PF still resetting
[    4.962982] 0000:04:13.0: eth10: Intel(R) I350 Virtual Function
[    4.962987] 0000:04:13.0: eth10: Address: f6:8b:64:bc:f3:a0
[    5.046413] usb 2-1: new high-speed USB device number 2 using ehci_hcd
[    5.139062] igb 0000:81:00.0: Intel(R) Gigabit Ethernet Network Connection
[    5.139069] igb 0000:81:00.0: eth11: (PCIe:2.5GT/s:Width x4)
[    5.139072] igb 0000:81:00.0: eth11: MAC: 00:1b:21:c9:2e:38
[    5.139372] igb 0000:81:00.0: eth11: PBA No: G18758-002
[    5.139375] igb 0000:81:00.0: LRO is disabled
[    5.139378] igb 0000:81:00.0: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
[    5.139412] igb 0000:81:00.1: PCI INT B -> GSI 52 (level, low) -> IRQ 52
[    5.139425] igb 0000:81:00.1: setting latency timer to 64
[    5.139794] igb 0000:81:00.1: irq 123 for MSI/MSI-X
[    5.139804] igb 0000:81:00.1: irq 124 for MSI/MSI-X
[    5.334657] igb 0000:81:00.1: Intel(R) Gigabit Ethernet Network Connection
[    5.334664] igb 0000:81:00.1: eth12: (PCIe:2.5GT/s:Width x4)
[    5.334667] igb 0000:81:00.1: eth12: MAC: 00:1b:21:c9:2e:39
[    5.334968] igb 0000:81:00.1: eth12: PBA No: G18758-002
[    5.334971] igb 0000:81:00.1: LRO is disabled
[    5.334974] igb 0000:81:00.1: Using MSI-X interrupts. 1 rx queue(s), 1 tx queue(s)
[    9.889377] Compat-mlnx-ofed backport release: gcecc987
[    9.889380] Backport based on git://beany.openfabrics.org/compat-rdma/compat.git 3d70f8c
[    9.889381] compat.git: git://beany.openfabrics.org/compat-rdma/compat.git
[    9.901680] mlx4_core: Mellanox ConnectX core driver v1.1 (Jun  9 2013)
[    9.901685] mlx4_core: Initializing 0000:06:00.0
[    9.901743] mlx4_core 0000:06:00.0: PCI INT A -> GSI 40 (level, low) -> IRQ 40
[    9.901780] mlx4_core 0000:06:00.0: setting latency timer to 64
[    9.901849] mlx4_core 0000:06:00.0: Enabling SR-IOV with 8 VFs
[   10.004723] pci 0000:06:00.1: [15b3:1004] type 0 class 0x000280
[   10.005692] pci 0000:06:00.2: [15b3:1004] type 0 class 0x000280
[   10.006634] pci 0000:06:00.3: [15b3:1004] type 0 class 0x000280
[   10.007583] pci 0000:06:00.4: [15b3:1004] type 0 class 0x000280
[   10.008537] pci 0000:06:00.5: [15b3:1004] type 0 class 0x000280
[   10.009488] pci 0000:06:00.6: [15b3:1004] type 0 class 0x000280
[   10.010397] pci 0000:06:00.7: [15b3:1004] type 0 class 0x000280
[   10.011342] pci 0000:06:01.0: [15b3:1004] type 0 class 0x000280
[   10.012174] mlx4_core 0000:06:00.0: Running in master mode
[   10.151699] igb 0000:04:00.0: DCA enabled
[   10.151719] igb 0000:04:00.1: DCA enabled
[   10.154420] igb 0000:81:00.0: DCA enabled
[   10.154437] igb 0000:81:00.1: DCA enabled
[   10.419793] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.479669] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.496162] udevd[1307]: renamed network interface eth3 to p2p2
[   10.539560] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.552121] udevd[1290]: renamed network interface eth5 to p2p1_1
[   10.599431] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.599968] udevd[1313]: renamed network interface eth2 to p2p1
[   10.643830] Loading iSCSI transport class v2.0-870.
[   10.659318] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.664024] udevd[1289]: renamed network interface eth4 to p2p1_0
[   10.719195] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.751638] udevd[1291]: renamed network interface eth6 to p2p1_2
[   10.779088] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update
[   10.838971] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.838971] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.898845] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   10.911351] udevd[1303]: renamed network interface eth0 to p1p1
[   10.958727] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   11.011440] udevd[1332]: renamed network interface eth11 to p5p1
[   11.018620] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   11.078511] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   11.138392] mlx4_core 0000:06:00.0: vpd r/w failed.  This is likely a firmware bug on this device.  Contact the card vendor for a firmware update.
[   15.049675] mlx4_core 0000:06:00.0: irq 150 for MSI/MSI-X
[   15.049688] mlx4_core 0000:06:00.0: irq 151 for MSI/MSI-X
[   15.049697] mlx4_core 0000:06:00.0: irq 152 for MSI/MSI-X
[   15.049707] mlx4_core 0000:06:00.0: irq 153 for MSI/MSI-X
[   15.067287] mlx4_core: Initializing 0000:82:00.0
[   15.067327] mlx4_core 0000:82:00.0: PCI INT A -> GSI 56 (level, low) -> IRQ 56
[   15.067360] mlx4_core 0000:82:00.0: setting latency timer to 64
[   15.067412] mlx4_core 0000:82:00.0: Enabling SR-IOV with 8 VFs
[   15.067414] mlx4_core 0000:82:00.0: Failed to enable SR-IOV, continuing without SR-IOV (err = -19).
[   17.310871] mlx4_core 0000:82:00.0: irq 154 for MSI/MSI-X
[   17.310881] mlx4_core 0000:82:00.0: irq 155 for MSI/MSI-X
[   17.310890] mlx4_core 0000:82:00.0: irq 156 for MSI/MSI-X
[   17.310898] mlx4_core 0000:82:00.0: irq 157 for MSI/MSI-X
[   17.310906] mlx4_core 0000:82:00.0: irq 158 for MSI/MSI-X
[   17.310915] mlx4_core 0000:82:00.0: irq 159 for MSI/MSI-X
[   17.310923] mlx4_core 0000:82:00.0: irq 160 for MSI/MSI-X
[   17.310931] mlx4_core 0000:82:00.0: irq 161 for MSI/MSI-X
[   17.310940] mlx4_core 0000:82:00.0: irq 162 for MSI/MSI-X
[   17.310948] mlx4_core 0000:82:00.0: irq 163 for MSI/MSI-X
[   17.310956] mlx4_core 0000:82:00.0: irq 164 for MSI/MSI-X
[   17.310964] mlx4_core 0000:82:00.0: irq 165 for MSI/MSI-X
[   17.310972] mlx4_core 0000:82:00.0: irq 166 for MSI/MSI-X
[   17.310980] mlx4_core 0000:82:00.0: irq 167 for MSI/MSI-X
[   17.310987] mlx4_core 0000:82:00.0: irq 168 for MSI/MSI-X
[   17.310998] mlx4_core 0000:82:00.0: irq 169 for MSI/MSI-X
[   17.311006] mlx4_core 0000:82:00.0: irq 170 for MSI/MSI-X
[   17.311014] mlx4_core 0000:82:00.0: irq 171 for MSI/MSI-X
[   17.311025] mlx4_core 0000:82:00.0: irq 172 for MSI/MSI-X
[   17.311036] mlx4_core 0000:82:00.0: irq 173 for MSI/MSI-X
[   17.311043] mlx4_core 0000:82:00.0: irq 174 for MSI/MSI-X
[   17.311052] mlx4_core 0000:82:00.0: irq 175 for MSI/MSI-X
[   17.311060] mlx4_core 0000:82:00.0: irq 176 for MSI/MSI-X
[   17.311068] mlx4_core 0000:82:00.0: irq 177 for MSI/MSI-X
[   17.311075] mlx4_core 0000:82:00.0: irq 178 for MSI/MSI-X
[   17.311083] mlx4_core 0000:82:00.0: irq 179 for MSI/MSI-X
[   17.311091] mlx4_core 0000:82:00.0: irq 180 for MSI/MSI-X
[   17.311099] mlx4_core 0000:82:00.0: irq 181 for MSI/MSI-X
[   17.311106] mlx4_core 0000:82:00.0: irq 182 for MSI/MSI-X
[   17.311114] mlx4_core 0000:82:00.0: irq 183 for MSI/MSI-X
[   17.311122] mlx4_core 0000:82:00.0: irq 184 for MSI/MSI-X
[   17.311130] mlx4_core 0000:82:00.0: irq 185 for MSI/MSI-X
[   17.311137] mlx4_core 0000:82:00.0: irq 186 for MSI/MSI-X
[   17.311145] mlx4_core 0000:82:00.0: irq 187 for MSI/MSI-X
[   17.311153] mlx4_core 0000:82:00.0: irq 188 for MSI/MSI-X
[   17.311163] mlx4_core 0000:82:00.0: irq 189 for MSI/MSI-X
[   17.311171] mlx4_core 0000:82:00.0: irq 190 for MSI/MSI-X
[   17.311179] mlx4_core 0000:82:00.0: irq 191 for MSI/MSI-X
[   17.501318] mlx4_core: Initializing 0000:06:00.1
[   17.501336] mlx4_core 0000:06:00.1: enabling device (0000 -> 0002)
[   17.501380] mlx4_core 0000:06:00.1: setting latency timer to 64
[   17.501406] mlx4_core 0000:06:00.1: Detected virtual function - running in slave mode
[   17.501481] mlx4_core 0000:06:00.1: Sending reset
[   17.501594] mlx4_core 0000:06:00.0: Received reset from slave:1
[   17.501609] mlx4_core 0000:06:00.1: Sending vhcr0
[   17.503101] mlx4_core 0000:06:00.1: HCA minimum page size:512
[   17.504639] mlx4_core 0000:06:00.1: irq 192 for MSI/MSI-X
[   17.504647] mlx4_core 0000:06:00.1: irq 193 for MSI/MSI-X
[   17.504655] mlx4_core 0000:06:00.1: irq 194 for MSI/MSI-X
[   17.504662] mlx4_core 0000:06:00.1: irq 195 for MSI/MSI-X
[   17.520010] mlx4_core: Initializing 0000:06:00.2
[   17.520025] mlx4_core 0000:06:00.2: enabling device (0000 -> 0002)
[   17.520069] mlx4_core 0000:06:00.2: setting latency timer to 64
[   17.520095] mlx4_core 0000:06:00.2: Detected virtual function - running in slave mode
[   17.520190] mlx4_core 0000:06:00.2: Sending reset
[   17.520258] mlx4_core 0000:06:00.0: Received reset from slave:2
[   17.520271] mlx4_core 0000:06:00.2: Sending vhcr0
[   17.521529] mlx4_core 0000:06:00.2: HCA minimum page size:512
[   17.522647] mlx4_core 0000:06:00.2: irq 196 for MSI/MSI-X
[   17.522655] mlx4_core 0000:06:00.2: irq 197 for MSI/MSI-X
[   17.522663] mlx4_core 0000:06:00.2: irq 198 for MSI/MSI-X
[   17.522670] mlx4_core 0000:06:00.2: irq 199 for MSI/MSI-X
[   17.536855] mlx4_core: Initializing 0000:06:00.3
[   17.536871] mlx4_core 0000:06:00.3: enabling device (0000 -> 0002)
[   17.536915] mlx4_core 0000:06:00.3: setting latency timer to 64
[   17.536940] mlx4_core 0000:06:00.3: Detected virtual function - running in slave mode
[   17.537026] mlx4_core 0000:06:00.3: Sending reset
[   17.537055] mlx4_core 0000:06:00.0: Received reset from slave:3
[   17.537069] mlx4_core 0000:06:00.3: Sending vhcr0
[   17.538012] mlx4_core 0000:06:00.3: HCA minimum page size:512
[   17.539139] mlx4_core 0000:06:00.3: irq 200 for MSI/MSI-X
[   17.539147] mlx4_core 0000:06:00.3: irq 201 for MSI/MSI-X
[   17.539154] mlx4_core 0000:06:00.3: irq 202 for MSI/MSI-X
[   17.539162] mlx4_core 0000:06:00.3: irq 203 for MSI/MSI-X
[   17.553427] mlx4_core: Initializing 0000:06:00.4
[   17.553443] mlx4_core 0000:06:00.4: enabling device (0000 -> 0002)
[   17.553487] mlx4_core 0000:06:00.4: setting latency timer to 64
[   17.553512] mlx4_core 0000:06:00.4: Detected virtual function - running in slave mode
[   17.553596] mlx4_core 0000:06:00.4: Sending reset
[   17.553623] mlx4_core 0000:06:00.0: Received reset from slave:4
[   17.553635] mlx4_core 0000:06:00.4: Sending vhcr0
[   17.554573] mlx4_core 0000:06:00.4: HCA minimum page size:512
[   17.555703] mlx4_core 0000:06:00.4: irq 204 for MSI/MSI-X
[   17.555713] mlx4_core 0000:06:00.4: irq 205 for MSI/MSI-X
[   17.555721] mlx4_core 0000:06:00.4: irq 206 for MSI/MSI-X
[   17.555729] mlx4_core 0000:06:00.4: irq 207 for MSI/MSI-X
[   17.569922] mlx4_core: Initializing 0000:06:00.5
[   17.569938] mlx4_core 0000:06:00.5: enabling device (0000 -> 0002)
[   17.569982] mlx4_core 0000:06:00.5: setting latency timer to 64
[   17.570007] mlx4_core 0000:06:00.5: Skipping virtual function:5
[   17.570038] mlx4_core: Initializing 0000:06:00.6
[   17.570051] mlx4_core 0000:06:00.6: enabling device (0000 -> 0002)
[   17.570092] mlx4_core 0000:06:00.6: setting latency timer to 64
[   17.570106] mlx4_core 0000:06:00.6: Skipping virtual function:6
[   17.570132] mlx4_core: Initializing 0000:06:00.7
[   17.570144] mlx4_core 0000:06:00.7: enabling device (0000 -> 0002)
[   17.570186] mlx4_core 0000:06:00.7: setting latency timer to 64
[   17.570199] mlx4_core 0000:06:00.7: Skipping virtual function:7
[   17.570225] mlx4_core: Initializing 0000:06:01.0
[   17.570237] mlx4_core 0000:06:01.0: enabling device (0000 -> 0002)
[   17.570278] mlx4_core 0000:06:01.0: setting latency timer to 64
[   17.570292] mlx4_core 0000:06:01.0: Skipping virtual function:8
[   17.865805] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v1.0 (Jun  9 2013)
[   17.927160] mlx4_core 0000:06:00.0: mlx4_ib: multi-function enabled
[   17.929985] mlx4_core 0000:06:00.0: mlx4_ib: initializing demux service for 80 qp1 clients
[   18.039497] mlx4_core 0000:06:00.1: mlx4_ib: multi-function enabled
[   18.039501] mlx4_core 0000:06:00.1: mlx4_ib: operating in qp1 tunnel mode
[   18.107424] mlx4_core 0000:06:00.2: mlx4_ib: multi-function enabled
[   18.107428] mlx4_core 0000:06:00.2: mlx4_ib: operating in qp1 tunnel mode
[   18.174450] mlx4_core 0000:06:00.3: mlx4_ib: multi-function enabled
[   18.174454] mlx4_core 0000:06:00.3: mlx4_ib: operating in qp1 tunnel mode
[   18.241353] mlx4_core 0000:06:00.4: mlx4_ib: multi-function enabled
[   18.241355] mlx4_core 0000:06:00.4: mlx4_ib: operating in qp1 tunnel mode
[  450.848108] mlx4_core 0000:06:00.0: Running in master mode
[  451.350373] mlx4_core 0000:06:00.0: FW version 2.11.500 (cmd intf rev 3), max commands 16
[  451.350380] mlx4_core 0000:06:00.0: Catastrophic error buffer at 0x1f020, size 0x10, BAR 0
[  451.350384] mlx4_core 0000:06:00.0: Communication vector bar:2 offset:0x800
[  451.350388] mlx4_core 0000:06:00.0: FW size 385 KB
[  451.350391] mlx4_core 0000:06:00.0: Internal clock bar:2 offset:0x800
[  451.350394] mlx4_core 0000:06:00.0: Clear int @ f0058, BAR 0
[  451.351701] mlx4_core 0000:06:00.0: Mapped 26 chunks/6168 KB for FW.
[  453.990632] mlx4_core 0000:06:00.0: BlueFlame available (reg size 512, regs/page 8)
[  453.990836] mlx4_core 0000:06:00.0: Base MM extensions: flags 00104cc0, rsvd L_Key 00008000
[  453.990838] mlx4_core 0000:06:00.0: Max ICM size 4294967296 MB
[  453.990840] mlx4_core 0000:06:00.0: Max QPs: 16777216, reserved QPs: 64, entry size: 256
[  453.990842] mlx4_core 0000:06:00.0: Max SRQs: 16777216, reserved SRQs: 64, entry size: 128
[  453.990844] mlx4_core 0000:06:00.0: Max CQs: 16777216, reserved CQs: 128, entry size: 128
[  453.990846] mlx4_core 0000:06:00.0: Max EQs: 32, reserved EQs: 28, entry size: 128
[  453.990848] mlx4_core 0000:06:00.0: reserved MPTs: 256, reserved MTTs: 32
[  453.990849] mlx4_core 0000:06:00.0: Max PDs: 131072, reserved PDs: 4, reserved UARs: 7
[  453.990851] mlx4_core 0000:06:00.0: Max QP/MCG: 131072, reserved MGMs: 0
[  453.990853] mlx4_core 0000:06:00.0: Max CQEs: 4194304, max WQEs: 16384, max SRQ WQEs: 16384
[  453.990855] mlx4_core 0000:06:00.0: Local CA ACK delay: 15, max MTU: 4096, port width cap: 2
[  453.990857] mlx4_core 0000:06:00.0: Max SQ desc size: 1008, max SQ S/G: 62
[  453.990858] mlx4_core 0000:06:00.0: Max RQ desc size: 512, max RQ S/G: 32
[  453.990860] mlx4_core 0000:06:00.0: Max GSO size: 131072
[  453.990861] mlx4_core 0000:06:00.0: Max basic counters: 255
[  453.990863] mlx4_core 0000:06:00.0: Max extended counters: 80
[  453.990864] mlx4_core 0000:06:00.0: Max RSS Table size: 256
[  453.990866] mlx4_core 0000:06:00.0: DEV_CAP flags:
[  453.990867] mlx4_core 0000:06:00.0:     RC transport
[  453.990868] mlx4_core 0000:06:00.0:     UC transport
[  453.990870] mlx4_core 0000:06:00.0:     UD transport
[  453.990871] mlx4_core 0000:06:00.0:     XRC transport
[  453.990872] mlx4_core 0000:06:00.0:     FCoIB support
[  453.990874] mlx4_core 0000:06:00.0:     SRQ support
[  453.990875] mlx4_core 0000:06:00.0:     IPoIB checksum offload
[  453.990876] mlx4_core 0000:06:00.0:     P_Key violation counter
[  453.990878] mlx4_core 0000:06:00.0:     Q_Key violation counter
[  453.990879] mlx4_core 0000:06:00.0:     DPDP
[  453.990881] mlx4_core 0000:06:00.0:     Big LSO headers
[  453.990882] mlx4_core 0000:06:00.0:     APM support
[  453.990883] mlx4_core 0000:06:00.0:     Atomic ops support
[  453.990885] mlx4_core 0000:06:00.0:     Address vector port checking support
[  453.990886] mlx4_core 0000:06:00.0:     UD multicast support
[  453.990888] mlx4_core 0000:06:00.0:     Router support
[  453.990889] mlx4_core 0000:06:00.0:     IBoE support
[  453.990891] mlx4_core 0000:06:00.0:     Unicast loopback support
[  453.990892] mlx4_core 0000:06:00.0:     FCS header control
[  453.990893] mlx4_core 0000:06:00.0:     UDP RSS support
[  453.990895] mlx4_core 0000:06:00.0:     Unicast VEP steering support
[  453.990896] mlx4_core 0000:06:00.0:     Multicast VEP steering support
[  453.990898] mlx4_core 0000:06:00.0:     Cross-channel (sync_qp) operations support
[  453.990899] mlx4_core 0000:06:00.0:     Counters support
[  453.990901] mlx4_core 0000:06:00.0:     Port management change event support
[  453.990903] mlx4_core 0000:06:00.0:     64 byte EQE support
[  453.990904] mlx4_core 0000:06:00.0:     64 byte CQE support
[  453.990905] mlx4_core 0000:06:00.0:     RSS support
[  453.990907] mlx4_core 0000:06:00.0:     RSS Toeplitz Hash Function support
[  453.990908] mlx4_core 0000:06:00.0:     RSS XOR Hash Function support
[  453.990910] mlx4_core 0000:06:00.0:     Device manage flow steering support
[  453.990912] mlx4_core 0000:06:00.0: Steering mode is: B0 steering, oper_log_mgm_entry_size = 10, log_num_mgm_entry_size = 10
[  453.990922] mlx4_core 0000:06:00.0:   profile[ 0] (  CMPT): 2^26 entries @ 0x         0, size 0x 100000000
[  453.990924] mlx4_core 0000:06:00.0:   profile[ 1] (RDMARC): 2^23 entries @ 0x 100000000, size 0x  10000000
[  453.990927] mlx4_core 0000:06:00.0:   profile[ 2] (   MTT): 2^25 entries @ 0x 110000000, size 0x  10000000
[  453.990929] mlx4_core 0000:06:00.0:   profile[ 3] (    QP): 2^19 entries @ 0x 120000000, size 0x   8000000
[  453.990931] mlx4_core 0000:06:00.0:   profile[ 4] (  ALTC): 2^19 entries @ 0x 128000000, size 0x   2000000
[  453.990933] mlx4_core 0000:06:00.0:   profile[ 5] (  DMPT): 2^19 entries @ 0x 12a000000, size 0x   2000000
[  453.990936] mlx4_core 0000:06:00.0:   profile[ 6] (   SRQ): 2^16 entries @ 0x 12c000000, size 0x    800000
[  453.990938] mlx4_core 0000:06:00.0:   profile[ 7] (    CQ): 2^16 entries @ 0x 12c800000, size 0x    800000
[  453.990940] mlx4_core 0000:06:00.0:   profile[ 8] (   MCG): 2^13 entries @ 0x 12d000000, size 0x    800000
[  453.990942] mlx4_core 0000:06:00.0:   profile[ 9] (  AUXC): 2^19 entries @ 0x 12d800000, size 0x     80000
[  453.990945] mlx4_core 0000:06:00.0:   profile[10] (    EQ): 2^10 entries @ 0x 12d880000, size 0x     20000
[  453.990947] mlx4_core 0000:06:00.0: HCA context memory: reserving 4940416 KB
[  453.990962] mlx4_core 0000:06:00.0: 4940416 KB of HCA context requires 9740 KB aux memory.
[  454.030152] mlx4_core 0000:06:00.0: Mapped 40 chunks/9740 KB for ICM aux.
[  454.031531] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 0 for ICM.
[  454.032886] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 40000000 for ICM.
[  454.034239] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 80000000 for ICM.
[  454.034590] mlx4_core 0000:06:00.0: Mapped 1 chunks/64 KB at c0000000 for ICM.
[  454.035268] mlx4_core 0000:06:00.0: Mapped 1 chunks/128 KB at 12d880000 for ICM.
[  454.036616] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 110000000 for ICM.
[  454.038002] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12a000000 for ICM.
[  454.039346] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 120000000 for ICM.
[  454.040688] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d800000 for ICM.
[  454.042030] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 128000000 for ICM.
[  454.043390] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 100000000 for ICM.
[  454.044731] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12c800000 for ICM.
[  454.046075] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12c000000 for ICM.
[  454.047424] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d000000 for ICM.
[  454.048764] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d040000 for ICM.
[  454.050108] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d080000 for ICM.
[  454.051449] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d0c0000 for ICM.
[  454.052790] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d100000 for ICM.
[  454.054135] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d140000 for ICM.
[  454.055474] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d180000 for ICM.
[  454.056816] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d1c0000 for ICM.
[  454.058164] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d200000 for ICM.
[  454.059508] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d240000 for ICM.
[  454.060849] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d280000 for ICM.
[  454.062193] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d2c0000 for ICM.
[  454.063532] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d300000 for ICM.
[  454.064872] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d340000 for ICM.
[  454.066216] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d380000 for ICM.
[  454.067559] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d3c0000 for ICM.
[  454.068906] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d400000 for ICM.
[  454.070249] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d440000 for ICM.
[  454.071591] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d480000 for ICM.
[  454.072934] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d4c0000 for ICM.
[  454.074279] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d500000 for ICM.
[  454.075623] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d540000 for ICM.
[  454.076964] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d580000 for ICM.
[  454.078304] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d5c0000 for ICM.
[  454.079653] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d600000 for ICM.
[  454.080994] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d640000 for ICM.
[  454.082336] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d680000 for ICM.
[  454.083679] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d6c0000 for ICM.
[  454.085020] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d700000 for ICM.
[  454.086361] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d740000 for ICM.
[  454.087702] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d780000 for ICM.
[  454.089042] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 12d7c0000 for ICM.
[  454.861083] mlx4_core 0000:06:00.0: Started init_resource_tracker: 80 slaves
[  454.861531] mlx4_core 0000:06:00.0: irq 150 for MSI/MSI-X
[  454.861540] mlx4_core 0000:06:00.0: irq 151 for MSI/MSI-X
[  454.861548] mlx4_core 0000:06:00.0: irq 152 for MSI/MSI-X
[  454.861555] mlx4_core 0000:06:00.0: irq 153 for MSI/MSI-X
[  454.874986] mlx4_core 0000:06:00.0: NOP command IRQ test passed
[  454.876249] mlx4_core: Initializing 0000:82:00.0
[  454.876297] mlx4_core 0000:82:00.0: PCI INT A -> GSI 56 (level, low) -> IRQ 56
[  454.876354] mlx4_core 0000:82:00.0: setting latency timer to 64
[  454.876433] mlx4_core 0000:82:00.0: Enabling SR-IOV with 8 VFs
[  454.876437] mlx4_core 0000:82:00.0: Failed to enable SR-IOV, continuing without SR-IOV (err = -19).
[  455.382271] mlx4_core 0000:82:00.0: FW version 2.9.1200 (cmd intf rev 3), max commands 16
[  455.382278] mlx4_core 0000:82:00.0: Catastrophic error buffer at 0x1f020, size 0x10, BAR 0
[  455.382282] mlx4_core 0000:82:00.0: Communication vector bar:2 offset:0x800
[  455.382286] mlx4_core 0000:82:00.0: FW size 385 KB
[  455.382289] mlx4_core 0000:82:00.0: Internal clock bar:2 offset:0x800
[  455.382292] mlx4_core 0000:82:00.0: Clear int @ f0058, BAR 0
[  455.384237] mlx4_core 0000:82:00.0: Mapped 26 chunks/6168 KB for FW.
[  456.206081] mlx4_core 0000:82:00.0: BlueFlame available (reg size 512, regs/page 8)
[  456.206243] mlx4_core 0000:82:00.0: Base MM extensions: flags 00000cc0, rsvd L_Key 00000500
[  456.206245] mlx4_core 0000:82:00.0: Max ICM size 4294967296 MB
[  456.206247] mlx4_core 0000:82:00.0: Max QPs: 16777216, reserved QPs: 64, entry size: 256
[  456.206248] mlx4_core 0000:82:00.0: Max SRQs: 16777216, reserved SRQs: 64, entry size: 128
[  456.206250] mlx4_core 0000:82:00.0: Max CQs: 16777216, reserved CQs: 128, entry size: 128
[  456.206252] mlx4_core 0000:82:00.0: Max EQs: 512, reserved EQs: 8, entry size: 128
[  456.206254] mlx4_core 0000:82:00.0: reserved MPTs: 16, reserved MTTs: 16
[  456.206256] mlx4_core 0000:82:00.0: Max PDs: 8388608, reserved PDs: 4, reserved UARs: 2
[  456.206258] mlx4_core 0000:82:00.0: Max QP/MCG: 8388608, reserved MGMs: 0
[  456.206259] mlx4_core 0000:82:00.0: Max CQEs: 4194304, max WQEs: 16384, max SRQ WQEs: 16384
[  456.206261] mlx4_core 0000:82:00.0: Local CA ACK delay: 15, max MTU: 4096, port width cap: 3
[  456.206263] mlx4_core 0000:82:00.0: Max SQ desc size: 1008, max SQ S/G: 62
[  456.206265] mlx4_core 0000:82:00.0: Max RQ desc size: 512, max RQ S/G: 32
[  456.206266] mlx4_core 0000:82:00.0: Max GSO size: 131072
[  456.206268] mlx4_core 0000:82:00.0: Max basic counters: 255
[  456.206269] mlx4_core 0000:82:00.0: Max extended counters: 80
[  456.206271] mlx4_core 0000:82:00.0: Max RSS Table size: 256
[  456.206272] mlx4_core 0000:82:00.0: DEV_CAP flags:
[  456.206274] mlx4_core 0000:82:00.0:     RC transport
[  456.206275] mlx4_core 0000:82:00.0:     UC transport
[  456.206276] mlx4_core 0000:82:00.0:     UD transport
[  456.206278] mlx4_core 0000:82:00.0:     XRC transport
[  456.206279] mlx4_core 0000:82:00.0:     FCoIB support
[  456.206280] mlx4_core 0000:82:00.0:     SRQ support
[  456.206282] mlx4_core 0000:82:00.0:     IPoIB checksum offload
[  456.206283] mlx4_core 0000:82:00.0:     P_Key violation counter
[  456.206284] mlx4_core 0000:82:00.0:     Q_Key violation counter
[  456.206286] mlx4_core 0000:82:00.0:     DPDP
[  456.206287] mlx4_core 0000:82:00.0:     Big LSO headers
[  456.206289] mlx4_core 0000:82:00.0:     APM support
[  456.206290] mlx4_core 0000:82:00.0:     Atomic ops support
[  456.206291] mlx4_core 0000:82:00.0:     Address vector port checking support
[  456.206293] mlx4_core 0000:82:00.0:     UD multicast support
[  456.206294] mlx4_core 0000:82:00.0:     Router support
[  456.206296] mlx4_core 0000:82:00.0:     IBoE support
[  456.206297] mlx4_core 0000:82:00.0:     Unicast loopback support
[  456.206299] mlx4_core 0000:82:00.0:     UDP RSS support
[  456.206300] mlx4_core 0000:82:00.0:     Unicast VEP steering support
[  456.206302] mlx4_core 0000:82:00.0:     Multicast VEP steering support
[  456.206303] mlx4_core 0000:82:00.0:     Cross-channel (sync_qp) operations support
[  456.206305] mlx4_core 0000:82:00.0:     Counters support
[  456.206306] mlx4_core 0000:82:00.0:     RSS support
[  456.206308] mlx4_core 0000:82:00.0:     RSS Toeplitz Hash Function support
[  456.206309] mlx4_core 0000:82:00.0:     RSS XOR Hash Function support
[  456.206313] mlx4_core 0000:82:00.0: Steering mode is: B0 steering, oper_log_mgm_entry_size = 10, log_num_mgm_entry_size = 10
[  456.206317] mlx4_core 0000:82:00.0:   profile[ 0] (  CMPT): 2^26 entries @ 0x         0, size 0x 100000000
[  456.206320] mlx4_core 0000:82:00.0:   profile[ 1] (RDMARC): 2^23 entries @ 0x 100000000, size 0x  10000000
[  456.206322] mlx4_core 0000:82:00.0:   profile[ 2] (   MTT): 2^25 entries @ 0x 110000000, size 0x  10000000
[  456.206324] mlx4_core 0000:82:00.0:   profile[ 3] (    QP): 2^19 entries @ 0x 120000000, size 0x   8000000
[  456.206327] mlx4_core 0000:82:00.0:   profile[ 4] (  ALTC): 2^19 entries @ 0x 128000000, size 0x   2000000
[  456.206329] mlx4_core 0000:82:00.0:   profile[ 5] (  DMPT): 2^19 entries @ 0x 12a000000, size 0x   2000000
[  456.206331] mlx4_core 0000:82:00.0:   profile[ 6] (   SRQ): 2^16 entries @ 0x 12c000000, size 0x    800000
[  456.206333] mlx4_core 0000:82:00.0:   profile[ 7] (    CQ): 2^16 entries @ 0x 12c800000, size 0x    800000
[  456.206335] mlx4_core 0000:82:00.0:   profile[ 8] (   MCG): 2^13 entries @ 0x 12d000000, size 0x    800000
[  456.206338] mlx4_core 0000:82:00.0:   profile[ 9] (  AUXC): 2^19 entries @ 0x 12d800000, size 0x     80000
[  456.206340] mlx4_core 0000:82:00.0:   profile[10] (    EQ): 2^06 entries @ 0x 12d880000, size 0x      2000
[  456.206342] mlx4_core 0000:82:00.0: HCA context memory: reserving 4940296 KB
[  456.206360] mlx4_core 0000:82:00.0: 4940296 KB of HCA context requires 9740 KB aux memory.
[  456.237926] mlx4_core 0000:82:00.0: Mapped 40 chunks/9740 KB for ICM aux.
[  456.239267] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 0 for ICM.
[  456.240575] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 40000000 for ICM.
[  456.241882] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 80000000 for ICM.
[  456.241919] mlx4_core 0000:82:00.0: Mapped 1 chunks/4 KB at c0000000 for ICM.
[  456.241975] mlx4_core 0000:82:00.0: Mapped 1 chunks/8 KB at 12d880000 for ICM.
[  456.243275] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 110000000 for ICM.
[  456.244605] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12a000000 for ICM.
[  456.245891] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 120000000 for ICM.
[  456.247176] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d800000 for ICM.
[  456.248462] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 128000000 for ICM.
[  456.249750] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 100000000 for ICM.
[  456.251036] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12c800000 for ICM.
[  456.252322] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12c000000 for ICM.
[  456.253619] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d000000 for ICM.
[  456.254904] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d040000 for ICM.
[  456.256189] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d080000 for ICM.
[  456.257477] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d0c0000 for ICM.
[  456.258764] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d100000 for ICM.
[  456.260048] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d140000 for ICM.
[  456.261333] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d180000 for ICM.
[  456.262621] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d1c0000 for ICM.
[  456.263917] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d200000 for ICM.
[  456.265201] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d240000 for ICM.
[  456.266484] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d280000 for ICM.
[  456.267769] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d2c0000 for ICM.
[  456.269053] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d300000 for ICM.
[  456.270339] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d340000 for ICM.
[  456.271624] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d380000 for ICM.
[  456.272909] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d3c0000 for ICM.
[  456.274206] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d400000 for ICM.
[  456.275492] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d440000 for ICM.
[  456.276774] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d480000 for ICM.
[  456.278060] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d4c0000 for ICM.
[  456.279345] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d500000 for ICM.
[  456.280629] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d540000 for ICM.
[  456.281915] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d580000 for ICM.
[  456.283201] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d5c0000 for ICM.
[  456.284502] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d600000 for ICM.
[  456.285787] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d640000 for ICM.
[  456.287072] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d680000 for ICM.
[  456.288355] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d6c0000 for ICM.
[  456.289641] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d700000 for ICM.
[  456.290928] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d740000 for ICM.
[  456.292212] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d780000 for ICM.
[  456.293497] mlx4_core 0000:82:00.0: Mapped 1 chunks/256 KB at 12d7c0000 for ICM.
[  457.128057] mlx4_core 0000:82:00.0: irq 154 for MSI/MSI-X
[  457.128066] mlx4_core 0000:82:00.0: irq 155 for MSI/MSI-X
[  457.128074] mlx4_core 0000:82:00.0: irq 156 for MSI/MSI-X
[  457.128082] mlx4_core 0000:82:00.0: irq 157 for MSI/MSI-X
[  457.128090] mlx4_core 0000:82:00.0: irq 158 for MSI/MSI-X
[  457.128098] mlx4_core 0000:82:00.0: irq 159 for MSI/MSI-X
[  457.128106] mlx4_core 0000:82:00.0: irq 160 for MSI/MSI-X
[  457.128114] mlx4_core 0000:82:00.0: irq 161 for MSI/MSI-X
[  457.128122] mlx4_core 0000:82:00.0: irq 162 for MSI/MSI-X
[  457.128130] mlx4_core 0000:82:00.0: irq 163 for MSI/MSI-X
[  457.128138] mlx4_core 0000:82:00.0: irq 164 for MSI/MSI-X
[  457.128146] mlx4_core 0000:82:00.0: irq 165 for MSI/MSI-X
[  457.128154] mlx4_core 0000:82:00.0: irq 166 for MSI/MSI-X
[  457.128162] mlx4_core 0000:82:00.0: irq 167 for MSI/MSI-X
[  457.128170] mlx4_core 0000:82:00.0: irq 168 for MSI/MSI-X
[  457.128180] mlx4_core 0000:82:00.0: irq 169 for MSI/MSI-X
[  457.128188] mlx4_core 0000:82:00.0: irq 170 for MSI/MSI-X
[  457.128195] mlx4_core 0000:82:00.0: irq 171 for MSI/MSI-X
[  457.128204] mlx4_core 0000:82:00.0: irq 172 for MSI/MSI-X
[  457.128214] mlx4_core 0000:82:00.0: irq 173 for MSI/MSI-X
[  457.128221] mlx4_core 0000:82:00.0: irq 174 for MSI/MSI-X
[  457.128229] mlx4_core 0000:82:00.0: irq 175 for MSI/MSI-X
[  457.128237] mlx4_core 0000:82:00.0: irq 176 for MSI/MSI-X
[  457.128245] mlx4_core 0000:82:00.0: irq 177 for MSI/MSI-X
[  457.128252] mlx4_core 0000:82:00.0: irq 178 for MSI/MSI-X
[  457.128260] mlx4_core 0000:82:00.0: irq 179 for MSI/MSI-X
[  457.128268] mlx4_core 0000:82:00.0: irq 180 for MSI/MSI-X
[  457.128276] mlx4_core 0000:82:00.0: irq 181 for MSI/MSI-X
[  457.128284] mlx4_core 0000:82:00.0: irq 182 for MSI/MSI-X
[  457.128291] mlx4_core 0000:82:00.0: irq 183 for MSI/MSI-X
[  457.128299] mlx4_core 0000:82:00.0: irq 184 for MSI/MSI-X
[  457.128308] mlx4_core 0000:82:00.0: irq 185 for MSI/MSI-X
[  457.128316] mlx4_core 0000:82:00.0: irq 186 for MSI/MSI-X
[  457.128324] mlx4_core 0000:82:00.0: irq 187 for MSI/MSI-X
[  457.128334] mlx4_core 0000:82:00.0: irq 188 for MSI/MSI-X
[  457.128342] mlx4_core 0000:82:00.0: irq 189 for MSI/MSI-X
[  457.128350] mlx4_core 0000:82:00.0: irq 190 for MSI/MSI-X
[  457.128358] mlx4_core 0000:82:00.0: irq 191 for MSI/MSI-X
[  457.318437] mlx4_core 0000:82:00.0: NOP command IRQ test passed
[  457.319341] mlx4_core: Initializing 0000:06:00.1
[  457.319360] mlx4_core 0000:06:00.1: enabling device (0000 -> 0002)
[  457.319400] mlx4_core 0000:06:00.1: setting latency timer to 64
[  457.319435] mlx4_core 0000:06:00.1: Detected virtual function - running in slave mode
[  457.319562] mlx4_core 0000:06:00.1: Sending reset
[  457.319652] mlx4_core 0000:06:00.0: Received reset from slave:1
[  457.319669] mlx4_core 0000:06:00.1: Sending vhcr0
[  457.320232] mlx4_core 0000:06:00.1: BlueFlame not available
[  457.320528] mlx4_core 0000:06:00.1: Base MM extensions: flags 00104cc0, rsvd L_Key 00008000
[  457.320535] mlx4_core 0000:06:00.1: Max ICM size 4294967296 MB
[  457.320539] mlx4_core 0000:06:00.1: Max QPs: 16777216, reserved QPs: 64, entry size: 256
[  457.320543] mlx4_core 0000:06:00.1: Max SRQs: 16777216, reserved SRQs: 64, entry size: 128
[  457.320547] mlx4_core 0000:06:00.1: Max CQs: 16777216, reserved CQs: 128, entry size: 128
[  457.320551] mlx4_core 0000:06:00.1: Max EQs: 32, reserved EQs: 28, entry size: 128
[  457.320555] mlx4_core 0000:06:00.1: reserved MPTs: 256, reserved MTTs: 32
[  457.320558] mlx4_core 0000:06:00.1: Max PDs: 131072, reserved PDs: 4, reserved UARs: 7
[  457.320562] mlx4_core 0000:06:00.1: Max QP/MCG: 131072, reserved MGMs: 0
[  457.320566] mlx4_core 0000:06:00.1: Max CQEs: 4194304, max WQEs: 16384, max SRQ WQEs: 16384
[  457.320570] mlx4_core 0000:06:00.1: Local CA ACK delay: 15, max MTU: 4096, port width cap: 2
[  457.320574] mlx4_core 0000:06:00.1: Max SQ desc size: 1008, max SQ S/G: 62
[  457.320577] mlx4_core 0000:06:00.1: Max RQ desc size: 512, max RQ S/G: 32
[  457.320580] mlx4_core 0000:06:00.1: Max GSO size: 131072
[  457.320583] mlx4_core 0000:06:00.1: Max basic counters: 255
[  457.320586] mlx4_core 0000:06:00.1: Max extended counters: 80
[  457.320589] mlx4_core 0000:06:00.1: Max RSS Table size: 256
[  457.320592] mlx4_core 0000:06:00.1: DEV_CAP flags:
[  457.320595] mlx4_core 0000:06:00.1:     RC transport
[  457.320598] mlx4_core 0000:06:00.1:     UC transport
[  457.320601] mlx4_core 0000:06:00.1:     UD transport
[  457.320603] mlx4_core 0000:06:00.1:     XRC transport
[  457.320606] mlx4_core 0000:06:00.1:     FCoIB support
[  457.320609] mlx4_core 0000:06:00.1:     SRQ support
[  457.320612] mlx4_core 0000:06:00.1:     IPoIB checksum offload
[  457.320615] mlx4_core 0000:06:00.1:     P_Key violation counter
[  457.320618] mlx4_core 0000:06:00.1:     Q_Key violation counter
[  457.320621] mlx4_core 0000:06:00.1:     DPDP
[  457.320624] mlx4_core 0000:06:00.1:     Big LSO headers
[  457.320626] mlx4_core 0000:06:00.1:     APM support
[  457.320629] mlx4_core 0000:06:00.1:     Atomic ops support
[  457.320632] mlx4_core 0000:06:00.1:     Address vector port checking support
[  457.320635] mlx4_core 0000:06:00.1:     UD multicast support
[  457.320638] mlx4_core 0000:06:00.1:     Router support
[  457.320641] mlx4_core 0000:06:00.1:     IBoE support
[  457.320644] mlx4_core 0000:06:00.1:     Unicast loopback support
[  457.320647] mlx4_core 0000:06:00.1:     FCS header control
[  457.320650] mlx4_core 0000:06:00.1:     UDP RSS support
[  457.320653] mlx4_core 0000:06:00.1:     Unicast VEP steering support
[  457.320656] mlx4_core 0000:06:00.1:     Multicast VEP steering support
[  457.320659] mlx4_core 0000:06:00.1:     Cross-channel (sync_qp) operations support
[  457.320663] mlx4_core 0000:06:00.1:     Counters support
[  457.320666] mlx4_core 0000:06:00.1:     Port management change event support
[  457.320669] mlx4_core 0000:06:00.1:     64 byte EQE support
[  457.320672] mlx4_core 0000:06:00.1:     64 byte CQE support
[  457.320675] mlx4_core 0000:06:00.1:     RSS support
[  457.320678] mlx4_core 0000:06:00.1:     RSS Toeplitz Hash Function support
[  457.320681] mlx4_core 0000:06:00.1:     RSS XOR Hash Function support
[  457.320869] mlx4_core 0000:06:00.1: HCA minimum page size:512
[  457.321452] mlx4_core 0000:06:00.1: Steering mode is: B0 steering
[  457.321459] mlx4_core 0000:06:00.1: Failed to map blue flame area
[  457.322042] mlx4_core 0000:06:00.1: irq 192 for MSI/MSI-X
[  457.322059] mlx4_core 0000:06:00.1: irq 193 for MSI/MSI-X
[  457.322073] mlx4_core 0000:06:00.1: irq 194 for MSI/MSI-X
[  457.322088] mlx4_core 0000:06:00.1: irq 195 for MSI/MSI-X
[  457.337531] mlx4_core 0000:06:00.1: NOP command IRQ test passed
[72021.926317] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v1.0 (Jun  9 2013)
[72022.008716] mlx4_core 0000:06:00.0: Registering MAC: 0x2c9xxxxxx for port 2
[72022.008723] mlx4_core 0000:06:00.0: Free MAC index is 1
[72022.011844] mlx4_core 0000:06:00.0: mlx4_ib: multi-function enabled
[72022.016570] mlx4_core 0000:06:00.0: mlx4_ib: initializing demux service for 80 qp1 clients
[72022.021298] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 100040000 for ICM.
[72022.029873] mlx4_core 0000:06:00.0: Registering MAC: 0x2c9xxxxxx for port 2
[72022.038230] mlx4_core 0000:06:00.0: Registering MAC: 0x2c9xxxxxx for port 2
[72023.432845] mlx4_core 0000:82:00.0: mlx4_ib: Port 1 logical link is up
[72027.204519] ------------[ cut here ]------------
[72027.204534] WARNING: at /build/buildd/linux-3.2.0/kernel/timer.c:1013 del_timer_sync+0x56/0x60()
[72027.204538] Hardware name: X9DR3-F
[72027.204540] Modules linked in: mlx4_ib(O) kvm_intel kvm pci_stub mlx4_core(O) brcompat(O) openvswitch(O) ip6table_filter ip6_tables iptable_filter ip_tables x_tables ib_uverbs(O) ib_umad(O) vesafb ib_iser(O) rdma_cm(O) ib_cm(O) iw_cm(O) ib_sa(O) ib_mad(O) ib_core(O) ib_addr(O) iscsi_tcp libiscsi_tcp bnx2i libiscsi scsi_transport_iscsi joydev sb_edac edac_core cnic uio mei(C) mac_hid ioatdma ipmi_watchdog compat(O) ipmi_si ipmi_devintf ipmi_msghandler lp parport ext2 zfs(P) zcommon(P) znvpair(P) zavl(P) zunicode(P) spl(O) usb_storage usbhid hid igbvf(O) isci libsas scsi_transport_sas btrfs igb(O) bnx2 dca i2c_algo_bit zlib_deflate libcrc32c [last unloaded: mlx4_core]
[72027.204625] Pid: 0, comm: swapper/0 Tainted: P        WC O 3.2.0-45-generic #70-Ubuntu
[72027.204629] Call Trace:
[72027.204631]  <IRQ>  [<ffffffff81067f3f>] warn_slowpath_common+0x7f/0xc0
[72027.204647]  [<ffffffff81067f9a>] warn_slowpath_null+0x1a/0x20
[72027.204653]  [<ffffffff81078c76>] del_timer_sync+0x56/0x60
[72027.204665]  [<ffffffffa061152b>] mlx4_ib_invalidate_all_guid_record+0xdb/0x110 [mlx4_ib]
[72027.204674]  [<ffffffffa06000ff>] mlx4_ib_event+0x1ef/0x210 [mlx4_ib]
[72027.204683]  [<ffffffff8104d318>] ? __wake_up_common+0x58/0x90
[72027.204690]  [<ffffffff8103ec59>] ? default_spin_lock_flags+0x9/0x10
[72027.204704]  [<ffffffffa03d0e5c>] mlx4_dispatch_event+0x6c/0x90 [mlx4_core]
[72027.204716]  [<ffffffffa03cb0e4>] mlx4_eq_int+0x2e4/0xa40 [mlx4_core]
[72027.204724]  [<ffffffff8108f409>] ? enqueue_hrtimer+0x39/0xc0
[72027.204735]  [<ffffffffa03cb854>] mlx4_msi_x_interrupt+0x14/0x20 [mlx4_core]
[72027.204742]  [<ffffffff810da145>] handle_irq_event_percpu+0x55/0x210
[72027.204748]  [<ffffffff810da351>] handle_irq_event+0x51/0x80
[72027.204754]  [<ffffffff810dd4f7>] handle_edge_irq+0x87/0x140
[72027.204762]  [<ffffffff81016272>] handle_irq+0x22/0x40
[72027.204770]  [<ffffffff8166a7ea>] do_IRQ+0x5a/0xe0
[72027.204777]  [<ffffffff8165fb2e>] common_interrupt+0x6e/0x6e
[72027.204780]  <EOI>  [<ffffffff8109d124>] ? tick_program_event+0x24/0x30
[72027.204792]  [<ffffffff81057190>] ? finish_task_switch+0x50/0xf0
[72027.204798]  [<ffffffff8105718a>] ? finish_task_switch+0x4a/0xf0
[72027.204804]  [<ffffffff8165d11c>] __schedule+0x3cc/0x6f0
[72027.204810]  [<ffffffff8165d76f>] schedule+0x3f/0x60
[72027.204816]  [<ffffffff81013268>] cpu_idle+0x108/0x120
[72027.204824]  [<ffffffff81625f0e>] rest_init+0x72/0x74
[72027.204832]  [<ffffffff81cfcc06>] start_kernel+0x3b5/0x3c2
[72027.204838]  [<ffffffff81cfc388>] x86_64_start_reservations+0x132/0x136
[72027.204844]  [<ffffffff81cfc140>] ? early_idt_handlers+0x140/0x140
[72027.204850]  [<ffffffff81cfc459>] x86_64_start_kernel+0xcd/0xdc
[72027.204854] ---[ end trace dc851a18b547e5a4 ]---
[72027.204861] mlx4_core 0000:06:00.0: mlx4_ib: Port 1 logical link is up
[72056.545942] mlx4_core 0000:06:00.0: slave 1 is trying to execute a Subnet MGMT MAD, class 0x1, method 0x81 for attr 0x11. Rejecting
[72056.621857] mlx4_core 0000:06:00.0: vhcr command MAD_IFC (0x24) slave:1 in_param 0x116f58000 in_mod=0xffff0001, op_mod=0xc failed with error:0, status -1
[72100.737531] mlx4_core 0000:06:00.0: FLR event for slave: 1
[72100.737550] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[72100.737554] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 1
[72100.840246] pci-stub 0000:06:00.1: restoring config space at offset 0x1 (was 0x100000, writing 0x100004)
[72102.886883] mlx4_core 0000:06:00.0: FLR event for slave: 1
[72102.886893] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[72102.886901] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 1
[72115.027808] pci-stub 0000:04:10.0: irq 112 for MSI/MSI-X
[72115.027825] pci-stub 0000:04:10.0: irq 113 for MSI/MSI-X
[72115.027839] pci-stub 0000:04:10.0: irq 114 for MSI/MSI-X
[72115.254328] pci-stub 0000:04:10.0: irq 112 for MSI/MSI-X
[72115.254345] pci-stub 0000:04:10.0: irq 113 for MSI/MSI-X
[72115.254359] pci-stub 0000:04:10.0: irq 114 for MSI/MSI-X
[72117.378203] mlx4_core 0000:06:00.0: Received reset from slave:1
[72117.378610] mlx4_core 0000:06:00.0: Have more references for index 1,no need to modify mac table
[72117.465377] mlx4_core 0000:06:00.0: Registering MAC: 0x2c9xxxxxx for port 2
[72117.654305] pci-stub 0000:06:00.1: irq 115 for MSI/MSI-X
[72117.654329] pci-stub 0000:06:00.1: irq 116 for MSI/MSI-X
[72117.654343] pci-stub 0000:06:00.1: irq 117 for MSI/MSI-X
[72117.654359] pci-stub 0000:06:00.1: irq 118 for MSI/MSI-X
[72117.909508] pci-stub 0000:06:00.1: irq 115 for MSI/MSI-X
[72117.909526] pci-stub 0000:06:00.1: irq 116 for MSI/MSI-X
[72117.909540] pci-stub 0000:06:00.1: irq 117 for MSI/MSI-X
[72117.909554] pci-stub 0000:06:00.1: irq 118 for MSI/MSI-X
[72118.339272] mlx4_core 0000:06:00.0: Registering MAC: 0x2c9xxxxxx for port 2
[72118.339284] mlx4_core 0000:06:00.0: Free MAC index is 0
[72118.356431] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 120040000 for ICM.
[72118.357709] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 1000c0000 for ICM.
[72118.390673] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 120080000 for ICM.
[72118.391997] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 100100000 for ICM.
[72119.477210] mlx4_core 0000:06:00.0: Mapped 1 chunks/256 KB at 100080000 for ICM.
[72237.141854] mlx4_core 0000:06:00.0: slave 1 is trying to execute a Subnet MGMT MAD, class 0x1, method 0x81 for attr 0x11. Rejecting
[72237.243695] mlx4_core 0000:06:00.0: vhcr command MAD_IFC (0x24) slave:1 in_param 0x117ee4000 in_mod=0xffff0001, op_mod=0xc failed with error:0, status -1
[72386.597929] pci-stub 0000:04:10.4: restoring config space at offset 0x1 (was 0x100000, writing 0x100004)
[72386.609050] mlx4_core 0000:06:00.0: FLR event for slave: 2
[72386.609068] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[72386.609075] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[72387.371047] mlx4_core 0000:06:00.0: FLR event for slave: 2
[72387.371055] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[72387.371059] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[72398.637685] pci-stub 0000:04:10.4: irq 107 for MSI/MSI-X
[72398.637706] pci-stub 0000:04:10.4: irq 108 for MSI/MSI-X
[72398.637720] pci-stub 0000:04:10.4: irq 111 for MSI/MSI-X
[73566.178472] pci-stub 0000:04:10.4: restoring config space at offset 0x1 (was 0x100000, writing 0x100004)
[73566.190621] mlx4_core 0000:06:00.0: FLR event for slave: 2
[73566.190634] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[73566.190638] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[73566.903788] mlx4_core 0000:06:00.0: FLR event for slave: 2
[73566.903798] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[73566.903802] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[73577.623503] pci-stub 0000:04:10.4: irq 107 for MSI/MSI-X
[73577.623525] pci-stub 0000:04:10.4: irq 108 for MSI/MSI-X
[73577.623540] pci-stub 0000:04:10.4: irq 111 for MSI/MSI-X
[73613.534599] device vnet0 left promiscuous mode
[73613.916094] mlx4_core 0000:06:00.0: FLR event for slave: 2
[73613.916113] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[73613.916118] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[73614.122865] pci-stub 0000:04:10.4: restoring config space at offset 0x1 (was 0x100000, writing 0x100004)
[73614.122920] pci-stub 0000:04:10.4: restoring config space at offset 0x1 (was 0x100004, writing 0x100000)
[73638.891584] device vnet0 entered promiscuous mode
[73642.277904] pci-stub 0000:04:10.4: enabling device (0000 -> 0002)
[73643.004158] assign device 0:4:10.4
[73643.008593] pci-stub 0000:06:00.2: enabling device (0000 -> 0002)
[73643.011029] mlx4_core 0000:06:00.0: FLR event for slave: 2
[73643.011051] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[73643.011064] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[73643.114362] assign device 0:6:0.2
[73643.224166] mlx4_core 0000:06:00.0: FLR event for slave: 2
[73643.224175] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr
[73643.224180] mlx4_core 0000:06:00.0: mlx4_handle_slave_flr: clean slave: 2
[73649.637860] vnet0: no IPv6 routers present
[73655.297282] pci-stub 0000:04:10.4: irq 107 for MSI/MSI-X
[73655.297302] pci-stub 0000:04:10.4: irq 108 for MSI/MSI-X
[73655.297316] pci-stub 0000:04:10.4: irq 111 for MSI/MSI-X

ゲスト上ログ

Ubuntu 12.04.2LTS + MLNX_OFED_LINUX 2.0.5

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.2.0-45-generic (buildd@panlong) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #70-Ubuntu SMP Wed May 29 20:12:06 UTC 2013 (Ubuntu 3.2.0-45.70-generic 3.2.44)
[    0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.2.0-45-generic root=/dev/mapper/ubuntu01-root ro
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
[    0.000000]  BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000dfffe000 (usable)
[    0.000000]  BIOS-e820: 00000000dfffe000 - 00000000e0000000 (reserved)
[    0.000000]  BIOS-e820: 00000000feffc000 - 00000000ff000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
[    0.000000]  BIOS-e820: 0000000100000000 - 0000000120000000 (usable)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] DMI: Bochs Bochs, BIOS Bochs 01/01/2011
[    0.000000] e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
[    0.000000] e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
[    0.000000] No AGP bridge found
[    0.000000] last_pfn = 0x120000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: write-back
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00E0000000 mask FFE0000000 uncachable
[    0.000000]   1 disabled
[    0.000000]   2 disabled
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] PAT not supported by CPU.
[    0.000000] last_pfn = 0xdfffe max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [ffff8800000fdab0] fdab0
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] Base memory trampoline at [ffff88000009a000] 9a000 size 20480
[    0.000000] init_memory_mapping: 0000000000000000-00000000dfffe000
[    0.000000]  0000000000 - 00dfe00000 page 2M
[    0.000000]  00dfe00000 - 00dfffe000 page 4k
[    0.000000] kernel direct mapping tables up to dfffe000 @ 1fffa000-20000000
[    0.000000] init_memory_mapping: 0000000100000000-0000000120000000
[    0.000000]  0100000000 - 0120000000 page 2M
[    0.000000] kernel direct mapping tables up to 120000000 @ dfffc000-dfffe000
[    0.000000] RAMDISK: 363b2000 - 371d1000
[    0.000000] ACPI: RSDP 00000000000fd8a0 00014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 00000000dfffe380 00034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 00000000dfffff80 00074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 00000000dfffe3c0 011A9 (v01   BXPC   BXDSDT 00000001 INTL 20100528)
[    0.000000] ACPI: FACS 00000000dfffff40 00040
[    0.000000] ACPI: SSDT 00000000dffff6e0 00858 (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: APIC 00000000dffff5b0 00090 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.000000] ACPI: HPET 00000000dffff570 00038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at 0000000000000000-0000000120000000
[    0.000000] Initmem setup node 0 0000000000000000-0000000120000000
[    0.000000]   NODE_DATA [000000011fffb000 - 000000011fffffff]
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 0:1cfa741, boot clock
[    0.000000]  [ffffea0000000000-ffffea00047fffff] PMD -> [ffff88011b600000-ffff88011f5fffff] on node 0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   0x00100000 -> 0x00120000
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[3] active PFN ranges
[    0.000000]     0: 0x00000010 -> 0x0000009f
[    0.000000]     0: 0x00000100 -> 0x000dfffe
[    0.000000]     0: 0x00100000 -> 0x00120000
[    0.000000] On node 0 totalpages: 1048461
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 5 pages reserved
[    0.000000]   DMA zone: 3914 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 16320 pages used for memmap
[    0.000000]   DMA32 zone: 897086 pages, LIFO batch:31
[    0.000000]   Normal zone: 2048 pages used for memmap
[    0.000000]   Normal zone: 129024 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ5 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] ACPI: IRQ10 used by override.
[    0.000000] ACPI: IRQ11 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] SMP: Allowing 4 CPUs, 0 hotplug CPUs
[    0.000000] nr_irqs_gsi: 40
[    0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[    0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
[    0.000000] PM: Registered nosave memory: 00000000dfffe000 - 00000000e0000000
[    0.000000] PM: Registered nosave memory: 00000000e0000000 - 00000000feffc000
[    0.000000] PM: Registered nosave memory: 00000000feffc000 - 00000000ff000000
[    0.000000] PM: Registered nosave memory: 00000000ff000000 - 00000000fffc0000
[    0.000000] PM: Registered nosave memory: 00000000fffc0000 - 0000000100000000
[    0.000000] Allocating PCI resources starting at e0000000 (gap: e0000000:1effc000)
[    0.000000] Booting paravirtualized kernel on KVM
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff88011fc00000 s83136 r8192 d23360 u524288
[    0.000000] pcpu-alloc: s83136 r8192 d23360 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3
[    0.000000] kvm-clock: cpu 0, msr 1:1fc13741, primary cpu clock
[    0.000000] KVM setup async PF for cpu 0
[    0.000000] kvm-stealtime: cpu 0, msr 11fc0ddc0
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 1030024
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.2.0-45-generic root=/dev/mapper/ubuntu01-root ro
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 4031508k/4718592k available (6579k kernel code, 524748k absent, 162336k reserved, 6626k data, 924k init)
[    0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] NR_IRQS:16640 nr_irqs:712 16
[    0.000000] Console: colour dummy device 80x25
[    0.000000] console [tty0] enabled
[    0.000000] allocated 33554432 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] hpet clockevent registered
[    0.000000] Detected 1999.999 MHz processor.
[    0.008000] Calibrating delay loop (skipped) preset value.. 3999.99 BogoMIPS (lpj=7999996)
[    0.008000] pid_max: default: 32768 minimum: 301
[    0.008000] Security Framework initialized
[    0.008000] AppArmor: AppArmor initialized
[    0.008000] Yama: becoming mindful.
[    0.008000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.008000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.008000] Mount-cache hash table entries: 256
[    0.008000] Initializing cgroup subsys cpuacct
[    0.008000] Initializing cgroup subsys memory
[    0.008000] Initializing cgroup subsys devices
[    0.008000] Initializing cgroup subsys freezer
[    0.008000] Initializing cgroup subsys blkio
[    0.008000] Initializing cgroup subsys perf_event
[    0.008000] mce: CPU supports 10 MCE banks
[    0.015350] ACPI: Core revision 20110623
[    0.016326] ftrace: allocating 26570 entries in 105 pages
[    0.021473] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.021479] CPU0: Intel QEMU Virtual CPU version 1.4.0 stepping 03
[    0.024001] Performance Events: unsupported p6 CPU model 2 no PMU driver, software events only.
[    0.024001] NMI watchdog disabled (cpu0): hardware events not enabled
[    0.024001] Booting Node   0, Processors  #1
[    0.024001] smpboot cpu 1: start_ip = 9a000
[    0.036006] kvm-clock: cpu 1, msr 1:1fc93741, secondary cpu clock
[    0.036195] KVM setup async PF for cpu 1
[    0.036206] NMI watchdog disabled (cpu1): hardware events not enabled
[    0.036195] kvm-stealtime: cpu 1, msr 11fc8ddc0
[    0.040070]  #2
[    0.040070] smpboot cpu 2: start_ip = 9a000
[    0.056006] kvm-clock: cpu 2, msr 1:1fd13741, secondary cpu clock
[    0.056183] KVM setup async PF for cpu 2
[    0.056193] NMI watchdog disabled (cpu2): hardware events not enabled
[    0.056183] kvm-stealtime: cpu 2, msr 11fd0ddc0
[    0.056273]  #3 Ok.
[    0.056273] smpboot cpu 3: start_ip = 9a000
[    0.076007] kvm-clock: cpu 3, msr 1:1fd93741, secondary cpu clock
[    0.076182] KVM setup async PF for cpu 3
[    0.076197] NMI watchdog disabled (cpu3): hardware events not enabled
[    0.076182] kvm-stealtime: cpu 3, msr 11fd8ddc0
[    0.076227] Brought up 4 CPUs
[    0.076227] Total of 4 processors activated (15999.99 BogoMIPS).
[    0.080400] devtmpfs: initialized
[    0.080738] EVM: security.selinux
[    0.080741] EVM: security.SMACK64
[    0.080744] EVM: security.capability
[    0.081079] print_constraints: dummy:
[    0.081079] RTC time: 12:56:38, date: 06/13/13
[    0.081079] NET: Registered protocol family 16
[    0.081344] Trying to unpack rootfs image as initramfs...
[    0.092438] ACPI: bus type pci registered
[    0.092444] PCI: Using configuration type 1 for base access
[    0.104813] bio: create slab <bio-0> at 0
[    0.105192] ACPI: Added _OSI(Module Device)
[    0.105356] ACPI: Added _OSI(Processor Device)
[    0.105361] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.105364] ACPI: Added _OSI(Processor Aggregator Device)
[    0.105824] ACPI: EC: Look up EC in DSDT
[    0.107915] ACPI: Interpreter enabled
[    0.107915] ACPI: (supports S0 S3 S4 S5)
[    0.107929] ACPI: Using IOAPIC for interrupt routing
[    0.111093] ACPI: No dock devices found.
[    0.111098] HEST: Table not found.
[    0.111102] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.111197] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.111354] pci_root PNP0A03:00: host bridge window [io  0x0000-0x0cf7]
[    0.111359] pci_root PNP0A03:00: host bridge window [io  0x0d00-0xffff]
[    0.111363] pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff]
[    0.111368] pci_root PNP0A03:00: host bridge window [mem 0xe0000000-0xfebfffff]
[    0.111427] pci 0000:00:00.0: [8086:1237] type 0 class 0x000600
[    0.111762] pci 0000:00:01.0: [8086:7000] type 0 class 0x000601
[    0.112251] pci 0000:00:01.1: [8086:7010] type 0 class 0x000101
[    0.118733] pci 0000:00:01.1: reg 20: [io  0xc080-0xc08f]
[    0.121490] pci 0000:00:01.2: [8086:7020] type 0 class 0x000c03
[    0.128615] pci 0000:00:01.2: reg 20: [io  0xc040-0xc05f]
[    0.156071] pci 0000:00:01.3: [8086:7113] type 0 class 0x000680
[    0.156473] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.156489] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
[    0.156653] pci 0000:00:02.0: [1013:00b8] type 0 class 0x000300
[    0.164009] pci 0000:00:02.0: reg 10: [mem 0xfc000000-0xfdffffff pref]
[    0.172045] pci 0000:00:02.0: reg 14: [mem 0xfebf8000-0xfebf8fff]
[    0.212084] pci 0000:00:02.0: reg 30: [mem 0xfebe0000-0xfebeffff pref]
[    0.264015] pci 0000:00:03.0: [8086:1520] type 0 class 0x000200
[    0.272016] pci 0000:00:03.0: reg 10: [mem 0xfebf0000-0xfebf3fff]
[    0.296082] pci 0000:00:03.0: reg 1c: [mem 0xfebf4000-0xfebf7fff]
[    0.380023] pci 0000:00:04.0: [1af4:1001] type 0 class 0x000100
[    0.384023] pci 0000:00:04.0: reg 10: [io  0xc000-0xc03f]
[    0.388034] pci 0000:00:04.0: reg 14: [mem 0xfebf9000-0xfebf9fff]
[    0.452027] pci 0000:00:05.0: [1af4:1002] type 0 class 0x0000ff
[    0.452086] pci 0000:00:05.0: reg 10: [io  0xc060-0xc07f]
[    0.472028] pci 0000:00:06.0: [15b3:1004] type 0 class 0x000280
[    0.508092] pci 0000:00:06.0: reg 18: [mem 0xfe000000-0xfe7fffff 64bit pref]
[    0.600585] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.601129]  pci0000:00: Unable to request _OSC control (_OSC support mask: 0x1e)
[    0.604249] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.604352] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.604441] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.604533] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.604591] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[    0.605078] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.605086] vgaarb: loaded
[    0.605089] vgaarb: bridge control possible 0000:00:02.0
[    0.605264] i2c-core: driver [aat2870] using legacy suspend method
[    0.605268] i2c-core: driver [aat2870] using legacy resume method
[    0.605399] SCSI subsystem initialized
[    0.605896] libata version 3.00 loaded.
[    0.605984] usbcore: registered new interface driver usbfs
[    0.605999] usbcore: registered new interface driver hub
[    0.606343] usbcore: registered new device driver usb
[    0.606597] PCI: Using ACPI for IRQ routing
[    0.606608] PCI: pci_cache_line_size set to 64 bytes
[    0.606818] reserve RAM buffer: 000000000009fc00 - 000000000009ffff
[    0.606823] reserve RAM buffer: 00000000dfffe000 - 00000000dfffffff
[    0.607022] NetLabel: Initializing
[    0.607028] NetLabel:  domain hash size = 128
[    0.607031] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.607064] NetLabel:  unlabeled traffic allowed by default
[    0.607372] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    0.607400] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.607407] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    0.623768] Switching to clocksource kvm-clock
[    0.629227] AppArmor: AppArmor Filesystem Enabled
[    0.629256] pnp: PnP ACPI init
[    0.629276] ACPI: bus type pnp registered
[    0.629374] pnp 00:00: [bus 00-ff]
[    0.629378] pnp 00:00: [io  0x0cf8-0x0cff]
[    0.629380] pnp 00:00: [io  0x0000-0x0cf7 window]
[    0.629382] pnp 00:00: [io  0x0d00-0xffff window]
[    0.629385] pnp 00:00: [mem 0x000a0000-0x000bffff window]
[    0.629387] pnp 00:00: [mem 0xe0000000-0xfebfffff window]
[    0.629436] pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
[    0.629450] pnp 00:01: [io  0x0070-0x0071]
[    0.629497] pnp 00:01: [irq 8]
[    0.629499] pnp 00:01: [io  0x0072-0x0077]
[    0.629526] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.629546] pnp 00:02: [io  0x0060]
[    0.629548] pnp 00:02: [io  0x0064]
[    0.629566] pnp 00:02: [irq 1]
[    0.629598] pnp 00:02: Plug and Play ACPI device, IDs PNP0303 (active)
[    0.629630] pnp 00:03: [irq 12]
[    0.629658] pnp 00:03: Plug and Play ACPI device, IDs PNP0f13 (active)
[    0.629684] pnp 00:04: [io  0x03f2-0x03f5]
[    0.629686] pnp 00:04: [io  0x03f7]
[    0.629705] pnp 00:04: [irq 6]
[    0.629707] pnp 00:04: [dma 2]
[    0.629732] pnp 00:04: Plug and Play ACPI device, IDs PNP0700 (active)
[    0.629813] pnp 00:05: [io  0x03f8-0x03ff]
[    0.629832] pnp 00:05: [irq 4]
[    0.629863] pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.629987] pnp 00:06: [mem 0xfed00000-0xfed003ff]
[    0.630035] pnp 00:06: Plug and Play ACPI device, IDs PNP0103 (active)
[    0.630154] pnp: PnP ACPI: found 7 devices
[    0.630158] ACPI: ACPI bus type pnp unregistered
[    0.636938] PCI: max bus depth: 0 pci_try_num: 1
[    0.636948] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7]
[    0.636960] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff]
[    0.636962] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff]
[    0.636965] pci_bus 0000:00: resource 7 [mem 0xe0000000-0xfebfffff]
[    0.637026] NET: Registered protocol family 2
[    0.637194] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.638701] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[    0.643173] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.643718] TCP: Hash tables configured (established 524288 bind 65536)
[    0.643723] TCP reno registered
[    0.643735] UDP hash table entries: 2048 (order: 4, 65536 bytes)
[    0.643784] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)
[    0.643912] NET: Registered protocol family 1
[    0.643933] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    0.644010] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    0.644014] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    0.644193] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[    0.644224] pci 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.644841] pci 0000:00:01.2: PCI INT D disabled
[    0.644880] pci 0000:00:02.0: Boot video device
[    0.644979] PCI: CLS 0 bytes, default 64
[    0.644991] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.644996] Placing 64MB software IO TLB between ffff8800dbffc000 - ffff8800dfffc000
[    0.645001] software IO TLB at phys 0xdbffc000 - 0xdfffc000
[    0.645739] audit: initializing netlink socket (disabled)
[    0.645753] type=2000 audit(1371128197.640:1): initialized
[    0.673169] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    0.676098] VFS: Disk quotas dquot_6.5.2
[    0.676172] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.676865] fuse init (API version 7.17)
[    0.676991] msgmni has been set to 7874
[    0.678099] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    0.678194] io scheduler noop registered
[    0.678198] io scheduler deadline registered
[    0.678242] io scheduler cfq registered (default)
[    0.678373] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    0.678407] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    0.678514] efifb: probing for efifb
[    0.678653] efifb: framebuffer at 0xfc000000, mapped to 0xffffc90001080000, using 1408k, total 1408k
[    0.678658] efifb: mode is 800x600x24, linelength=2400, pages=1
[    0.678661] efifb: scrolling: redraw
[    0.678665] efifb: Truecolor: size=0:8:8:8, shift=0:16:8:0
[    0.681685] Console: switching to colour frame buffer device 100x37
[    0.684077] fb0: EFI VGA frame buffer device
[    0.684230] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    0.684293] ACPI: Power Button [PWRF]
[    0.685552] ERST: Table is not found!
[    0.685584] GHES: HEST is not enabled!
[    0.685726] virtio-pci 0000:00:04.0: PCI INT A -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.686497] virtio-pci 0000:00:04.0: setting latency timer to 64
[    0.688574] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[    0.688729] virtio-pci 0000:00:05.0: PCI INT A -> Link[LNKA] -> GSI 10 (level, high) -> IRQ 10
[    0.690553] virtio-pci 0000:00:05.0: setting latency timer to 64
[    0.690857] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.714601] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    0.714917] Freeing initrd memory: 14460k freed
[    0.939310] 00:05: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    0.944244] Linux agpgart interface v0.103
[    0.947494] brd: module loaded
[    0.949997] loop: module loaded
[    0.951899] virtio-pci 0000:00:04.0: irq 40 for MSI/MSI-X
[    0.951927] virtio-pci 0000:00:04.0: irq 41 for MSI/MSI-X
[    0.953521]  vda: vda1 vda2 < vda5 >
[    0.958294] ata_piix 0000:00:01.1: version 2.13
[    0.960439] ata_piix 0000:00:01.1: setting latency timer to 64
[    0.961498] scsi0 : ata_piix
[    0.963952] scsi1 : ata_piix
[    0.966225] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc080 irq 14
[    0.968260] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc088 irq 15
[    0.970498] Fixed MDIO Bus: probed
[    0.971713] tun: Universal TUN/TAP device driver, 1.6
[    0.972938] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    0.974476] PPP generic driver version 2.4.2
[    0.976332] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.977586] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.978820] uhci_hcd: USB Universal Host Controller Interface driver
[    0.980120] uhci_hcd 0000:00:01.2: PCI INT D -> Link[LNKD] -> GSI 11 (level, high) -> IRQ 11
[    0.982836] uhci_hcd 0000:00:01.2: setting latency timer to 64
[    0.982847] uhci_hcd 0000:00:01.2: UHCI Host Controller
[    0.984415] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[    0.985810] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c040
[    0.987465] hub 1-0:1.0: USB hub found
[    0.989002] hub 1-0:1.0: 2 ports detected
[    0.992298] usbcore: registered new interface driver libusual
[    0.993650] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    0.996253] serio: i8042 KBD port at 0x60,0x64 irq 1
[    0.998369] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.001081] mousedev: PS/2 mouse device common for all mice
[    1.004105] rtc_cmos 00:01: RTC can wake from S4
[    1.006354] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    1.007661] rtc_cmos 00:01: rtc core: registered rtc_cmos as rtc0
[    1.009327] rtc0: alarms up to one day, 114 bytes nvram, hpet irqs
[    1.010701] device-mapper: uevent: version 1.0.3
[    1.012261] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
[    1.013523] cpuidle: using governor ladder
[    1.014714] cpuidle: using governor menu
[    1.015878] EFI Variables Facility v0.08 2004-May-17
[    1.017335] TCP cubic registered
[    1.018635] NET: Registered protocol family 10
[    1.020348] NET: Registered protocol family 17
[    1.021505] Registering the dns_resolver key type
[    1.023826] PM: Hibernation image not present or could not be loaded.
[    1.023850] registered taskstats version 1
[    1.040161]   Magic number: 1:140:936
[    1.042209] rtc_cmos 00:01: setting system clock to 2013-06-13 12:56:39 UTC (1371128199)
[    1.044582] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    1.046624] EDD information not available.
[    1.125051] ata2.01: NODEV after polling detection
[    1.125545] ata2.00: ATAPI: QEMU DVD-ROM, 1.4.0, max UDMA/100
[    1.129341] ata2.00: configured for MWDMA2
[    1.132760] scsi 1:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     1.4. PQ: 0 ANSI: 5
[    1.136805] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    1.138951] cdrom: Uniform CD-ROM driver Revision: 3.20
[    1.141578] sr 1:0:0:0: Attached scsi CD-ROM sr0
[    1.142237] sr 1:0:0:0: Attached scsi generic sg0 type 5
[    1.147291] Freeing unused kernel memory: 924k freed
[    1.149874] Write protecting the kernel read-only data: 12288k
[    1.156272] Freeing unused kernel memory: 1596k freed
[    1.162535] Freeing unused kernel memory: 1188k freed
[    1.210281] udevd[98]: starting version 175
[    1.246757] Intel(R) Gigabit Virtual Function Network Driver - version 2.0.1-k
[    1.248001] Copyright (c) 2009 - 2011 Intel Corporation.
[    1.251571] igbvf 0000:00:03.0: setting latency timer to 64
[    1.251986] igbvf 0000:00:03.0: irq 42 for MSI/MSI-X
[    1.252026] igbvf 0000:00:03.0: irq 43 for MSI/MSI-X
[    1.252048] igbvf 0000:00:03.0: irq 44 for MSI/MSI-X
[    1.696314] Refined TSC clocksource calibration: 2000.270 MHz.
[    1.713420] FDC 0 is a S82078B
[    1.729334] igbvf 0000:00:03.0: Intel(R) I350 Virtual Function
[    1.732330] igbvf 0000:00:03.0: Address: fa:fb:f1:c4:a4:6d
[    1.734523] mlx4_core: Mellanox ConnectX core driver v1.0 (July 14, 2011)
[    1.736268] mlx4_core: Initializing 0000:00:06.0
[    1.738263] mlx4_core 0000:00:06.0: Missing DCS, aborting.
[    1.902194] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
[    3.364461] Adding 4190204k swap on /dev/mapper/ubuntu01-swap_1.  Priority:-1 extents:1 across:4190204k
[    3.385117] ADDRCONF(NETDEV_UP): eth0: link is not ready
[    3.395567] udevd[340]: starting version 175
[    3.416203] EXT4-fs (dm-0): re-mounted. Opts: errors=remount-ro
[    3.418382] lp: driver loaded but no devices found
[    3.441724] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 0
[    3.451993] Compat-mlnx-ofed backport release: gcecc987
[    3.451996] Backport based on git://beany.openfabrics.org/compat-rdma/compat.git 3d70f8c
[    3.451998] compat.git: git://beany.openfabrics.org/compat-rdma/compat.git
[    3.537518] type=1400 audit(1371128201.990:2): apparmor="STATUS" operation="profile_load" name="/sbin/dhclient" pid=501 comm="apparmor_parser"
[    3.537518] type=1400 audit(1371128201.990:3): apparmor="STATUS" operation="profile_replace" name="/sbin/dhclient" pid=502 comm="apparmor_parser"
[    3.537705] type=1400 audit(1371128201.990:4): apparmor="STATUS" operation="profile_load" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=501 comm="apparmor_parser"
[    3.537768] type=1400 audit(1371128201.990:5): apparmor="STATUS" operation="profile_replace" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=502 comm="apparmor_parser"
[    3.537877] type=1400 audit(1371128201.990:6): apparmor="STATUS" operation="profile_load" name="/usr/lib/connman/scripts/dhclient-script" pid=501 comm="apparmor_parser"
[    3.537939] type=1400 audit(1371128201.990:7): apparmor="STATUS" operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" pid=502 comm="apparmor_parser"
[    3.816512] Compat-mlnx-ofed backport release: gcecc987
[    3.816512] Backport based on git://beany.openfabrics.org/compat-rdma/compat.git 3d70f8c
[    3.816512] compat.git: git://beany.openfabrics.org/compat-rdma/compat.git
[    3.816610] igbvf 0000:00:03.0: Link is Up 1000 Mbps Full Duplex
[    3.819206] mlx4_core: Mellanox ConnectX core driver v1.1 (Jun 13 2013)
[    3.819206] mlx4_core: Initializing 0000:00:06.0
[    3.821285] mlx4_core 0000:00:06.0: setting latency timer to 64
[    3.821393] mlx4_core 0000:00:06.0: Detected virtual function - running in slave mode
[    3.821545] mlx4_core 0000:00:06.0: Sending reset
[    3.821545] mlx4_core 0000:00:06.0: Sending vhcr0
[    3.824686] mlx4_core 0000:00:06.0: BlueFlame not available
[    3.824698] igbvf 0000:00:03.0: Link is Up 1000 Mbps Full Duplex
[    3.825110] mlx4_core 0000:00:06.0: Base MM extensions: flags 00104cc0, rsvd L_Key 00008000
[    3.825113] mlx4_core 0000:00:06.0: Max ICM size 4294967296 MB
[    3.825115] mlx4_core 0000:00:06.0: Max QPs: 16777216, reserved QPs: 64, entry size: 256
[    3.825118] mlx4_core 0000:00:06.0: Max SRQs: 16777216, reserved SRQs: 64, entry size: 128
[    3.825121] mlx4_core 0000:00:06.0: Max CQs: 16777216, reserved CQs: 128, entry size: 128
[    3.825123] mlx4_core 0000:00:06.0: Max EQs: 32, reserved EQs: 28, entry size: 128
[    3.825125] mlx4_core 0000:00:06.0: reserved MPTs: 256, reserved MTTs: 32
[    3.825128] mlx4_core 0000:00:06.0: Max PDs: 131072, reserved PDs: 4, reserved UARs: 7
[    3.825130] mlx4_core 0000:00:06.0: Max QP/MCG: 131072, reserved MGMs: 0
[    3.825133] mlx4_core 0000:00:06.0: Max CQEs: 4194304, max WQEs: 16384, max SRQ WQEs: 16384
[    3.825135] mlx4_core 0000:00:06.0: Local CA ACK delay: 15, max MTU: 4096, port width cap: 2
[    3.825138] mlx4_core 0000:00:06.0: Max SQ desc size: 1008, max SQ S/G: 62
[    3.825140] mlx4_core 0000:00:06.0: Max RQ desc size: 512, max RQ S/G: 32
[    3.825142] mlx4_core 0000:00:06.0: Max GSO size: 131072
[    3.825144] mlx4_core 0000:00:06.0: Max basic counters: 255
[    3.825146] mlx4_core 0000:00:06.0: Max extended counters: 80
[    3.825178] mlx4_core 0000:00:06.0: Max RSS Table size: 256
[    3.825180] mlx4_core 0000:00:06.0: DEV_CAP flags:
[    3.825182] mlx4_core 0000:00:06.0:     RC transport
[    3.825184] mlx4_core 0000:00:06.0:     UC transport
[    3.825186] mlx4_core 0000:00:06.0:     UD transport
[    3.825188] mlx4_core 0000:00:06.0:     XRC transport
[    3.825190] mlx4_core 0000:00:06.0:     FCoIB support
[    3.825192] mlx4_core 0000:00:06.0:     SRQ support
[    3.825193] mlx4_core 0000:00:06.0:     IPoIB checksum offload
[    3.825195] mlx4_core 0000:00:06.0:     P_Key violation counter
[    3.825197] mlx4_core 0000:00:06.0:     Q_Key violation counter
[    3.825199] mlx4_core 0000:00:06.0:     DPDP
[    3.825201] mlx4_core 0000:00:06.0:     Big LSO headers
[    3.825203] mlx4_core 0000:00:06.0:     APM support
[    3.825205] mlx4_core 0000:00:06.0:     Atomic ops support
[    3.825207] mlx4_core 0000:00:06.0:     Address vector port checking support
[    3.825209] mlx4_core 0000:00:06.0:     UD multicast support
[    3.825211] mlx4_core 0000:00:06.0:     Router support
[    3.825213] mlx4_core 0000:00:06.0:     IBoE support
[    3.825215] mlx4_core 0000:00:06.0:     Unicast loopback support
[    3.825217] mlx4_core 0000:00:06.0:     FCS header control
[    3.825219] mlx4_core 0000:00:06.0:     UDP RSS support
[    3.825221] mlx4_core 0000:00:06.0:     Unicast VEP steering support
[    3.825223] mlx4_core 0000:00:06.0:     Multicast VEP steering support
[    3.825225] mlx4_core 0000:00:06.0:     Cross-channel (sync_qp) operations support
[    3.825227] mlx4_core 0000:00:06.0:     Counters support
[    3.825229] mlx4_core 0000:00:06.0:     Port management change event support
[    3.825231] mlx4_core 0000:00:06.0:     64 byte EQE support
[    3.825233] mlx4_core 0000:00:06.0:     64 byte CQE support
[    3.825235] mlx4_core 0000:00:06.0:     RSS support
[    3.825237] mlx4_core 0000:00:06.0:     RSS Toeplitz Hash Function support
[    3.825239] mlx4_core 0000:00:06.0:     RSS XOR Hash Function support
[    3.825338] mlx4_core 0000:00:06.0: HCA minimum page size:512
[    3.825818] mlx4_core 0000:00:06.0: Steering mode is: B0 steering
[    3.825820] mlx4_core 0000:00:06.0: Failed to map blue flame area
[    3.826506] mlx4_core 0000:00:06.0: irq 45 for MSI/MSI-X
[    3.826506] mlx4_core 0000:00:06.0: irq 46 for MSI/MSI-X
[    3.826506] mlx4_core 0000:00:06.0: irq 47 for MSI/MSI-X
[    3.826506] mlx4_core 0000:00:06.0: irq 48 for MSI/MSI-X
[    3.832042] init: rsyslog main process (634) terminated with status 127
[    3.832042] init: rsyslog main process ended, respawning
[    4.391080] init: failsafe main process (607) killed by TERM signal
[    4.439310] type=1400 audit(1371128202.890:8): apparmor="STATUS" operation="profile_load" name="/usr/sbin/tcpdump" pid=746 comm="apparmor_parser"
[    4.440865] type=1400 audit(1371128202.894:9): apparmor="STATUS" operation="profile_replace" name="/sbin/dhclient" pid=744 comm="apparmor_parser"
[    4.441631] type=1400 audit(1371128202.894:10): apparmor="STATUS" operation="profile_replace" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=744 comm="apparmor_parser"
[    4.661863] mlx4_core 0000:00:06.0: NOP command IRQ test passed
[    4.667211] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
[    4.661863] mlx4_core 0000:00:06.0: NOP command IRQ test passed
[    4.667211] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
[    4.676148] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v1.0 (Jun 13 2013)
[    4.789797] mlx4_core 0000:00:06.0: mlx4_ib: multi-function enabled
[    4.789801] mlx4_core 0000:00:06.0: mlx4_ib: operating in qp1 tunnel mode
[    4.794274] mlx4_en: Mellanox ConnectX HCA Ethernet driver v2.1 (Jun 13 2013)
[    4.795746] mlx4_en 0000:00:06.0: Activating port:2
[    4.853558] mlx4_en: eth1: Using 36 TX rings
[    4.853564] mlx4_en: eth1: Using 4 RX rings
[    4.853872] mlx4_en: eth1: Initializing port
[    5.925984] Default coalesing params for mtu:2044 - rx_frames:88 rx_usecs:16
[    6.938474] ib0: enabling connected mode will cause multicast packet drops
[    6.940499] ib0: mtu > 2044 will cause multicast packet drops.
[    6.950009] eth_ipoib: eth_ipoib: IP-over-InfiniBand Para Virtualized Driver: v1.0.0 (Jun 13 2013)
[    6.964447] fmr_pool: Device mlx4_0 does not support FMRs
[    6.964447] fmr_pool: Device mlx4_0 does not support FMRs
[    6.964447] fmr_pool: Device mlx4_0 does not support FMRs
[    6.980376] Loading iSCSI transport class v2.0-870.
[    6.984016] iscsi: registered transport (iser)
[   14.608060] eth0: no IPv6 routers present
[  123.909643] show_signal_msg: 3 callbacks suppressed
[  123.909651] ibnetdiscover[1495]: segfault at e4 ip 00007f31d5e87024 sp 00007fff8aba8328 error 4 in libibmad.so.5.3.1[7f31d5e7d000+12000]

 ちょっとしたメモ

手動でのKVM用MACの生成方法

MACADDR="52:54:00:$(dd if=/dev/urandom bs=512 count=1 2>/dev/null | md5sum | sed 's/^\(..\)\(..\)\(..\).*$/\1:\2:\3/')"; echo $MACADDR

Windows用SPICEクライアントのショートカット

フルスクリーン/ウィンドウモード切替
Shift + F11
フォーカスリリース
Shift + F12

以下デバッグモード

サーバへ接続
Shift + F5
サーバから切断
Shift + F6