On server running NFS share network interface eth3 (mlx4_core) was disconnected.<br />
Log var/log/messages contains following:<br />
<br />
Jul 24 23:29:25 mds-controller1 kernel: ------------[ cut here ]------------<br />
Jul 24 23:29:25 mds-controller1 kernel: WARNING: at net/sched/sch_generic.c:261 dev_watchdog+0x26d/0x280() (Not tainted)<br />
Jul 24 23:29:25 mds-controller1 kernel: Hardware name: ProLiant SL390s G7<br />
Jul 24 23:29:25 mds-controller1 kernel: NETDEV WATCHDOG: eth3 (mlx4_core): transmit queue 12 timed out<br />
Jul 24 23:29:25 mds-controller1 kernel: Modules linked in: nfsd lockd nfs_acl auth_rpcgss exportfs bnx2fc fcoe libfcoe libfc 8021q scsi_transport_fc garp stp llc scsi_tgt sunrpc mlx4_en serio_raw sg iTCO_wdt iTCO_vendor_support hpilo hpwdt i7core_edac edac_core shpchp ext4 mbcache jbd2 sd_mod crc_t10dif mlx4_core hpsa pata_acpi ata_generic ata_piix igb dca ptp pps_core radeon ttm drm_kms_helper drm i2c_algo_bit i2c_core dm_mirror dm_region_hash dm_log dm_mod be2iscsi bnx2i cnic uio ipv6 cxgb4i cxgb4 cxgb3i libcxgbi cxgb3 mdio libiscsi_tcp qla4xxx iscsi_boot_sysfs libiscsi scsi_transport_iscsi [last unloaded: scsi_wait_scan]<br />
Jul 24 23:29:25 mds-controller1 kernel: Pid: 0, comm: swapper Not tainted 2.6.32-358.6.1.el6.x86_64 <a href="http://bugs.centos.org/view.php?id=1">0000001</a><br />
Jul 24 23:29:25 mds-controller1 kernel: Call Trace:<br />
Jul 24 23:29:25 mds-controller1 kernel: <IRQ> [<ffffffff8106e2e7>] ? warn_slowpath_common+0x87/0xc0<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8106e3d6>] ? warn_slowpath_fmt+0x46/0x50<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81467bfd>] ? dev_watchdog+0x26d/0x280<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81012b69>] ? sched_clock+0x9/0x10<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81467990>] ? dev_watchdog+0x0/0x280<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81081837>] ? run_timer_softirq+0x197/0x340<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff810a7ff0>] ? tick_sched_timer+0x0/0xc0<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8102e99d>] ? lapic_next_event+0x1d/0x30<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81076fb1>] ? __do_softirq+0xc1/0x1e0<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8109b77b>] ? hrtimer_interrupt+0x14b/0x260<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8100c1cc>] ? call_softirq+0x1c/0x30<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8100de05>] ? do_softirq+0x65/0xa0<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81076d95>] ? irq_exit+0x85/0x90<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81517230>] ? smp_apic_timer_interrupt+0x70/0x9b<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff8100bb93>] ? apic_timer_interrupt+0x13/0x20<br />
Jul 24 23:29:25 mds-controller1 kernel: <EOI> [<ffffffff8141508a>] ? poll_idle+0x3a/0x80<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81415063>] ? poll_idle+0x13/0x80<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81415277>] ? cpuidle_idle_call+0xa7/0x140<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81009fc6>] ? cpu_idle+0xb6/0x110<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff814f33da>] ? rest_init+0x7a/0x80<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81c27f7b>] ? start_kernel+0x424/0x430<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81c2733a>] ? x86_64_start_reservations+0x125/0x129<br />
Jul 24 23:29:25 mds-controller1 kernel: [<ffffffff81c27438>] ? x86_64_start_kernel+0xfa/0x109<br />
Jul 24 23:29:25 mds-controller1 kernel: ---[ end trace de13874ba4151305 ]---<br />
Jul 24 23:29:26 mds-controller1 kernel: mlx4_en: eth3: Link Down<br />
Jul 24 23:29:28 mds-controller1 kernel: mlx4_en: eth3: Link Up
↧