I've just had another instance myself but think my contribution may have been a red hearing from the start, at least regarding a RAID Sync ... any suggestions on the below?
1&1 Dedicated server went unreachable... mail, httpd, nagios agent all unresponsive.
Serial console was reachable and pinging
http://www.google.com was showing packet loss.
Code:
PING www.l.google.com (74.125.39.103) 56(84) bytes of data.
64 bytes from fx-in-f103.1e100.net (74.125.39.103): icmp_seq=1 ttl=55 time=174 ms
64 bytes from fx-in-f103.1e100.net (74.125.39.103): icmp_seq=2 ttl=55 time=124 ms
64 bytes from fx-in-f103.1e100.net (74.125.39.103): icmp_seq=5 ttl=55 time=156 ms
64 bytes from fx-in-f103.1e100.net (74.125.39.103): icmp_seq=8 ttl=55 time=154 ms
--- www.l.google.com ping statistics ---
11 packets transmitted, 4 received, 63% packet loss, time 10006ms
rtt min/avg/max/mdev = 124.610/152.596/174.816/18.000 ms
Attempted service network restart - no change in behaviour
Did full reboot and this fixed the issue. Saw a couple of warnings/errors in reboot process. The one regarding a kernel module was the worrying one.
Code:
The system is going down for reboot NOW!
INIT: Sending pStopping atd: [ OK ]
Stopping psmon: [ OK ]
Shutting down mailman: [ OK ]
Stopping httpd: [ OK ]
Stopping psa: Stopping Plesk... done
Stopping mail handlers tmpfs storage
[ OK ]
Stopping tortixd: [ OK ]
Stopping sshd: [ OK ]
Stopping Courier-IMAP server:
Stopping imap [ OK ]
Stopping imap-ssl [ OK ]
Stopping pop3 [ OK ]
Stopping pop3-ssl [ OK ]
Stopping : Stopping mysqld: [ OK ]
Stopping Clam AntiVirus Daemon: [ OK ]
Stopping xinetd: [ OK ]
Stopping crond: [ OK ]
Stopping monitoring for VG vg00: 3 logical volume(s) in volume group "vg00" unmonitored
[ OK ]
Shutting down ntpd: [ OK ]
Stopping named: .[ OK ]
Shutting down kernel logger: [ OK ]
Shutting down system logger: [ OK ]
Shutting down interface eth0: [ OK ]
Shutting down loopback interface: [ OK ]
iptables: Flushing firewall rules: [ OK ]
iptables: Setting chains to policy ACCEPT: mangle nat filter [ OK ]
iptables: Unloading modules: iptable_mangle iptable_nat[FAILED]
Disabling ondemand cpu frequency scaling: FATAL: Error removing cpufreq_ondemand (/lib/modules/2.6.32.43-6.art.x86_64/kernel/drivers/cpufreq/cpufreq_ondemand.ko): Operation not permitted
[ OK ]
Starting killall: Shutting down spamd: [ OK ]
[ OK ]
Sending all processes the TERM signal...
Sending all processes the KILL signal...
Saving random seed:
Syncing hardware clock to system time grsec: time set by /sbin/hwclock[hwclock:7653] uid/euid:0/0 gid/egid:0/0, parent /etc/rc.d/init.d/halt[S01reboot:6836] uid/euid:0/0 gid/egid:0/0
Turning off swap:
Unmounting file systems: umount2: Device or resource busy
umount: /usr: device is busy
umount2: Device or resource busy
umount: /usr: device is busy
Unmounting file systems (retry): umount2: Device or resource busy
umount: /usr: device is busy
umount2: Device or resource busy
umount: /usr: device is busy
Unmounting file systems (retry): umount2: Device or resource busy
umount: /usr: device is busy
umount2: Device or resource busy
umount: /usr: device is busy
umount2: Device or resource busy
umount: /usr: device is busy
umount2: Device or resource busy
umount: /usr: device is busy
Please stand by while rebooting the system...
Thanks,
Steve