Pastebin
(02:19:55 PM) Mike: (02:16:24 PM) Mike: https://adminhd.liquidweb.com/msgs/index.mhtml?id=2552919 (02:16:28 PM) Mike: take a peak (02:17:24 PM) Chris Hildebrandt: you'll need to pass that on to David, he's the super today (02:21:37 PM) David Singer: checking (02:22:54 PM) David Singer: are they hitting a hard limit on mem at this point? (02:23:15 PM) Mike: let me log back in and check again (02:23:25 PM) David Singer: time to move if so (02:23:28 PM) David Singer: kk (02:23:47 PM) Mike: https://adminhd.liquidweb.com/msgs/?2555120 take this one (02:23:49 PM) Mike: lol (02:24:03 PM) Mike: RAW 2011-02-07 13:23:31 (02:24:17 PM) Mike: been waiting all day and he replied 1 hr ago (02:24:32 PM) David Singer: yea (02:24:42 PM) David Singer: thats usual (02:25:17 PM) David Singer: merge and let him know that we are working on determining the issue and will have more info shortly (02:25:54 PM) Mike: root@host [~]# free -m
total used free shared buffers cached
Mem: 3399 3368 31 0 106 2257 -/+ buffers/cache: 1004 2395 Swap: 6142 408 5733
(02:25:56 PM) Mike: cant merge (02:25:59 PM) Mike: i tried (02:26:06 PM) Mike: before i even linked it to you (02:26:33 PM) David Singer: kk (02:28:09 PM) David Singer: well, not really swapping bad, 5733 is he hitting a wall during backups or anything related specifically to the timeframe when he goes down? (02:28:13 PM) Mike: 00:40:01 99120 3382104 97.15 106696 2184608 5893616 395820 6.29 136876 00:50:02 127948 3353276 96.32 108968 2192136 5885656 403780 6.42 144872 01:00:01 604648 2876576 82.63 99864 1749952 5867884 421552 6.70 139188 01:10:01 332436 3148788 90.45 314468 1810128 5834248 455188 7.24 142644 01:20:03 23936 3457288 99.31 714496 1627608 5822944 466492 7.42 139804 Average: 167142 3314082 95.20 208634 2057356 5874098 415338 6.60 131878
01:59:52 LINUX RESTART
02:10:01 kbmemfree kbmemused %memused kbbuffers kbcached kbswpfree kbswpused %swpused kbswpcad 02:20:01 87688 3393536 97.48 513892 1929904 5861040 428396 6.81 125936 02:30:01 87056 3394168 97.50 406084 1896112 5856472 432964 6.88 128296 02:40:02 72616 3408608 97.91 413980 1950112 5855712 433724 6.90 131896 02:50:01 54152 3427072 98.44 415884 1994292 5855684 433752 6.90 132108 03:00:01 200152 3281072 94.25 417536 1874596 5849848 439588 6.99 136688
(02:28:22 PM) Mike: when it went down (02:28:36 PM) David Singer: from sar? (02:28:44 PM) Mike: yeah (02:28:57 PM) David Singer: backups running during that time? (02:29:10 PM) Mike: well there are a few actually (02:29:12 PM) David Singer: clam still on the box? (02:29:23 PM) Mike: 00:40:01 all 3.43 0.01 1.41 0.00 95.15 00:50:02 all 3.07 0.01 1.41 0.00 95.52 01:00:01 all 3.01 0.01 1.25 0.00 95.73 01:10:01 all 5.66 5.32 2.81 0.00 86.22 01:20:03 all 6.45 4.37 3.30 0.00 85.88 Average: all 4.01 1.26 1.80 0.00 92.93
01:59:52 LINUX RESTART
02:10:01 CPU %user %nice %system %iowait %idle 02:20:01 all 1.96 0.64 0.90 0.00 96.49 02:30:01 all 5.12 0.01 2.32 0.00 92.55 02:40:02 all 6.38 0.01 2.41 0.00 91.20 02:50:01 all 5.29 0.01 2.26 0.00 92.45 03:00:01 all 8.08 0.01 3.60 0.00 88.31 03:10:01 all 7.28 0.02 2.68 0.00 90.02 03:20:01 all 3.07 0.01 1.34 0.00 95.58 03:30:01 all 4.18 0.17 1.54 0.00 94.12
06:00:01 all 2.64 0.01 0.90 0.00 96.45 06:10:01 all 3.04 0.39 1.05 0.00 95.51 06:20:01 all 2.95 1.46 1.54 0.00 94.06 06:30:01 all 3.98 1.48 1.60 0.00 92.94 06:40:01 all 4.44 0.01 1.52 0.00 94.03 06:50:01 all 2.85 0.02 1.08 0.00 96.06 07:00:01 all 2.99 0.01 1.07 0.00 95.93 07:10:01 all 2.58 0.01 0.85 0.00 96.57 07:20:01 all 3.00 0.37 1.07 0.00 95.56 07:30:01 all 2.58 0.01 0.80 0.00 96.61 Average: all 3.99 0.25 1.60 0.00 94.17
08:08:07 LINUX RESTART
08:10:01 CPU %user %nice %system %iowait %idle 08:20:01 all 7.35 1.80 3.26 0.00 87.60 08:30:01 all 6.43 0.01 2.58 0.00 90.98 08:40:01 all 3.86 0.01 1.18 0.00 94.94 08:50:01 all 8.19 0.02 2.76 0.00 89.03 09:00:01 all 3.54 0.01 1.13 0.00 95.33 09:10:01 all 4.79 0.02 1.44 0.00 93.74 09:20:01 all 7.60 0.01 1.80 0.00 90.59 09:30:01 all 12.75 0.01 3.18 0.00 84.06 09:40:01 all 12.06 0.01 4.00 0.00 83.92 09:50:01 all 8.39 0.01 2.49 0.00 89.12
(02:29:32 PM) Mike: dont think so (02:29:47 PM) David Singer: weird (02:29:57 PM) Mike: Average: all 7.33 0.19 2.56 0.00 89.91 root@host [~]# ps aux | grep clamd root 27216 0.0 0.0 1376 224 pts/0 D 14:29 0:00 grep clamd root@host [~]# (02:30:13 PM) David Singer: kk (02:30:27 PM) Mike: no iowait (02:30:36 PM) Mike: but slight swaps usage (02:31:23 PM) Mike: 07:10:01 1 93 0.11 0.16 0.17 07:20:01 3 97 0.10 0.21 0.19 07:30:01 6 96 0.22 0.25 0.23 Average: 4 99 0.31 0.36 0.34
08:08:07 LINUX RESTART
08:10:01 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 08:20:01 3 100 0.61 0.78 0.47 08:30:01 3 100 0.08 0.31 0.37 08:40:01 1 104 0.35 0.35 0.35
(02:31:25 PM) Mike: 01:00:01 6 106 0.20 0.22 0.20 01:10:01 5 109 1.89 1.57 0.88 01:20:03 2 103 0.70 1.19 1.04 Average: 4 101 0.55 0.54 0.49
01:59:52 LINUX RESTART
02:10:01 runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 02:20:01 4 98 0.12 0.11 0.09 02:30:01 3 117 0.21 0.41 0.26 02:40:02 3 95 0.38 0.43 0.34 02:50:01 4 102 0.25 0.32 0.34
(02:31:28 PM) Mike: and no load (02:31:37 PM) Mike: no reason for this server to restart (02:31:48 PM) Mike: in my opinion (02:31:50 PM) Mike: that is (02:32:04 PM) Mike: i wonder if it is KPing (02:32:08 PM) David Singer: anything in the kernel log? (02:32:11 PM) David Singer: yea (02:32:41 PM) David Singer: not that theres hw issues on a vps...lol