My MySQL keeps crashing.
I notice that the serverload goes up to 30-40 all very, very quickly, then mysql stops accepting connections.
is anyone able to tell from this what might be happening?
################### Logwatch 7.3.6+cvs20080702-debian (07/02/08) ####################
Processing Initiated: Sun Jul 11 09:29:51 2010
Date Range Processed: today
( 2010-Jul-11 )
Period is day.
Detail Level of Output: 5
Type of Output/Format: mail / text
Logfiles for Host: wiggins
##################################################################
--------------------- courier mail services Begin ------------------------
Connections: 10 Times
Protocol POP3 - 10 Times
Host 66.183.188.57 - 10 Times
Logins: 10 Times
Protocol POP3 - 10 Times, 0 Bytes
User
info@synthgear.com - 5 Times, 0 Bytes
Host 66.183.188.57 - 5 Times, 0 Bytes
User
info@tunereel.com - 5 Times, 0 Bytes
Host 66.183.188.57 - 5 Times, 0 Bytes
---------------------- courier mail services End -------------------------
--------------------- Cron Begin ------------------------
Commands Run:
User root:
cd / && run-parts --report /etc/cron.hourly: 3 Time(s)
[ -x /usr/lib/php5/maxlifetime ] && [ -d /var/lib/php5 ] && find /var/lib/php5/ -type f -cmin +$(/usr/lib/php5/maxlifetime) -print0 | xargs -n 200 -r -0 rm: 6 Time(s)
php /root/check_mysql.php: 36 Time(s)
test -x /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.weekly ): 1 Time(s)
---------------------- Cron End -------------------------
--------------------- httpd Begin ------------------------
0.00 MB transferred in 1816 responses (1xx 0, 2xx 1813, 3xx 0, 4xx 3, 5xx 0)
1 Images (0.00 MB),
1 Content pages (0.00 MB),
1814 Other (0.00 MB)
Requests with error response codes
400 Bad Request
/wp-content/themes/arthemia-premium/images/left_stripe.gif: 1 Time(s)
/wp-content/themes/arthemia-premium/script ... h=80&zc=1&q=100: 1 Time(s)
HTTP/1.1: 1 Time(s)
---------------------- httpd End -------------------------
--------------------- Kernel Begin ------------------------
WARNING: Kernel Errors Present
[<c05fbb2e>] ? error_code+0x66/0x6c ...: 18 Time(s)
19 Time(s): 0 pages HighMem
1 Time(s): 10127 total pagecache pages
1 Time(s): 10141 pages shared
1 Time(s): 10221 pages shared
1 Time(s): 10661 pages shared
1 Time(s): 119790 pages non-shared
1 Time(s): 12322 pages shared
1 Time(s): 123765 pages non-shared
1 Time(s): 124358 pages non-shared
1 Time(s): 124459 pages non-shared
1 Time(s): 124475 pages non-shared
1 Time(s): 124498 pages non-shared
1 Time(s): 124532 pages non-shared
1 Time(s): 124537 pages non-shared
1 Time(s): 124539 pages non-shared
1 Time(s): 124558 pages non-shared
1 Time(s): 124580 pages non-shared
1 Time(s): 124587 pages non-shared
1 Time(s): 124613 pages non-shared
1 Time(s): 124655 pages non-shared
1 Time(s): 124762 pages non-shared
1 Time(s): 124781 pages non-shared
1 Time(s): 124854 pages non-shared
1 Time(s): 125003 pages non-shared
1 Time(s): 125120 pages non-shared
1 Time(s): 12552 pages shared
1 Time(s): 12591 pages shared
19 Time(s): 131072 pages RAM
1 Time(s): 13468 pages shared
1 Time(s): 13638 pages shared
1 Time(s): 14059 pages shared
1 Time(s): 14108 pages shared
1 Time(s): 14606 pages shared
1 Time(s): 15861 pages shared
1 Time(s): 16534 pages shared
1 Time(s): 18945 pages shared
1 Time(s): 21265 pages shared
1 Time(s): 22072 pages shared
19 Time(s): 3409 pages reserved
1 Time(s): 4202 pages in swap cache
1 Time(s): 4575 total pagecache pages
1 Time(s): 4909 pages in swap cache
1 Time(s): 4918 pages in swap cache
1 Time(s): 5164 pages in swap cache
1 Time(s): 5242 total pagecache pages
1 Time(s): 5267 pages in swap cache
1 Time(s): 5270 total pagecache pages
1 Time(s): 5373 pages in swap cache
1 Time(s): 5381 pages in swap cache
1 Time(s): 5697 total pagecache pages
1 Time(s): 5782 total pagecache pages
1 Time(s): 5849 total pagecache pages
1 Time(s): 5869 pages in swap cache
1 Time(s): 5905 total pagecache pages
1 Time(s): 6183 pages in swap cache
1 Time(s): 6526 pages in swap cache
1 Time(s): 6562 total pagecache pages
1 Time(s): 6572 pages in swap cache
1 Time(s): 6577 pages in swap cache
1 Time(s): 6582 pages in swap cache
1 Time(s): 6916 total pagecache pages
1 Time(s): 6979 total pagecache pages
1 Time(s): 7033 pages in swap cache
1 Time(s): 7037 pages in swap cache
1 Time(s): 7417 total pagecache pages
1 Time(s): 7477 total pagecache pages
1 Time(s): 7635 total pagecache pages
1 Time(s): 7691 total pagecache pages
1 Time(s): 8035 total pagecache pages
2 Time(s): 8736 pages shared
2 Time(s): 8784 pages in swap cache
2 Time(s): 8815 total pagecache pages
1 Time(s): 9099 pages in swap cache
1 Time(s): 9181 pages shared
1 Time(s): 9598 total pagecache pages
1 Time(s): 9743 pages in swap cache
19 Time(s): CPU 0: hi: 0, btch: 1 usd: 0
2 Time(s): CPU 0: hi: 186, btch: 31 usd: 26
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 30
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 31
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 43
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 64
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 70
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 86
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 107
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 113
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 128
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 131
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 133
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 137
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 146
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 151
1 Time(s): CPU 0: hi: 186, btch: 31 usd: 155
2 Time(s): CPU 0: hi: 186, btch: 31 usd: 163
19 Time(s): CPU 1: hi: 0, btch: 1 usd: 0
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 13
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 18
2 Time(s): CPU 1: hi: 186, btch: 31 usd: 27
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 102
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 117
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 135
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 146
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 147
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 154
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 156
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 157
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 163
2 Time(s): CPU 1: hi: 186, btch: 31 usd: 171
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 177
1 Time(s): CPU 1: hi: 186, btch: 31 usd: 180
2 Time(s): CPU 1: hi: 186, btch: 31 usd: 181
19 Time(s): CPU 2: hi: 0, btch: 1 usd: 0
2 Time(s): CPU 2: hi: 186, btch: 31 usd: 30
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 37
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 46
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 72
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 81
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 111
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 117
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 119
2 Time(s): CPU 2: hi: 186, btch: 31 usd: 130
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 135
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 145
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 151
2 Time(s): CPU 2: hi: 186, btch: 31 usd: 170
1 Time(s): CPU 2: hi: 186, btch: 31 usd: 172
2 Time(s): CPU 2: hi: 186, btch: 31 usd: 179
19 Time(s): CPU 3: hi: 0, btch: 1 usd: 0
2 Time(s): CPU 3: hi: 186, btch: 31 usd: 22
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 30
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 52
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 81
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 95
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 100
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 107
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 120
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 139
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 142
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 146
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 158
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 162
2 Time(s): CPU 3: hi: 186, btch: 31 usd: 167
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 171
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 179
1 Time(s): CPU 3: hi: 186, btch: 31 usd: 184
19 Time(s): Call Trace:
1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB active_anon:2444kB inactive_anon:2584kB active_file:0kB inactive_file:12kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:12kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:192kB kernel_stack:48kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB active_anon:2444kB inactive_anon:2584kB active_file:0kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):40kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:52kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:192kB kernel_stack:48kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:13 all_unreclaimable? no
1 Time(s): DMA free:2028kB min:84kB low:104kB high:124kB active_anon:2524kB inactive_anon:2404kB active_file:0kB inactive_file:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:20kB mapped:44kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:184kB kernel_stack:48kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:42 all_unreclaimable? no
1 Time(s): DMA free:2032kB min:84kB low:104kB high:124kB active_anon:2328kB inactive_anon:2500kB active_file:8kB inactive_file:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:48kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:192kB kernel_stack:48kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:11 all_unreclaimable? no
1 Time(s): DMA free:2036kB min:84kB low:104kB high:124kB active_anon:2248kB inactive_anon:2468kB active_file:12kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:32kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:340kB kernel_stack:88kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
2 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB active_anon:2376kB inactive_anon:2532kB active_file:12kB inactive_file:28kB unevictable:0kB isolated(anon):0kB isolated(file):100kB present:15872kB mlocked:0kB dirty:0kB writeback:32kB mapped:88kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:196kB kernel_stack:48kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:25 all_unreclaimable? no
1 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB active_anon:2384kB inactive_anon:2536kB active_file:28kB inactive_file:96kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:16kB mapped:68kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:184kB kernel_stack:48kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
1 Time(s): DMA free:2040kB min:84kB low:104kB high:124kB active_anon:2404kB inactive_anon:2496kB active_file:12kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:64kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:216kB kernel_stack:32kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
2 Time(s): DMA free:2044kB min:84kB low:104kB high:124kB active_anon:2444kB inactive_anon:2468kB active_file:8kB inactive_file:108kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:20kB shmem:0kB slab_reclaimable:64kB slab_unreclaimable:216kB kernel_stack:32kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:68 all_unreclaimable? yes
2 Time(s): DMA free:2048kB min:84kB low:104kB high:124kB active_anon:2208kB inactive_anon:2664kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:28kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:248kB kernel_stack:48kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:13 all_unreclaimable? no
1 Time(s): DMA free:2048kB min:84kB low:104kB high:124kB active_anon:2468kB inactive_anon:2608kB active_file:8kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:192kB kernel_stack:48kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? yes
1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB active_anon:2132kB inactive_anon:2352kB active_file:20kB inactive_file:56kB unevictable:0kB isolated(anon):264kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:36kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:340kB kernel_stack:72kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:73 all_unreclaimable? no
1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB active_anon:2260kB inactive_anon:2352kB active_file:20kB inactive_file:16kB unevictable:0kB isolated(anon):136kB isolated(file):28kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:36kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:340kB kernel_stack:72kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:14 all_unreclaimable? no
1 Time(s): DMA free:2052kB min:84kB low:104kB high:124kB active_anon:2388kB inactive_anon:2568kB active_file:0kB inactive_file:44kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:0kB mapped:60kB shmem:0kB slab_reclaimable:64kB slab_unreclaimable:216kB kernel_stack:32kB pagetables:16kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:80 all_unreclaimable? yes
1 Time(s): DMA free:2064kB min:84kB low:104kB high:124kB active_anon:2344kB inactive_anon:2504kB active_file:28kB inactive_file:92kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:16kB mapped:64kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:196kB kernel_stack:48kB pagetables:20kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:95 all_unreclaimable? no
1 Time(s): DMA free:2064kB min:84kB low:104kB high:124kB active_anon:2372kB inactive_anon:2548kB active_file:24kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15872kB mlocked:0kB dirty:0kB writeback:76kB mapped:60kB shmem:0kB slab_reclaimable:60kB slab_unreclaimable:200kB kernel_stack:48kB pagetables:52kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
19 Time(s): DMA per-cpu:
1 Time(s): DMA: 11*4kB 12*8kB 3*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
1 Time(s): DMA: 11*4kB 8*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2092kB
1 Time(s): DMA: 12*4kB 1*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2040kB
2 Time(s): DMA: 14*4kB 9*8kB 1*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2032kB
1 Time(s): DMA: 17*4kB 0*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2052kB
1 Time(s): DMA: 20*4kB 9*8kB 3*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2088kB
1 Time(s): DMA: 34*4kB 9*8kB 0*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2064kB
1 Time(s): DMA: 35*4kB 10*8kB 1*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2060kB
1 Time(s): DMA: 39*4kB 10*8kB 1*16kB 1*32kB 0*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2076kB
2 Time(s): DMA: 4*4kB 12*8kB 3*16kB 1*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2048kB
2 Time(s): DMA: 4*4kB 7*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2056kB
1 Time(s): DMA: 5*4kB 2*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2052kB
1 Time(s): DMA: 8*4kB 4*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2048kB
1 Time(s): DMA: 9*4kB 1*8kB 3*16kB 1*32kB 0*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2044kB
2 Time(s): DMA: 9*4kB 2*8kB 2*16kB 0*32kB 1*64kB 1*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 2068kB
10 Time(s): Free swap = 0kB
2 Time(s): Free swap = 16kB
2 Time(s): Free swap = 20kB
1 Time(s): Free swap = 380kB
1 Time(s): Free swap = 40kB
1 Time(s): Free swap = 4284kB
2 Time(s): Free swap = 4kB
1 Time(s): Killed process 20435 (mysqld)
1 Time(s): Killed process 31863 (apache2)
1 Time(s): Killed process 31878 (apache2)
1 Time(s): Killed process 31885 (apache2)
1 Time(s): Killed process 32089 (apache2)
1 Time(s): Killed process 32093 (apache2)
1 Time(s): Killed process 32094 (apache2)
1 Time(s): Killed process 32098 (apache2)
1 Time(s): Killed process 32109 (apache2)
1 Time(s): Killed process 32111 (apache2)
1 Time(s): Killed process 32117 (apache2)
1 Time(s): Killed process 32129 (apache2)
1 Time(s): Killed process 32134 (apache2)
1 Time(s): Killed process 32149 (mysqld)
1 Time(s): Killed process 32158 (apache2)
1 Time(s): Killed process 32187 (apache2)
1 Time(s): Killed process 32239 (mysqld)
1 Time(s): Killed process 32283 (mysqld)
19 Time(s): Mem-Info:
1 Time(s): Normal free:2692kB min:2792kB low:3488kB high:4188kB active_anon:232576kB inactive_anon:232768kB active_file:484kB inactive_file:1608kB unevictable:0kB isolated(anon):1004kB isolated(file):296kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:512kB shmem:28kB slab_reclaimable:3116kB slab_unreclaimable:9772kB kernel_stack:2080kB pagetables:7472kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2996 all_unreclaimable? no
1 Time(s): Normal free:2708kB min:2792kB low:3488kB high:4188kB active_anon:233372kB inactive_anon:233416kB active_file:536kB inactive_file:628kB unevictable:0kB isolated(anon):0kB isolated(file):768kB present:503936kB mlocked:0kB dirty:0kB writeback:352kB mapped:1440kB shmem:24kB slab_reclaimable:3336kB slab_unreclaimable:9580kB kernel_stack:1944kB pagetables:6852kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2018 all_unreclaimable? yes
1 Time(s): Normal free:2712kB min:2792kB low:3488kB high:4188kB active_anon:234320kB inactive_anon:234228kB active_file:0kB inactive_file:108kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:84kB shmem:28kB slab_reclaimable:2972kB slab_unreclaimable:9556kB kernel_stack:2072kB pagetables:6780kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:27 all_unreclaimable? no
1 Time(s): Normal free:2712kB min:2792kB low:3488kB high:4188kB active_anon:234320kB inactive_anon:234228kB active_file:0kB inactive_file:108kB unevictable:0kB isolated(anon):128kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:84kB shmem:28kB slab_reclaimable:2972kB slab_unreclaimable:9556kB kernel_stack:2072kB pagetables:6780kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:292 all_unreclaimable? no
1 Time(s): Normal free:2728kB min:2792kB low:3488kB high:4188kB active_anon:232732kB inactive_anon:233020kB active_file:260kB inactive_file:1056kB unevictable:0kB isolated(anon):1240kB isolated(file):328kB present:503936kB mlocked:0kB dirty:0kB writeback:36kB mapped:176kB shmem:28kB slab_reclaimable:3116kB slab_unreclaimable:9772kB kernel_stack:2080kB pagetables:7472kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1330 all_unreclaimable? yes
1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB active_anon:233260kB inactive_anon:233212kB active_file:580kB inactive_file:2044kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:576kB mapped:532kB shmem:24kB slab_reclaimable:3476kB slab_unreclaimable:9564kB kernel_stack:2016kB pagetables:7076kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:6918 all_unreclaimable? yes
1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB active_anon:233668kB inactive_anon:233688kB active_file:476kB inactive_file:376kB unevictable:0kB isolated(anon):0kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:428kB mapped:1272kB shmem:24kB slab_reclaimable:3116kB slab_unreclaimable:9340kB kernel_stack:1968kB pagetables:7084kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1421 all_unreclaimable? yes
1 Time(s): Normal free:2752kB min:2792kB low:3488kB high:4188kB active_anon:234040kB inactive_anon:234084kB active_file:144kB inactive_file:1428kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:568kB mapped:72kB shmem:24kB slab_reclaimable:3088kB slab_unreclaimable:9336kB kernel_stack:1968kB pagetables:7112kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:960 all_unreclaimable? yes
1 Time(s): Normal free:2764kB min:2792kB low:3488kB high:4188kB active_anon:232884kB inactive_anon:233084kB active_file:380kB inactive_file:516kB unevictable:0kB isolated(anon):192kB isolated(file):260kB present:503936kB mlocked:0kB dirty:28kB writeback:628kB mapped:1124kB shmem:24kB slab_reclaimable:3428kB slab_unreclaimable:9916kB kernel_stack:2032kB pagetables:7192kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3385 all_unreclaimable? yes
1 Time(s): Normal free:2764kB min:2792kB low:3488kB high:4188kB active_anon:232884kB inactive_anon:233084kB active_file:568kB inactive_file:336kB unevictable:0kB isolated(anon):192kB isolated(file):500kB present:503936kB mlocked:0kB dirty:28kB writeback:628kB mapped:1236kB shmem:24kB slab_reclaimable:3428kB slab_unreclaimable:9916kB kernel_stack:2032kB pagetables:7192kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3283 all_unreclaimable? yes
1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB active_anon:232848kB inactive_anon:232896kB active_file:320kB inactive_file:380kB unevictable:0kB isolated(anon):256kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:72kB mapped:740kB shmem:24kB slab_reclaimable:3696kB slab_unreclaimable:10092kB kernel_stack:2264kB pagetables:7140kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2493 all_unreclaimable? yes
1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB active_anon:233768kB inactive_anon:233956kB active_file:692kB inactive_file:3312kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:800kB shmem:32kB slab_reclaimable:3112kB slab_unreclaimable:9344kB kernel_stack:1824kB pagetables:6512kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3392 all_unreclaimable? yes
1 Time(s): Normal free:2768kB min:2792kB low:3488kB high:4188kB active_anon:233768kB inactive_anon:233956kB active_file:692kB inactive_file:3424kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:0kB mapped:912kB shmem:32kB slab_reclaimable:3112kB slab_unreclaimable:9344kB kernel_stack:1824kB pagetables:6512kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:3392 all_unreclaimable? yes
1 Time(s): Normal free:2788kB min:2792kB low:3488kB high:4188kB active_anon:232652kB inactive_anon:232716kB active_file:248kB inactive_file:268kB unevictable:0kB isolated(anon):1368kB isolated(file):592kB present:503936kB mlocked:0kB dirty:12kB writeback:168kB mapped:672kB shmem:28kB slab_reclaimable:3116kB slab_unreclaimable:9768kB kernel_stack:2272kB pagetables:7436kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:1217 all_unreclaimable? yes
1 Time(s): Normal free:2800kB min:2792kB low:3488kB high:4188kB active_anon:233588kB inactive_anon:233548kB active_file:708kB inactive_file:564kB unevictable:0kB isolated(anon):384kB isolated(file):640kB present:503936kB mlocked:0kB dirty:0kB writeback:340kB mapped:956kB shmem:32kB slab_reclaimable:3128kB slab_unreclaimable:9420kB kernel_stack:1896kB pagetables:6704kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
1 Time(s): Normal free:3080kB min:2792kB low:3488kB high:4188kB active_anon:233372kB inactive_anon:233416kB active_file:416kB inactive_file:620kB unevictable:0kB isolated(anon):0kB isolated(file):640kB present:503936kB mlocked:0kB dirty:0kB writeback:352kB mapped:1104kB shmem:24kB slab_reclaimable:3336kB slab_unreclaimable:9580kB kernel_stack:1944kB pagetables:6852kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
1 Time(s): Normal free:3136kB min:2792kB low:3488kB high:4188kB active_anon:233652kB inactive_anon:233488kB active_file:868kB inactive_file:1044kB unevictable:0kB isolated(anon):256kB isolated(file):0kB present:503936kB mlocked:0kB dirty:0kB writeback:316kB mapped:796kB shmem:24kB slab_reclaimable:3156kB slab_unreclaimable:9460kB kernel_stack:2000kB pagetables:7200kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:992 all_unreclaimable? no
1 Time(s): Normal free:3692kB min:2792kB low:3488kB high:4188kB active_anon:233060kB inactive_anon:232932kB active_file:512kB inactive_file:1168kB unevictable:0kB isolated(anon):512kB isolated(file):128kB present:503936kB mlocked:0kB dirty:0kB writeback:124kB mapped:704kB shmem:24kB slab_reclaimable:3312kB slab_unreclaimable:9592kB kernel_stack:1952kB pagetables:6864kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:2531 all_unreclaimable? no
1 Time(s): Normal free:4004kB min:2792kB low:3488kB high:4188kB active_anon:233496kB inactive_anon:233652kB active_file:216kB inactive_file:688kB unevictable:0kB isolated(anon):384kB isolated(file):384kB present:503936kB mlocked:0kB dirty:0kB writeback:256kB mapped:372kB shmem:32kB slab_reclaimable:3144kB slab_unreclaimable:9364kB kernel_stack:1856kB pagetables:6600kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:896 all_unreclaimable? no
19 Time(s): Normal per-cpu:
1 Time(s): Normal: 2676*4kB 921*8kB 146*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 20408kB
1 Time(s): Normal: 270*4kB 106*8kB 42*16kB 5*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2760kB
1 Time(s): Normal: 294*4kB 69*8kB 57*16kB 4*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2768kB
1 Time(s): Normal: 300*4kB 100*8kB 52*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2864kB
1 Time(s): Normal: 300*4kB 93*8kB 46*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2712kB
2 Time(s): Normal: 302*4kB 127*8kB 34*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2768kB
1 Time(s): Normal: 302*4kB 77*8kB 56*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2752kB
1 Time(s): Normal: 304*4kB 74*8kB 57*16kB 1*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2752kB
2 Time(s): Normal: 305*4kB 103*8kB 35*16kB 5*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2764kB
1 Time(s): Normal: 309*4kB 172*8kB 6*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2708kB
1 Time(s): Normal: 324*4kB 164*8kB 12*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2800kB
1 Time(s): Normal: 330*4kB 136*8kB 20*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2728kB
1 Time(s): Normal: 337*4kB 148*8kB 16*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2788kB
1 Time(s): Normal: 380*4kB 72*8kB 65*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3136kB
1 Time(s): Normal: 388*4kB 179*8kB 6*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3080kB
1 Time(s): Normal: 521*4kB 153*8kB 18*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 3692kB
1 Time(s): Normal: 565*4kB 174*8kB 22*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 4004kB
1 Time(s): Out of memory: kill process 20171 (mysqld_safe) score 15877 or a child
1 Time(s): Out of memory: kill process 31863 (apache2) score 13677 or a child
1 Time(s): Out of memory: kill process 31878 (apache2) score 13325 or a child
1 Time(s): Out of memory: kill process 31885 (apache2) score 13663 or a child
1 Time(s): Out of memory: kill process 32089 (apache2) score 13491 or a child
1 Time(s): Out of memory: kill process 32093 (apache2) score 13484 or a child
1 Time(s): Out of memory: kill process 32094 (apache2) score 13470 or a child
1 Time(s): Out of memory: kill process 32098 (apache2) score 13504 or a child
1 Time(s): Out of memory: kill process 32109 (apache2) score 13589 or a child
1 Time(s): Out of memory: kill process 32111 (apache2) score 13449 or a child
1 Time(s): Out of memory: kill process 32117 (apache2) score 13451 or a child
1 Time(s): Out of memory: kill process 32129 (apache2) score 13262 or a child
1 Time(s): Out of memory: kill process 32134 (apache2) score 13460 or a child
1 Time(s): Out of memory: kill process 32149 (mysqld) score 34419 or a child
1 Time(s): Out of memory: kill process 32158 (apache2) score 13551 or a child
1 Time(s): Out of memory: kill process 32187 (apache2) score 13420 or a child
1 Time(s): Out of memory: kill process 32239 (mysqld) score 32241 or a child
1 Time(s): Out of memory: kill process 32283 (mysqld) score 14617 or a child
1 Time(s): Pid: 31878, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32006, comm: smtp Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32039, comm: smtp Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32090, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32092, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32097, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32098, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32105, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32109, comm: apache2 Not tainted 2.6.32.12-linode25 #1
3 Time(s): Pid: 32111, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32112, comm: apache2 Not tainted 2.6.32.12-linode25 #1
2 Time(s): Pid: 32113, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32206, comm: smtpd Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32235, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32260, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Pid: 32285, comm: apache2 Not tainted 2.6.32.12-linode25 #1
1 Time(s): Swap cache stats: add 6977820, delete 6973619, find 7256579/7779513
1 Time(s): Swap cache stats: add 6986707, delete 6981789, find 7257730/7780872
1 Time(s): Swap cache stats: add 6986707, delete 6981798, find 7257730/7780872
1 Time(s): Swap cache stats: add 7002601, delete 6996732, find 7259236/7783070
1 Time(s): Swap cache stats: add 7009714, delete 7004341, find 7260821/7785371
1 Time(s): Swap cache stats: add 7009722, delete 7004341, find 7260821/7785371
1 Time(s): Swap cache stats: add 7010750, delete 7005586, find 7261106/7785766
1 Time(s): Swap cache stats: add 7054055, delete 7047473, find 7272274/7801059
1 Time(s): Swap cache stats: add 7054179, delete 7047653, find 7272290/7801083
1 Time(s): Swap cache stats: add 7054284, delete 7048101, find 7272292/7801091
1 Time(s): Swap cache stats: add 7095558, delete 7090291, find 7278968/7811068
1 Time(s): Swap cache stats: add 7104941, delete 7097908, find 7280682/7813461
1 Time(s): Swap cache stats: add 7104988, delete 7097951, find 7280760/7813546
2 Time(s): Swap cache stats: add 7122151, delete 7113367, find 7284760/7819110
1 Time(s): Swap cache stats: add 7135372, delete 7126273, find 7287403/7823015
1 Time(s): Swap cache stats: add 7141602, delete 7131859, find 7288439/7824595
1 Time(s): Swap cache stats: add 7146452, delete 7139875, find 7289110/7825750
1 Time(s): Swap cache stats: add 7146452, delete 7139880, find 7289113/7825754
19 Time(s): Total swap = 262136kB
7 Time(s): [<c01043b0>] ? xen_set_pte_at+0x80/0xf0
6 Time(s): [<c0105357>] ? xen_force_evtchn_callback+0x17/0x30
3 Time(s): [<c0105bbf>] ? xen_restore_fl_direct_end+0x0/0x1
15 Time(s): [<c0105bc8>] ? check_events+0x8/0xc
1 Time(s): [<c0107f69>] ? syscall_call+0x7/0xb
3 Time(s): [<c01089c7>] ? xen_do_upcall+0x7/0xc
36 Time(s): [<c011b480>] ? do_page_fault+0x0/0x330
19 Time(s): [<c011b5b4>] ? do_page_fault+0x134/0x330
4 Time(s): [<c0129fa7>] ? finish_task_switch+0x47/0xa0
2 Time(s): [<c0134ff1>] ? do_softirq+0x31/0x40
2 Time(s): [<c0135121>] ? irq_exit+0x31/0x70
1 Time(s): [<c0135176>] ? local_bh_enable_ip+0x16/0x90
2 Time(s): [<c01445ae>] ? __wake_up_bit+0x2e/0x40
3 Time(s): [<c0144640>] ? autoremove_wake_function+0x0/0x50
1 Time(s): [<c016b054>] ? __rcu_process_callbacks+0x44/0x2e0
10 Time(s): [<c0175b97>] ? filemap_fault+0x397/0x3a0
1 Time(s): [<c0176e0a>] ? generic_file_aio_read+0x3fa/0x6b0
18 Time(s): [<c01778ca>] ? oom_kill_process+0x9a/0x280
18 Time(s): [<c0177f3c>] ? __out_of_memory+0xfc/0x160
18 Time(s): [<c0177ff4>] ? out_of_memory+0x54/0xb0
1 Time(s): [<c017b15c>] ? __alloc_pages_nodemask+0x49c/0x580
18 Time(s): [<c017b221>] ? __alloc_pages_nodemask+0x561/0x580
11 Time(s): [<c017caed>] ? __do_page_cache_readahead+0xdd/0x1f0
11 Time(s): [<c017cc27>] ? ra_submit+0x27/0x40
1 Time(s): [<c017d053>] ? page_cache_sync_readahead+0x43/0x70
10 Time(s): [<c01886da>] ? __do_fault+0x5a/0x490
10 Time(s): [<c018a7e7>] ? handle_mm_fault+0x167/0x990
4 Time(s): [<c018ad59>] ? handle_mm_fault+0x6d9/0x990
4 Time(s): [<c018af3f>] ? handle_mm_fault+0x8bf/0x990
2 Time(s): [<c018e39c>] ? __vm_enough_memory+0x2c/0x170
2 Time(s): [<c018f741>] ? vma_merge+0xf1/0x280
2 Time(s): [<c0190079>] ? mmap_region+0x1d9/0x480
4 Time(s): [<c01966d7>] ? read_swap_cache_async+0xc7/0x110
4 Time(s): [<c0196788>] ? swapin_readahead+0x68/0x90
1 Time(s): [<c019ce51>] ? kmem_cache_free+0x41/0x60
3 Time(s): [<c01a0287>] ? filp_close+0x47/0x80
1 Time(s): [<c01a21f0>] ? do_sync_read+0x0/0x120
1 Time(s): [<c01a22c5>] ? do_sync_read+0xd5/0x120
1 Time(s): [<c01a236a>] ? rw_verify_area+0x5a/0xd0
1 Time(s): [<c01a304d>] ? vfs_read+0x9d/0x180
1 Time(s): [<c01a3201>] ? sys_read+0x41/0x80
2 Time(s): [<c01a3965>] ? __fput+0x145/0x1d0
1 Time(s): [<c01b36d4>] ? dput+0x84/0x130
2 Time(s): [<c01b3730>] ? dput+0xe0/0x130
1 Time(s): [<c01d8696>] ? flock_lock_file_wait+0x216/0x320
1 Time(s): [<c03cfbbc>] ? security_file_permission+0xc/0x10
1 Time(s): [<c04bc096>] ? sock_setsockopt+0x96/0x6f0
3 Time(s): [<c05f9837>] ? schedule+0x407/0xa20
1 Time(s): [<c05fb7b0>] ? _spin_lock_irq+0x10/0x20
2 Time(s): [<c05fb885>] ? _spin_lock+0x5/0x10
1 Time(s): [<c05fbab5>] ? unlock_kernel+0x25/0x2c
1 Time(s): active_anon:58725 inactive_anon:58796 isolated_anon:342
1 Time(s): active_anon:58733 inactive_anon:58808 isolated_anon:317
1 Time(s): active_anon:58748 inactive_anon:58843 isolated_anon:344
1 Time(s): active_anon:58794 inactive_anon:58849 isolated_anon:64
1 Time(s): active_anon:58823 inactive_anon:58859 isolated_anon:128
2 Time(s): active_anon:58832 inactive_anon:58917 isolated_anon:48
1 Time(s): active_anon:58932 inactive_anon:58955 isolated_anon:0
2 Time(s): active_anon:58937 inactive_anon:58987 isolated_anon:0
1 Time(s): active_anon:58971 inactive_anon:59055 isolated_anon:96
1 Time(s): active_anon:58998 inactive_anon:59011 isolated_anon:96
1 Time(s): active_anon:59006 inactive_anon:59009 isolated_anon:64
1 Time(s): active_anon:59048 inactive_anon:59023 isolated_anon:0
2 Time(s): active_anon:59053 inactive_anon:59106 isolated_anon:0
1 Time(s): active_anon:59106 inactive_anon:59155 isolated_anon:0
2 Time(s): active_anon:59132 inactive_anon:59223 isolated_anon:32
2 Time(s): active_file:0 inactive_file:26 isolated_file:0
1 Time(s): active_file:107 inactive_file:141 isolated_file:217
1 Time(s): active_file:118 inactive_file:101 isolated_file:96
1 Time(s): active_file:126 inactive_file:416 isolated_file:74
1 Time(s): active_file:135 inactive_file:315 isolated_file:32
1 Time(s): active_file:137 inactive_file:164 isolated_file:217
1 Time(s): active_file:138 inactive_file:88 isolated_file:135
1 Time(s): active_file:147 inactive_file:515 isolated_file:0
1 Time(s): active_file:175 inactive_file:855 isolated_file:0
1 Time(s): active_file:175 inactive_file:883 isolated_file:0
1 Time(s): active_file:180 inactive_file:145 isolated_file:160
1 Time(s): active_file:223 inactive_file:261 isolated_file:0
1 Time(s): active_file:43 inactive_file:381 isolated_file:0
1 Time(s): active_file:54 inactive_file:162 isolated_file:96
1 Time(s): active_file:65 inactive_file:67 isolated_file:148
1 Time(s): active_file:70 inactive_file:268 isolated_file:89
1 Time(s): active_file:82 inactive_file:102 isolated_file:64
1 Time(s): active_file:91 inactive_file:132 isolated_file:65
2 Time(s): apache2 invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
9 Time(s): apache2 invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
4 Time(s): apache2 invoked oom-killer: gfp_mask=0x280da, order=0, oom_adj=0
1 Time(s): apache2: page allocation failure. order:0, mode:0x200da
1 Time(s): free:1186 slab_reclaimable:794 slab_unreclaimable:2528
1 Time(s): free:1187 slab_reclaimable:849 slab_unreclaimable:2444
2 Time(s): free:1190 slab_reclaimable:758 slab_unreclaimable:2451
1 Time(s): free:1195 slab_reclaimable:794 slab_unreclaimable:2381
1 Time(s): free:1195 slab_reclaimable:794 slab_unreclaimable:2528
1 Time(s): free:1198 slab_reclaimable:787 slab_unreclaimable:2380
2 Time(s): free:1198 slab_reclaimable:872 slab_unreclaimable:2527
1 Time(s): free:1200 slab_reclaimable:884 slab_unreclaimable:2439
1 Time(s): free:1200 slab_reclaimable:939 slab_unreclaimable:2571
2 Time(s): free:1203 slab_reclaimable:794 slab_unreclaimable:2390
1 Time(s): free:1206 slab_reclaimable:794 slab_unreclaimable:2527
1 Time(s): free:1210 slab_reclaimable:797 slab_unreclaimable:2409
1 Time(s): free:1280 slab_reclaimable:849 slab_unreclaimable:2444
1 Time(s): free:1300 slab_reclaimable:804 slab_unreclaimable:2415
1 Time(s): free:1439 slab_reclaimable:843 slab_unreclaimable:2447
1 Time(s): free:1514 slab_reclaimable:802 slab_unreclaimable:2395
1 Time(s): imklog 3.18.6, log source = /proc/kmsg started.
19 Time(s): lowmem_reserve[]: 0 0 0 0
19 Time(s): lowmem_reserve[]: 0 492 492 492
1 Time(s): mapped:108 shmem:8 pagetables:1654 bounce:0
1 Time(s): mapped:133 shmem:6 pagetables:1773 bounce:0
1 Time(s): mapped:137 shmem:7 pagetables:1881 bounce:0
1 Time(s): mapped:176 shmem:7 pagetables:1872 bounce:0
1 Time(s): mapped:192 shmem:6 pagetables:1721 bounce:0
1 Time(s): mapped:197 shmem:6 pagetables:1789 bounce:0
1 Time(s): mapped:205 shmem:8 pagetables:1632 bounce:0
1 Time(s): mapped:214 shmem:6 pagetables:1813 bounce:0
1 Time(s): mapped:233 shmem:8 pagetables:1632 bounce:0
1 Time(s): mapped:255 shmem:8 pagetables:1680 bounce:0
2 Time(s): mapped:28 shmem:7 pagetables:1708 bounce:0
1 Time(s): mapped:284 shmem:6 pagetables:1802 bounce:0
1 Time(s): mapped:298 shmem:6 pagetables:1718 bounce:0
1 Time(s): mapped:322 shmem:6 pagetables:1802 bounce:0
1 Time(s): mapped:329 shmem:6 pagetables:1784 bounce:0
1 Time(s): mapped:35 shmem:6 pagetables:1791 bounce:0
1 Time(s): mapped:382 shmem:6 pagetables:1718 bounce:0
1 Time(s): mapped:53 shmem:7 pagetables:1881 bounce:0
1 Time(s): smtp invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
1 Time(s): smtp invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
1 Time(s): smtpd invoked oom-killer: gfp_mask=0x201da, order=0, oom_adj=0
3 Time(s): unevictable:0 dirty:0 writeback:0 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:112 unstable:0
2 Time(s): unevictable:0 dirty:0 writeback:142 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:144 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:146 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:35 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:64 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:8 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:85 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:9 unstable:0
2 Time(s): unevictable:0 dirty:0 writeback:96 unstable:0
1 Time(s): unevictable:0 dirty:0 writeback:98 unstable:0
1 Time(s): unevictable:0 dirty:3 writeback:42 unstable:0
2 Time(s): unevictable:0 dirty:7 writeback:157 unstable:0
---------------------- Kernel End -------------------------
--------------------- pam_unix Begin ------------------------
cron:
Sessions Opened:
root: 46 Time(s)
sshd:
Authentication Failures:
root (125.77.107.212): 19 Time(s)
unknown (125.77.107.212): 1 Time(s)
Invalid Users:
Unknown Account: 1 Time(s)
Sessions Opened:
root: 3 Time(s)
---------------------- pam_unix End -------------------------
--------------------- POP-3 Begin ------------------------
[POP3] Connections:
=========================
Host | Connections
------------------------------------------------------------- | -----------
::ffff:66.183.188.57 | 10
---------------------------------------------------------------------------
10
[POP3] Logout stats (in MB):
============================
User | Logouts | Downloaded | Mbox Size
--------------------------------------- | ------- | ---------- | ----------
info@synthgear.com | 5 | 0 | 0
info@tunereel.com | 5 | 0 | 0
---------------------------------------------------------------------------
10 | 0.00 | 0.00
---------------------- POP-3 End -------------------------
--------------------- Postfix Begin ------------------------
****** Summary *************************************************************************************
5 *Fatal: General fatal
3 *Warning: Startup error
1 *Warning: Map lookup problem
5 Process exited
7 Postfix communications error
18 Miscellaneous warnings
225.448K Bytes accepted 230,859
2.691M Bytes sent via SMTP 2,821,500
======== ================================================
54 Accepted 45.00%
66 Rejected 55.00%
-------- ------------------------------------------------
120 Total 100.00%
======== ================================================
66 5xx Reject unknown user 100.00%
-------- ------------------------------------------------
66 Total 5xx Rejects 100.00%
======== ================================================
96 Connections made
15 Connections lost (inbound)
7 Connections lost (outbound)
96 Disconnections
56 Removed from queue
1469 Sent via SMTP
1 Resent
67 Deferred
736 Deferrals
142 Bounced (local)
334 Bounced (remote)
1 Bounce failure
24 Notifications sent
894 Connection failure (outbound)
8 Timeout (inbound)
12 MX errors
13 Numeric hostname
6 Hostname verification errors
4 Hostname validation errors
5 PIX workaround enabled
****** Detail **************************************************************************************
5 *Fatal: General fatal -------------------------------------------------------------------
5 Proxy:mysql:/etc/postfix/mysql-virtual_domains.cf(0,lock|fold_fix): table lookup pr...
3 *Warning: Startup error -----------------------------------------------------------------
3 Bad command startup -- throttling
1 *Warning: Map lookup problem ------------------------------------------------------------
1 virtual_alias_maps
5 Process exited --------------------------------------------------------------------------
5 Exit status 1
7 Postfix communications error ------------------------------------------------------------
6 Problem talking to service rewrite
1 Problem talking to service private/scache
18 Miscellaneous warnings ------------------------------------------------------------------
13 do not list domain synthgear.com in BOTH mydestination and virtual_mailbox_domains
4 connect to mysql server 127.0.0.1: Can't connect to MySQL server on '127.0.0.1' (111)
1 mysql query failed: Lost connection to MySQL server during query
66 5xx Reject unknown user -----------------------------------------------------------------
66 Virtual mailbox table
15 Connections lost (inbound) --------------------------------------------------------------
11 After RCPT
2 After DATA
1 After CONNECT
1 After MAIL
7 Connections lost (outbound) -------------------------------------------------------------
4 While sending DATA command
3 While sending RCPT TO
1469 Sent via SMTP ---------------------------------------------------------------------------
536 gmail.com
191 yahoo.com
181 hotmail.com
70 mail.ru
58 yahoo.co.uk
52 pwagorn.msoutlookonline.net
12 yandex.ru
10 bk.ru
10 mac.com
9 freemeilaadressforall.net
9 googlemail.com
9 testbird.info
8 comcast.net
8 mailinator.com
8 msn.com
8 sbcglobal.net
7 hotmail.co.uk
6 goodemailadressforfree.net
5 gooogletartsert.net
5 greatvox.com
4 live.com
4 rocketmail.com
4 yahoo.ca
3 att.net
3 cox.net
3 juno.com
2 aol.com
2 asdf.com
2 astroboymail.com
2 bellsouth.net
2 btinternet.com
2 charter.net
2 earthlink.net
2 free.fr
2 list.ru
2 pookmail.com
2 shaw.ca
2 sogetthis.com
2 ttu.edu
2 uoregon.edu
2 visir.is
2 web.de
2 yahoo.es
2 ymail.com
1 800hightech.com
1 aanet.com.au
1 abc.net.au
1 abella.net
1 adsf.com
1 alko.com.br
1 amandaledsham.plus.com
1 americanapparel.net
1 annomedia.com
1 asd.pt
1 audiothru.com
1 austin.rr.com
1 basslinejack.com
1 berkeley.edu
1 bertg.be
1 blackbaud.com
1 blueorchidarts.com
1 bluethumbproductions.com
1 blueyonder.co.uk
1 bscdi.org
1 btopenworld.com
1 califaudio.com
1 captain-obvious.de
1 carolina.rr.com
1 cd6.so-net.ne.jp
1 celticblues.com
1 centrum.cz
1 cfl.rr.com
1 charlestaylor.co.uk
1 christian-mail.zzn.com
1 chvnx.com
1 cinci.rr.com
1 cmu.edu
1 cn.edu
1 columbia.edu
1 comments.com
1 cosh.nl
1 cranky.ca
1 crestlinesoaring.org
1 cruzerrf.com
1 cruzio.com
1 cs.dal.ca
1 csusb.edu
1 d00m.com
1 damnhandy.com
1 defsf.com
1 diegostocco.com
1 djpsmusicmix.com
1 djshoxy.com
1 eircom.net
1 email.it
1 eskimo.com
1 excite.com
1 farmland.de
1 fiu.edu
1 fl.net.au
1 flamefireshows.com
1 flamestitch.com
1 fortasse.org
1 freetube.uni.cc
1 fsmail.net
1 fsu.edu
1 gipsymedia.com
1 girlzdealz.com
1 gmx.at
1 gmx.com
1 gmx.net
1 goetzit.com
1 gozo.com
1 groc.org
1 grudaemmim.com.br
1 gym-muttenz.educanet2.ch
1 hampshire.edu
1 hiltonius.com
1 hot.ee
1 hotmail.fr
1 ikmultimedia.com
1 inaudible-visions.net
1 inbox.com
1 indiana.edu
1 instantdogma.net
1 intouch.adam2.org
1 ispaul.com
1 itofkc.com
1 jakuza.de
1 jhu.edu
1 jimandrada.com
1 jns18.com
1 jon.com
1 jowersinc.com
1 karlsruhe.hu
1 kefcorp.net
1 kidsloveguns.com
1 kingston.net
1 l-rs.org
1 lelab.tv
1 lgnshow.com
1 libero.it
1 live.nl
1 logicsmith.com
1 lpbroadband.net
1 lycos.com
1 mailin8r.com
1 manx.net
1 maui.net
1 me.com
1 mediaroach.com
1 melbpc.org.au
1 memolinkcorp.com
1 meuspartum.com
1 michaelboland.ca
1 mmi-agency.com
1 mtu.edu
1 my.sanjuancollege.edu
1 myway.com
1 narod.ru
1 nerif.com
1 neuf.fr
1 no.com
1 nocc.net
1 noise.io
1 noiseaddicts.com
1 noisenik.com
1 noisetrade.com
1 noos.fr
1 nucleus.com
1 nuim.ie
1 o2.pl
1 oddstrument.com
1 optonline.net
1 orange.fr
1 pandora.be
1 pcsites.com
1 pdogrecords.com
1 pinnacleitdev.com
1 pobox.com
1 pomona.edu
1 protype.com
1 ptolserv.com
1 pyccmaui.org
1 re-mix.de
1 reckon.ws
1 recursor.net
1 rediffmail.com
1 reforma.si
1 rice.edu
1 rolfguild.org
1 sdmaus.com
1 sennfelder.de
1 shunra.co.za
1 silcom.com
1 smashbase.com
1 sound.net
1 spectorbass.com
1 student.gla.ac.uk
1 student.wpunj.edu
1 studioguitar.com
1 suddenlink.net
1 supercable.net.ve
1 swoop.otherinbox.com
1 sympatico.ca
1 tcsi.pt
1 tedtedted.com
1 telenet.be
1 terryjackson.us
1 thecellstudio.com
1 thetafreq.com
1 theyachtforsale.com
1 timeinc.com
1 timothyandrew.net
1 tiscali.co.uk
1 tom.com
1 tommunch.com
1 topmail.co.za
1 tpg.com.au
1 transmit.net
1 unstoppablex.com
1 upf.edu
1 upyourego.com
1 ussnomad.org
1 utk.edu
1 vcu.edu
1 vegasbuzznews.com
1 vektor57.com
1 verizon.net
1 videotron.ca
1 virgin.net
1 vision-webs.com
1 wanadoo.fr
1 wanadoo.nl
1 waterfuel.ws
1 well.com
1 wenzler.us
1 westcoastplasma.ca
1 westofeastmusic.com
1 whitelabel-music.co.uk
1 willphalen.com
1 wonko.info
1 worldbid.com
1 xennexinc.com
1 xmission.com
1 xpressblinds.net
1 yahoo.co.id
1 yahoo.co.in
1 yahoo.com.cn
1 yahoo.com.hk
1 yahoo.fr
1 yahoo.gr
1 yes.com
1 zenme.info
736 Deferrals -------------------------------------------------------------------------------
586 4.4.1: Transient failure: Network & routing status: No answer from host
74 4.2.1: Transient failure: Mailbox status: Mailbox disabled, not accepting messages
36 4.4.2: Transient failure: Network & routing status: Bad connection
27 4.4.3: Transient failure: Network & routing status: Routing server failure
8 4.0.0: Transient failure: Other/Undefined status: Other undefined status
3 4.1.8: Transient failure: Addressing status: Bad sender's system address
1 4.3.5: Transient failure: Mail system status
1 4.7.0: Transient failure: Security/policy status: Temporary authentication failure
142 Bounced (local) -------------------------------------------------------------------------
117 5.4.4: Permanent failure: Network & routing status: Unable to route
25 5.1.1: Permanent failure: Addressing status: Bad destination mailbox address
334 Bounced (remote) ------------------------------------------------------------------------
239 5.1.1: Permanent failure: Addressing status: Bad destination mailbox address
69 5.0.0: Permanent failure: Other/Undefined status: Other undefined status
15 5.2.1: Permanent failure: Mailbox status: Mailbox disabled, not accepting messages
9 5.7.1: Permanent failure: Security/policy status: Delivery not authorized, message ...
1 5.3.0: Permanent failure: Mail system status: Other/Undefined mail system status
1 5.4.1: Permanent failure: Network & routing status: No answer from host
24 Notifications sent ----------------------------------------------------------------------
24 Non-delivery
894 Connection failure (outbound) -----------------------------------------------------------
544 Connection refused
338 Connection timed out
11 Refused to talk to me
1 No route to host
8 Timeout (inbound) -----------------------------------------------------------------------
8 While receiving the initial server greeting
12 MX errors -------------------------------------------------------------------------------
8 No MX host has a valid address record
4 Malformed domain name in resource data of MX record
13 Numeric hostname ------------------------------------------------------------------------
13 Resource data of MX record
6 Hostname verification errors ------------------------------------------------------------
4 Name or service not known
2 Address not listed for hostname
4 Hostname validation errors --------------------------------------------------------------
4 empty hostname
5 PIX workaround enabled ------------------------------------------------------------------
5 disable_esmtp delay_dotcrlf
======================================================================================================================
Delays Percentiles 0% 25% 50% 75% 90% 95% 98% 100%
----------------------------------------------------------------------------------------------------------------------
1: Pre qmgr 0.000 0.890 1.900 3.000 49198.000 57410.000 61309.000 81353.000
2: In qmgr 0.000 0.280 3.400 16.000 37.000 42.000 48.000 235.000
3: Connection setup 0.000 0.040 0.140 0.620 21.000 21.000 33.200 604.000
4: Xmit time 0.000 0.000 0.540 6.100 16.000 194.000 206.000 268.000
======================================================================================================================
---------------------- Postfix End -------------------------
--------------------- SSHD Begin ------------------------
Failed logins from:
125.77.107.212: 19 times
root/password: 19 times
Illegal users from:
125.77.107.212: 1 time
shit: 1 time
Users logging in through sshd:
root:
66.183.188.57: 3 times
SFTP subsystem requests: 1 Time(s)
**Unmatched Entries**
pam_env(sshd:setcred): Unable to open env file: /etc/default/locale: No such file or directory : 6 time(s)
---------------------- SSHD End -------------------------
--------------------- Disk Space Begin ------------------------
Filesystem Size Used Avail Use% Mounted on
/dev/xvda 16G 880M 15G 6% /
---------------------- Disk Space End -------------------------
###################### Logwatch End #########################