Нет доступа по SSH Fedora 16

Тема в разделе "Администрирование серверов", создана пользователем casinolot, 27 дек 2012.

Модераторы: mefish, stooper
  1. casinolot

    casinolot

    Регистр.:
    22 окт 2010
    Сообщения:
    548
    Симпатии:
    84
    Вчера лёг сервер под Fedora 16.
    Некоторое время очень сильно всё тормозило но сайт еще как-то грузился.
    Потом появилась ошибка вебсервера nginx
    пинговал, все нормально.
    Пытался зайти через putty дает ввести логин и потом все запустилось.
    Перезагрузили всё нормально, но вопрос почем так и остался, пока вариант что сервер базы данных лёг, но вопрос, почему же тогда лег и вебсервер и подсоединится нельзя было и пинг был.
     
  2. swdns

    swdns Создатель

    Регистр.:
    22 сен 2007
    Сообщения:
    32
    Симпатии:
    12
    ответ 100% в логах смотрите логи apache, nginx, mysql, а то гадать можно до бесконечности.
     
  3. casinolot

    casinolot

    Регистр.:
    22 окт 2010
    Сообщения:
    548
    Симпатии:
    84
    вот логи запросов
    Код:
    202.51.198.114 - - [23/Dec/2012:18:01:25 -0800] "POST /pma/scripts/setup.php HTTP/1.1" 404 36 "50.56.194.203" "Mozilla/4.0 (compatible; MSIE 6.0; MSIE 5.5; Windows NT 5.1) Opera 7.01 [en]"
    202.51.198.114 - - [23/Dec/2012:18:01:25 -0800] "-" 400 0 "-" "-"
    141.212.121.10 - - [24/Dec/2012:04:07:00 -0800] "-" 400 0 "-" "-"
    216.240.147.167 - - [24/Dec/2012:16:00:54 -0800] "GET /w00tw00t.at.ISC.SANS.DFind:) HTTP/1.1" 400 166 "-" "-"
    118.218.219.206 - - [25/Dec/2012:02:17:32 -0800] "GET /admin/config.php HTTP/1.1" 499 0 "-" "Python-urllib/2.4"
    118.218.219.206 - - [25/Dec/2012:02:17:37 -0800] "GET /admin/config.php HTTP/1.1" 404 36 "-" "Python-urllib/2.4"
    66.249.73.53 - - [25/Dec/2012:03:00:47 -0800] "GET /robots.txt HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.73.53 - - [25/Dec/2012:03:06:12 -0800] "GET /robots.txt HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    193.33.237.205 - - [25/Dec/2012:03:29:31 -0800] "GET /w00tw00t.at.ISC.SANS.DFind:) HTTP/1.1" 400 166 "-" "-"
    66.249.73.53 - - [25/Dec/2012:09:33:30 -0800] "GET /robots.txt HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.73.53 - - [25/Dec/2012:12:29:37 -0800] "GET /robots.txt HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.73.53 - - [25/Dec/2012:15:59:34 -0800] "GET /robots.txt HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.73.53 - - [25/Dec/2012:16:00:36 -0800] "GET /site/contact HTTP/1.1" 504 176 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.76.230 - - [26/Dec/2012:23:06:54 -0800] "GET /robots.txt HTTP/1.1" 404 1369 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.76.230 - - [26/Dec/2012:23:06:54 -0800] "GET /merchant/register HTTP/1.1" 200 3673 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    66.249.76.230 - - [26/Dec/2012:23:21:15 -0800] "GET /site/contact HTTP/1.1" 200 2613 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +[url]http://www.google.com/bot.html[/url])"
    
    Видно что был бот, и какая-то школота сканила в попытках найти phpMyadmin
    вот логи ошибок
    Код:
    2012/12/23 18:01:24 [error] 8198#0: *27859 FastCGI sent in stderr: "Unable to open primary script: /srv/www/29Club//phpadmin/scripts/setup.php (No such file or directory)" while reading response header from upstream, client: 202.51.198.114, server: dev.29clubsports.com, request: "POST /phpadmin/scripts/setup.php HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "50.56.194.203", referrer: "50.56.194.203"
    2012/12/23 18:01:25 [error] 8198#0: *27881 FastCGI sent in stderr: "Unable to open primary script: /srv/www/29Club//pma/scripts/setup.php (No such file or directory)" while reading response header from upstream, client: 202.51.198.114, server: dev.29clubsports.com, request: "POST /pma/scripts/setup.php HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "50.56.194.203", referrer: "50.56.194.203"
    2012/12/25 02:17:37 [error] 8198#0: *28206 FastCGI sent in stderr: "Unable to open primary script: /srv/www/29Club//admin/config.php (No such file or directory)" while reading response header from upstream, client: 118.218.219.206, server: dev.29clubsports.com, request: "GET /admin/config.php HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "50.56.194.203"
    2012/12/25 03:00:47 [error] 8198#0: *28208 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /robots.txt HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    2012/12/25 03:06:12 [error] 8198#0: *28210 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /robots.txt HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    2012/12/25 09:33:30 [error] 8198#0: *28218 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /robots.txt HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    2012/12/25 12:29:37 [error] 8198#0: *28220 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /robots.txt HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    2012/12/25 15:59:34 [error] 8198#0: *28226 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /robots.txt HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    2012/12/25 16:00:36 [error] 8198#0: *28226 upstream timed out (110: Connection timed out) while reading response header from upstream, client: 66.249.73.53, server: dev.29clubsports.com, request: "GET /site/contact HTTP/1.1", upstream: "fastcgi://127.0.0.1:9000", host: "dev.29clubsports.com"
    
    Видно по последним запросам что сервер лёг.

    самое интересное что я вот нашёл, как я понял из-за недостатка памяти убивались процессы ядра.
    Код:
    ec 26 01:55:23 (none) kernel: [14290814.294267] sshd invoked oom-killer: gfp_mask=0x44d0, order=2, oom_adj=0, oom_score_adj=0
    Dec 26 01:55:23 (none) kernel: [14290814.294288] sshd cpuset=/ mems_allowed=0
    Dec 26 01:55:23 (none) kernel: [14290814.294296] Pid: 13043, comm: sshd Not tainted 3.1.0-7.fc16.x86_64 #1
    Dec 26 01:55:23 (none) kernel: [14290814.294303] Call Trace:
    Dec 26 01:55:23 (none) kernel: [14290814.294317]  [<ffffffff8109ba6f>] ? cpuset_print_task_mems_allowed+0x91/0x9d
    Dec 26 01:55:23 (none) kernel: [14290814.294330]  [<ffffffff810e0b84>] dump_header+0x80/0x1c1
    Dec 26 01:55:23 (none) kernel: [14290814.294340]  [<ffffffff8100727f>] ? xen_restore_fl_direct_reloc+0x4/0x4
    Dec 26 01:55:23 (none) kernel: [14290814.294350]  [<ffffffff81085d93>] ? arch_local_irq_restore+0xb/0xd
    Dec 26 01:55:23 (none) kernel: [14290814.294360]  [<ffffffff814b5d64>] ? _raw_spin_unlock_irqrestore+0x17/0x19
    Dec 26 01:55:23 (none) kernel: [14290814.294370]  [<ffffffff810e0f3c>] oom_kill_process+0x50/0x246
    Dec 26 01:55:23 (none) kernel: [14290814.294379]  [<ffffffff810e1645>] out_of_memory+0x314/0x35d
    Dec 26 01:55:23 (none) kernel: [14290814.294388]  [<ffffffff810e5627>] __alloc_pages_nodemask+0x5ee/0x71d
    Dec 26 01:55:23 (none) kernel: [14290814.294397]  [<ffffffff81006ce5>] ? xen_force_evtchn_callback+0xd/0xf
    Dec 26 01:55:23 (none) kernel: [14290814.294407]  [<ffffffff814af14e>] kmalloc_large_node+0x56/0x87
    Dec 26 01:55:23 (none) kernel: [14290814.294416]  [<ffffffff8111afe7>] __kmalloc_node_track_caller+0x32/0x12b
    Dec 26 01:55:23 (none) kernel: [14290814.294425]  [<ffffffff813c999d>] ? sock_alloc_send_pskb+0xb4/0x2d7
    Dec 26 01:55:23 (none) kernel: [14290814.294434]  [<ffffffff813cd468>] __alloc_skb+0x75/0x133
    Dec 26 01:55:23 (none) kernel: [14290814.294441]  [<ffffffff81006ce5>] ? xen_force_evtchn_callback+0xd/0xf
    Dec 26 01:55:23 (none) kernel: [14290814.294449]  [<ffffffff813c999d>] sock_alloc_send_pskb+0xb4/0x2d7
    Dec 26 01:55:23 (none) kernel: [14290814.294459]  [<ffffffff814501c5>] ? scm_set_cred+0x47/0x4f
    Dec 26 01:55:23 (none) kernel: [14290814.294467]  [<ffffffff813c9bd5>] sock_alloc_send_skb+0x15/0x17
    Dec 26 01:55:23 (none) kernel: [14290814.294475]  [<ffffffff814512d3>] unix_stream_sendmsg+0x11e/0x2ec
    Dec 26 01:55:23 (none) kernel: [14290814.294484]  [<ffffffff813c5e99>] sock_aio_write+0x10f/0x123
    Dec 26 01:55:23 (none) kernel: [14290814.294493]  [<ffffffff810fbc07>] ? handle_pte_fault+0x299/0x77c
    Dec 26 01:55:23 (none) kernel: [14290814.294502]  [<ffffffff811289bf>] do_sync_write+0xbf/0xff
    Dec 26 01:55:23 (none) kernel: [14290814.294510]  [<ffffffff81005e99>] ? xen_write_cr3+0x5e/0x62
    Dec 26 01:55:23 (none) kernel: [14290814.294519]  [<ffffffff811dbd02>] ? security_file_permission+0x2e/0x33
    Dec 26 01:55:23 (none) kernel: [14290814.294527]  [<ffffffff81128ddf>] ? rw_verify_area+0xb0/0xcd
    Dec 26 01:55:23 (none) kernel: [14290814.294535]  [<ffffffff81129071>] vfs_write+0xb3/0xf3
    Dec 26 01:55:23 (none) kernel: [14290814.294542]  [<ffffffff81129259>] sys_write+0x4a/0x6e
    Dec 26 01:55:23 (none) kernel: [14290814.294551]  [<ffffffff814bc482>] system_call_fastpath+0x16/0x1b
    Dec 26 01:55:23 (none) kernel: [14290814.294558] Mem-Info:
    Dec 26 01:55:23 (none) kernel: [14290814.294562] Node 0 DMA per-cpu:
    Dec 26 01:55:23 (none) kernel: [14290814.294569] CPU    0: hi:    0, btch:   1 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294576] CPU    1: hi:    0, btch:   1 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294582] CPU    2: hi:    0, btch:   1 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294587] CPU    3: hi:    0, btch:   1 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294593] Node 0 DMA32 per-cpu:
    Dec 26 01:55:23 (none) kernel: [14290814.294599] CPU    0: hi:  186, btch:  31 usd:  60
    Dec 26 01:55:23 (none) kernel: [14290814.294605] CPU    1: hi:  186, btch:  31 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294611] CPU    2: hi:  186, btch:  31 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294617] CPU    3: hi:  186, btch:  31 usd:   0
    Dec 26 01:55:23 (none) kernel: [14290814.294627] active_anon:1054 inactive_anon:1114 isolated_anon:18
    Dec 26 01:55:23 (none) kernel: [14290814.294628]  active_file:19 inactive_file:111 isolated_file:21
    Dec 26 01:55:23 (none) kernel: [14290814.294630]  unevictable:10671 dirty:17 writeback:1032 unstable:0
    Dec 26 01:55:23 (none) kernel: [14290814.294631]  free:28685 slab_reclaimable:161828 slab_unreclaimable:41983
    Dec 26 01:55:23 (none) kernel: [14290814.294632]  mapped:29 shmem:17 pagetables:3709 bounce:0
    Dec 26 01:55:23 (none) kernel: [14290814.294652] Node 0 DMA free:4004kB min:52kB low:64kB high:76kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:13780kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:6792kB slab_unreclaimable:3220kB kernel_stack:16kB pagetables:4kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
    Dec 26 01:55:23 (none) kernel: [14290814.294683] lowmem_reserve[]: 0 992 992 992
    Dec 26 01:55:23 (none) kernel: [14290814.294695] Node 0 DMA32 free:110736kB min:4000kB low:5000kB high:6000kB active_anon:4216kB inactive_anon:4456kB active_file:76kB inactive_file:444kB unevictable:42684kB isolated(anon):72kB isolated(file):84kB present:1016064kB mlocked:0kB dirty:68kB writeback:4128kB mapped:116kB shmem:68kB slab_reclaimable:640520kB slab_unreclaimable:164712kB kernel_stack:1272kB pagetables:14832kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:13992 all_unreclaimable? yes
    Dec 26 01:55:23 (none) kernel: [14290814.294728] lowmem_reserve[]: 0 0 0 0
    Dec 26 01:55:23 (none) kernel: [14290814.294740] Node 0 DMA: 41*4kB 46*8kB 29*16kB 22*32kB 4*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4004kB
    Dec 26 01:55:23 (none) kernel: [14290814.294767] Node 0 DMA32: 15163*4kB 6223*8kB 4*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 110788kB
    Dec 26 01:55:23 (none) kernel: [14290814.294794] 12688 total pagecache pages
    Dec 26 01:55:23 (none) kernel: [14290814.294800] 1892 pages in swap cache
    Dec 26 01:55:23 (none) kernel: [14290814.294805] Swap cache stats: add 137474067, delete 137472175, find 70751713/106389453
    Dec 26 01:55:23 (none) kernel: [14290814.294812] Free swap  = 1833256kB
    Dec 26 01:55:23 (none) kernel: [14290814.294817] Total swap = 2096476kB
    Dec 26 01:55:23 (none) kernel: [14290814.295020] 262128 pages RAM
    Dec 26 01:55:23 (none) kernel: [14290814.295020] 8002 pages reserved
    Dec 26 01:55:23 (none) kernel: [14290814.295020] 433 pages shared
    Dec 26 01:55:23 (none) kernel: [14290814.295020] 224759 pages non-shared
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [ pid ]   uid  tgid total_vm      rss cpu oom_adj oom_score_adj name
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  280]     0   280     4310        1   0     -17         -1000 udevd
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  304]     0   304     5803        0   0       0             0 systemd-stdout-
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  435]     0   435     3497        1   0       0             0 xe-daemon
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  439]     0   439    22822        0   0     -17         -1000 auditd
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  442]     0   442     1608        0   3       0             0 acpid
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  468]     0   468     9029        0   0       0             0 systemd-logind
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  551]    81   551     5434        2   0     -13          -900 dbus-daemon
    Dec 26 01:55:23 (none) kernel: [14290814.295020] [  559]     0   559    63077        0   0       0             0 rsyslogd
    Dec 26 01:55:23 (none) kernel: [14290814.301481] [  580]   998   580     4893        0   0       0             0 chronyd
    Dec 26 01:55:23 (none) kernel: [14290814.301491] [  844]     0   844    18861        0   0     -17         -1000 sshd
    Dec 26 01:55:23 (none) kernel: [14290814.301500] [  845]     0   845     4793        0   0       0             0 rpcbind
    Dec 26 01:55:23 (none) kernel: [14290814.301509] [  852]     0   852     5211       23   1       0             0 nova-agent
    Dec 26 01:55:23 (none) kernel: [14290814.301519] [  882]     0   882     5300        0   0       0             0 atd
    Dec 26 01:55:23 (none) kernel: [14290814.301528] [  888]     0   888    27232        1   0       0             0 agetty
    Dec 26 01:55:23 (none) kernel: [14290814.301537] [  892]     0   892    27232        1   2       0             0 agetty
    Dec 26 01:55:23 (none) kernel: [14290814.301547] [ 1015]     0  1015    32819       19   0       0             0 sshblack.pl
    Dec 26 01:55:23 (none) kernel: [14290814.301561] [24675]     0 24675    21971        0   0       0             0 master
    Dec 26 01:55:23 (none) kernel: [14290814.301570] [24678]    89 24678    22041        1   1       0             0 qmgr
    Dec 26 01:55:23 (none) kernel: [14290814.301580] [24784]    89 24784    22015        0   0       0             0 tlsmgr
    Dec 26 01:55:23 (none) kernel: [14290814.301590] [26121]     0 26121    66528       47   0       0             0 /usr/bin/spamd 
    Dec 26 01:55:23 (none) kernel: [14290814.301600] [26128]     0 26128    66528        0   0       0             0 spamd child
    Dec 26 01:55:23 (none) kernel: [14290814.301609] [26129]     0 26129    66528        0   0       0             0 spamd child
    Dec 26 01:55:23 (none) kernel: [14290814.301619] [14870]     0 14870    29599        0   0       0             0 crond
    Dec 26 01:55:23 (none) kernel: [14290814.301629] [14910]    29 14910     6939        0   2       0             0 rpc.statd
    Dec 26 01:55:23 (none) kernel: [14290814.301639] [14919]     0 14919     6938        0   1       0             0 rpc.idmapd
    Dec 26 01:55:23 (none) kernel: [14290814.301648] [ 4124]     0  4124     3836        0   2       0             0 newrelic-daemon
    Dec 26 01:55:23 (none) kernel: [14290814.301659] [ 4126]     0  4126   208224        0   0       0             0 newrelic-daemon
    Dec 26 01:55:23 (none) kernel: [14290814.301669] [ 7084]     0  7084    83967        2   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.301678] [32453]   999 32453    87701        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.301687] [ 8197]     0  8197    24664        0   0       0             0 nginx
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 8198]   999  8198    25015        0   0       0             0 nginx
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [32209]    27 32209    29106        0   0       0             0 mysqld_safe
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [32561]     0 32561     4309        0   0     -17         -1000 udevd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [32562]     0 32562     4309        0   0     -17         -1000 udevd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 1164]     0  1164    16635        0   3       0             0 ssh-agent
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 1444]     0  1444    16635        0   2       0             0 ssh-agent
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 1469]     0  1469    16635        0   1       0             0 ssh-agent
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 8561]     0  8561    16635        0   0       0             0 ssh-agent
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 8857]     0  8857    16635        0   3       0             0 ssh-agent
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11948]   999 11948    85754       34   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11950]   999 11950    87732        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11951]   999 11951    85115        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11953]   999 11953    85853        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11954]   999 11954    87541      113   1       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11955]   999 11955    85434        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11956]   999 11956    85116        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [30628]     0 30628    20236        0   0       0             0 sshd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [30629]    74 30629    19201        0   0       0             0 sshd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [10110]   999 10110    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [11182]     0 11182     3725        0   0       0             0 anacron
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [14086]     0 14086     2905        1   0       0             0 run-parts
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [14129]     0 14129     2905        0   0       0             0 man-db.cron
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [14130]     0 14130     2334        0   0       0             0 awk
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [14142]     0 14142     4344        0   0       0             0 mandb
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 7656]   999  7656    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [13043]     0 13043    20236        0   0       0             0 sshd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [13044]    74 13044    19201        0   0       0             0 sshd
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [14144]   999 14144    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [22266]   999 22266    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [25413]   999 25413    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [28172]   999 28172    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [29114]   999 29114    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 2803]   999  2803    83967        0   0       0             0 php-fpm
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 2839]    27  2839   185319       31   0       0             0 mysqld
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 4969]    89  4969    22050        6   0       0             0 smtp
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 5280]    89  5280    22034        0   0       0             0 cleanup
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 5484]    89  5484    21996        0   0       0             0 pickup
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 5693]    89  5693    22007        0   0       0             0 bounce
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 6070]    89  6070    21998        2   1       0             0 trivial-rewrite
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 6075]    89  6075    22007        0   0       0             0 bounce
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 6124]     0  6124     1069        0   0       0             0 sleep
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 6126]     0  6126    40726        0   0       0             0 crond
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [ 6127]     0  6127    61154       20   0       0             0 php
    Dec 26 01:55:23 (none) kernel: [14290814.302464] [B]Out of memory: Kill process 2839 (mysqld) score 12 or sacrifice child[/B]
    [B]Dec 26 01:55:23 (none) kernel: [14290814.302464] Killed process 2839 (mysqld) total-vm:741276kB, anon-rss:124kB, file-rss:0kB[/B]
    Dec 26 01:55:24 (none) mysqld_safe[32209]: /usr/bin/mysqld_safe: line 144:  2839 Killed                  nohup /usr/libexec/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --log-error=/var/log/mysqld.log --pid-file=/var/run/mysqld/mysqld.pid --socket=/var/lib/mysql/mysql.sock < /dev/null >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1 >> /var/log/mysqld.log 2>&1
    Dec 26 01:55:27 (none) mysqld_safe[32209]: 121225 17:55:26 mysqld_safe Number of processes running now: 0
    Dec 26 01:55:27 (none) mysqld_safe[32209]: 121225 17:55:27 mysqld_safe mysqld restarted
    


    Я также понял, что скорее всего заработал OOM Killer и поубивал в том числе и sshd процесс доступа к серверу