Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
PostPosted: Fri Jun 05, 2015 1:53 pm 
Offline

Joined: Sat Sep 01, 2012 1:59 pm
Posts: 1
Two different linodes using similar images OS (Centos 7) - both rebooting exactly at 12:00 midnight each day. We have other Linodes using exact same images and settings and not doing this. These are lamp stacks using different CMS's.

Log Files - /var/log/secure and /var/log/messages do not indicate any cause

SECURE
Jun 2 23:55:01 account-name systemd: Started Session 462 of user root.
Jun 3 00:00:01 account-name systemd: Created slice user-0.slice.
Jun 3 00:00:01 account-name systemd: Starting Session 463 of user root.

MESSAGES
Jun 2 23:34:38 account-name sshd[8574]: Failed password for invalid user root from 222.186.21.182 port 4853 ssh2
Jun 3 00:01:01 account-name sshd[1690]: Received signal 15; terminating.
Jun 3 00:01:45 account-name polkitd[1466]: Loading rules from directory /etc/polkit-1/rules.d

CRON
Jun 4 23:53:01 account-name CROND[10210]: (root) CMD (/usr/lib64/sa/sa2 -A)
Jun 4 23:55:01 account-name CROND[10222]: (root) CMD (/root/monitors/monitorDB.sh > /dev/null 2>&1)
Jun 5 00:00:01 account-name CROND[10236]: (root) CMD (/root/monitors/monitorDB.sh > /dev/null 2>&1)
Jun 5 00:00:01 account-name CROND[10237]: (root) CMD (/usr/local/bin/automysqlbackup/runmysqlbackup)
Jun 5 00:00:01 account-name CROND[10238]: (root) CMD (/usr/lib64/sa/sa1 1 1)
Jun 5 00:02:02 account-name crond[1434]: (CRON) INFO (RANDOM_DELAY will be scaled with factor 11% if used.)
Jun 5 00:02:02 account-name crond[1434]: (CRON) INFO (running with inotify support)
Jun 5 00:05:01 account-name CROND[2440]: (root) CMD (/root/monitors/monitorDB.sh > /dev/null 2>&1)
Jun 5 00:10:01 account-name CROND[2450]: (root) CMD (/root/monitors/monitorDB.sh > /dev/null 2>&1)


There are three cron jobs (same as other limnodes - no issues)

# Rotate Logs
1) 0 2 * * * /usr/sbin/logrotate /etc/logrotate.conf > /dev/null 2>&1

# Backup Project At Regular Intervals
2) 41 22 1,15 * * /home/<account-name>/www/account-name_backup.sh

# Reboot Linode if Database Goes Down
3) */6 * * * * /root/monitors/monitorDB.sh > /dev/null 2>&1

==========

What next??

Thanks - John


Top
   
PostPosted: Fri Jun 05, 2015 7:18 pm 
Offline
Senior Member

Joined: Fri Feb 13, 2015 8:12 pm
Posts: 101
Reboot Linode if Database Goes Down??

You should not need that. At most, you would restart the database itself, not the entire system, but in either case there is something fundamentally wrong in your system if your database goes down and you have to restart the database by hand.

For example, make sure that your system has enough RAM and swap for your database to run and disable the Out Of Memory killer (search for "OOM killer")

I would insert a line like this one:
Code:
logger DB down, rebooting system

in the /root/monitors/monitorDB.sh script and the next time your system reboots you will be able to know, by looking at /var/log, whether your script was the reason for the reboot or not.


Top
   
PostPosted: Fri Jun 05, 2015 8:14 pm 
Offline
Senior Newbie
User avatar

Joined: Mon Mar 30, 2015 8:17 pm
Posts: 7
Website: http://technical.silverglass.org/
Location: San Diego, CA
Have you checked the host job queue in Linode Manager for those systems? If for instance Lassie is initiating a reboot, the reason should show up there.


Top
   
PostPosted: Mon Jun 22, 2015 1:22 am 
Offline
Junior Member
User avatar

Joined: Mon Jun 22, 2015 12:55 am
Posts: 30
Website: http://iserversupport.com/
Please check /var/log/cron log and make sure no other jobs are running which initiate the reboot

_________________
Server Management with 24x7 monitoring
http://iserversupport.com/on-demand/


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 5 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group