Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Forum locked  This topic is locked, you cannot edit posts or make further replies.
Author Message
PostPosted: Fri Oct 26, 2007 11:18 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
Lassie - Linode Autonomous System Shutdown Intelligent rEbooter

Lassie is a shutdown watchdog. It will automatically reboot your Linode if it powers off unexpectedly. It works by detecting that your Linode has powered off without a shutdown job being responsible for the power off condition. To prevent a loop, it will give up after 5 boots have occurred within a 15 minute period.

It's enabled by default, but the setting can be changed on the Lassie page, located off of the new Utilities sub-tab.

A side effect of this is that now "reboot" from inside your Linode will function as expected, but a "shutdown" from inside your Linode will result in Lassie kicking in and issuing a boot. Previously both of those commands resulted in a shutdown. I can't win :). A work-around for this is to issue a shutdown job via Lish, by creating an alias for "shutdown" to do: "ssh LinodeUsername@hostXX.linode.com shutdown".

Notifications via email are planned.

Enjoy!
-Chris


Top
   
PostPosted: Fri Oct 26, 2007 2:13 pm 
Offline
Senior Member

Joined: Sun Nov 30, 2003 2:28 pm
Posts: 245
caker wrote:
A side effect of this is that now "reboot" from inside your Linode will function as expected, but a "shutdown" from inside your Linode will result in Lassie kicking in and issuing a boot. Previously both of those commands resulted in a shutdown. I can't win :).


For what it's worth, I think this a better default. I might reboot from inside the linode to make sure new libraries are in use, or just invoke the nostalgia of my WIndows day, but the only reason I shutdown is to re-arrange disks or somesuch, which I'm going to be doing from the Web UI anyway.

_________________
The irony is that Bill Gates claims to be making a stable operating system and Linus Torvalds claims to be trying to take over the world.
-- seen on the net


Top
   
PostPosted: Fri Oct 26, 2007 7:19 pm 
Offline
Senior Member

Joined: Fri Feb 18, 2005 4:09 pm
Posts: 594
caker wrote:
Lassie - Linode Autonomous System Shutdown Intelligent rEbooter

Lassie is a shutdown watchdog.


Since it's almost Halloween, please rename it to:

Linode Autonomous System Shutdown Intelligent rEbooter agEnt And TimER (LASSIE EATER)

James


Top
   
 Post subject:
PostPosted: Fri Oct 26, 2007 7:28 pm 
Offline
Junior Member

Joined: Sat May 05, 2007 8:53 pm
Posts: 49
I'm a little curious -- have shutdowns been a problem?

I've been on Linode since '04, and mine has never gone down on its own.

I'm not trying to diss a new and valuable feature -- but is it solving a problem that people actually have?


Top
   
 Post subject:
PostPosted: Fri Oct 26, 2007 8:01 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
astrashe3 wrote:
I'm a little curious -- have shutdowns been a problem?

Definitely not widespread. But, Linux has bugs from time to time, and so does UML. It's just a nice thing to have, rather than having your Linode go down 5 minutes after you go to bed, and not knowing about it until you get up the next morning. This also solves the "It's been 2 years since I've logged into linode.com, lost my password, the email address you have for me no longer works, and I typed reboot in my Linode and it didn't come back up" issues (because I hack UML to shutdown on "reboot" so it'll pick up any config changes between boots).

-Chris


Top
   
PostPosted: Sun Oct 28, 2007 6:49 am 
Offline
Senior Member

Joined: Thu Apr 15, 2004 3:18 am
Posts: 52
Website: http://www.rumble.net/
Location: London, UK
I got a pretty major problem when I went to resize my main drive with the new disk space we've just been given. Lassie started booting before it finished and pretty nastily barfed the drive.

Lassie should check that another job isn't already running before forcing a boot!


Top
   
 Post subject:
PostPosted: Sun Oct 28, 2007 10:18 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
Lassie doesn't boot your Linode -- it just queues up a boot job. Jobs run one after another. And, the resize jobs *should* still be checking that your volume isn't in use before doing anything... I'll have a look at the logs.

-Chris


Top
   
 Post subject:
PostPosted: Sun Oct 28, 2007 11:26 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
OK, I found, and squashed a bug. It was a race. We use the pid file that UML writes out in determining if a Linode is running or not. It turns out that UML doesn't immediately write this file. If another job ran just after the Linode booted and then checked to see if the Linode was active, it would not find the pid file and assume it was ok to do its thing.

Now boot jobs wait a few seconds, while checking to see if UML wrote out its pid file, before completing.

This bug has been in here for a LONG time (way before Lassie), so I'm grateful to you for reporting this, but sorry it ended up in your filesystem being munched on a bit.

Regards,
-Chris


Top
   
 Post subject:
PostPosted: Sun Oct 28, 2007 4:18 pm 
Offline
Senior Member

Joined: Thu Apr 15, 2004 3:18 am
Posts: 52
Website: http://www.rumble.net/
Location: London, UK
caker wrote:
This bug has been in here for a LONG time (way before Lassie), so I'm grateful to you for reporting this, but sorry it ended up in your filesystem being munched on a bit.


That's cool. It seems to have e2fscked without any real problems. My only issue now is that the Linode dashboard reports the fs as 20 gigs but inside the linode it's still 16 gigs. I suspect it might need some manual command-line hackery to get it back in shape, but not sure where to start.

Feel free to bring my linode down if you think you can resize it to its proper size. Otherwise, any ideas on how to do it?


Top
   
 Post subject:
PostPosted: Sun Oct 28, 2007 4:30 pm 
Offline
Senior Member

Joined: Sun Nov 30, 2003 2:28 pm
Posts: 245
Try shrinking it to 16G (or 15G) and then re-enlarging? Also, what does fdisk show for the partition size? It's possible that the partition got enlarged, but not the file
system. If that's the case, then you should be able to enlarge the file system from within the linode.

_________________
The irony is that Bill Gates claims to be making a stable operating system and Linus Torvalds claims to be trying to take over the world.

-- seen on the net


Top
   
 Post subject:
PostPosted: Mon Oct 29, 2007 9:05 pm 
Offline
Senior Member

Joined: Thu Apr 15, 2004 3:18 am
Posts: 52
Website: http://www.rumble.net/
Location: London, UK
SteveG wrote:
Try shrinking it to 16G (or 15G) and then re-enlarging?


That did the trick. Thanks!


Top
   
Display posts from previous:  Sort by  
Forum locked  This topic is locked, you cannot edit posts or make further replies.


Who is online

Users browsing this forum: No registered users and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group