Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
PostPosted: Wed Jan 01, 2014 4:25 pm 
Offline
Senior Newbie

Joined: Wed Jan 01, 2014 4:16 pm
Posts: 5
Hey there,

So for the past few months I've had 100% uptime, however in the past 2 days there was consecutive downtime on my Linode. I know absolutely nothing about load balancing or failovers, but it sounds like I need some sort of failover put in place, so that in the event that my Linode goes down in the future, my traffic can automatically be redirected to another VPS which I can configure myself to transform into the "master" until my linode comes back online.

I suppose I could easily buy managed VPS hosting elsewhere such as from Amazon or from Lumous and let them worry about keeping the VPS afloat, but I would rather learn how to set up a failsafe sort of system myself.

Hypothetically, if I have 2 VPSes (1 linode and 1 other linux VPS from somewhere else), is there a reasonably cheap/easy way to get a failsafe working? If not, what other options do I have for protecting myself against downtime such as I've experienced in the past several days?

Thanks!


Top
   
PostPosted: Thu Jan 02, 2014 2:21 am 
Offline
Senior Member
User avatar

Joined: Wed Mar 17, 2004 4:11 pm
Posts: 554
Website: http://www.unixtastic.com
Location: Europe
Automatic failover is hard. There are lots of ways to do it and they are all complicated and liable to cause downtime themselves if not implemented perfectly. They also vary from service to service. What works for incoming mail won't work for outgoing mail or web. Having two VPS's instead of one also doubles your costs.

It should be far easier to make your Linode more stable. I've seen uptimes of years on linodes as have many other people on this board. The only time I reboot is to resize file systems, upgrade my OS, or take advantage of upgrades.

What's causing the downtime? That should be fixed.
What services do you want to protect anyway?


Top
   
PostPosted: Thu Jan 02, 2014 12:21 pm 
Offline
Senior Newbie

Joined: Wed Jan 01, 2014 4:16 pm
Posts: 5
I was not told what was the exact problem, it was nothing running on my linode and it was out of my hands (the most I was told was there were hardware problems). Each time they shut off my node they make an "emergency ticket" and apologized, it's happened frequently since I purchased my linode this past August/July...

If I cannot determine a good failover method at linode for apache and mysql then I'll likely cancel my account here and go with another company. Mostly the fact that two days in a row there were two issues on my linode really worries me. The Linode support is great, but they can't do anything to guarantee better uptime.

Here's a record of all the downtime:

http://davzy.com/screenshots/Screen_Sho ... 122720.png

Each of those downtimes were out of my hands (so a problem with Linode itself), with the exception of the one I've put a star by. Whenever it goes down they sometimes offer me $5 credits. $5 is nice but doesn't do anything when the service is offline.

This poor uptime isn't worth the money I pay per month. I've looked at DigitalOcean and a few friends who buy VPSes there have shown that they have better uptime than I've had with linode, and they pay 1/4th of what I pay at linode. I've asked linode if they'll give me a monthly discount and they've refused (which is ironic because if they gave me even $5 a month, I would be willing to throw them an extra $40 for a balancer and second node). I might as well buy several VPSes from DigitalOcean in this case, or go with a company like https://lumous.io/ who offers 100% uptime and then compensation, and when their services go down they (apparently) automatically move nodes to a different server that's online, so that downtime is very small, whereas you can see from my image, on day 2 of downtime with linode I was down for 1 and 1/2 hours.


Top
   
PostPosted: Thu Jan 02, 2014 1:14 pm 
Offline
Senior Member
User avatar

Joined: Sun Dec 27, 2009 11:12 pm
Posts: 1038
Location: Colorado, USA
FYI - Lumous.io (2048M, 2Core, 95G = $108.04/month) is about 2.5x the price of Linode, so 100% uptime guarantee is obviously an expense most people don't need or are unwilling to pay for in a VPS service.

_________________
Either provide enough details for people to help, or sit back and listen to the crickets chirp.
Security thru obscurity is a myth - and really really annoying.


Top
   
PostPosted: Thu Jan 02, 2014 2:05 pm 
Offline
Senior Member
User avatar

Joined: Tue May 26, 2009 3:29 pm
Posts: 1691
Location: Montreal, QC
Linode in general has a very good reliability record; it seems that you just got unlucky and were put on an unreliable host machine. I've had between one and three linodes (currently two) for nearly five years now, and I haven't had a single emergency maintenance ticket. That's not to say I haven't had rare unexpected downtime, such as the time the primary and backup power failed at a datacenter, or that time Linode's infrastructure went nuts, but I think there have only been two or three such incidents that have affected me in five years.


Top
   
PostPosted: Thu Jan 02, 2014 2:54 pm 
Offline
Senior Newbie

Joined: Wed Jan 01, 2014 4:16 pm
Posts: 5
Guspaz wrote:
Linode in general has a very good reliability record; it seems that you just got unlucky and were put on an unreliable host machine. I've had between one and three linodes (currently two) for nearly five years now, and I haven't had a single emergency maintenance ticket. That's not to say I haven't had rare unexpected downtime, such as the time the primary and backup power failed at a datacenter, or that time Linode's infrastructure went nuts, but I think there have only been two or three such incidents that have affected me in five years.


Do you mind telling me where your linodes that have never been down are located? The last Linode could do (I should think) is put me on a service with better uptime, after the uptime disaster I've had to endure.

vonskippy wrote:
FYI - Lumous.io (2048M, 2Core, 95G = $108.04/month) is about 2.5x the price of Linode, so 100% uptime guarantee is obviously an expense most people don't need or are unwilling to pay for in a VPS service.


If I want constant uptime I would need from linode: 2 linodes and 1 balancer. That's $60 a month and I'm cool paying it. However, I could get a basic managed VPS from Lumous for $40 for the better uptime then that makes more sense, especially considering that I wouldn't need to modify my back end to work clustered, and that I'd get more than $5 back when I experience multiple long downtimes (which would also happen fewer times). That's why I asked for a discount at Linode. After the bad uptime with them, and the cheaper better service elsewhere I would of thought they'd of given me atleast some sort of discount and then I wouldn't of minded spending even more money at linode as opposed to switching, but no dice. If I only ever experienced one downtime with linode I wouldn't be making a fuss, but I've experienced many outages now, 2 outages less than 24 hours apart where one was over an hour is hugely upsetting.


Top
   
PostPosted: Thu Jan 02, 2014 3:05 pm 
Offline
Senior Member

Joined: Mon Jul 05, 2010 5:13 pm
Posts: 392
reditr wrote:
The last Linode could do (I should think) is put me on a service with better uptime, after the uptime disaster I've had to endure.


If this were possible, we'd already be doing it for everybody. If we identify an issue that could cause future problems, we schedule maintenance in the future and alert affected users. If an issue occurs that we could not have seen coming, then we need to do emergency maintenance, as you've experienced. As part of the maintenance, our administrators assess whether we've corrected the issue, and if we believe there will be further instability we migrate Linodes off that host onto other hardware.

Unfortunately, statistically speaking some people will have periods of really bad luck. We do everything we can to detect issues proactively and fix them without affecting Linodes, but that isn't possible for all cases.

- Les


Top
   
PostPosted: Thu Jan 02, 2014 3:06 pm 
Offline
Senior Member

Joined: Sun May 23, 2010 1:57 pm
Posts: 315
Website: http://www.jebblue.net
My uptime has been exceptional at Linode just as an FYI.


Top
   
PostPosted: Thu Jan 02, 2014 4:33 pm 
Offline
Senior Newbie

Joined: Wed Jan 01, 2014 4:16 pm
Posts: 5
akerl wrote:
reditr wrote:
The last Linode could do (I should think) is put me on a service with better uptime, after the uptime disaster I've had to endure.


If this were possible, we'd already be doing it for everybody. If we identify an issue that could cause future problems, we schedule maintenance in the future and alert affected users. If an issue occurs that we could not have seen coming, then we need to do emergency maintenance, as you've experienced. As part of the maintenance, our administrators assess whether we've corrected the issue, and if we believe there will be further instability we migrate Linodes off that host onto other hardware.

Unfortunately, statistically speaking some people will have periods of really bad luck. We do everything we can to detect issues proactively and fix them without affecting Linodes, but that isn't possible for all cases.

- Les


Even your reply here comes off to me as somewhat of a dodge. You are acknowledging that your service has been poor yet you are implicitly telling me to further endure this poor service. If my "bad luck" is an exception as you say, then you should have no problems offering to move me to a more historically stable server and offering me a slight monthly discount. For one instance of "bad luck" such actions should be extremely minor for you to do. The fact that neither of these things have been done really make me wonder how much linode cares about its customers, or what people think about linode's services in general.

If I pay linode an excess of money in contrast to what I'd be spending at other companies then I expect a better service. Your testimonials are mostly all excellent, and I have no problem paying the linode prices for this excellent service. Statistically since the conception of my account at linode however, I have yet to experience these levels of standards that are worthy of what I'm paying, and so for a subpar service I'd be better suited to switch companies and obtain that same subpar service for a fraction of the cost.

Once again, your technical support are friendly, and I greatly applaud your efforts towards making your service well received by your customers as proven by the excellent testimonials by many of your users. What I have a problem with is that I am an unfortunate example of where your service has been unsatisfactory, and I feel that I have been swept under a rug. The one day one occurrence of 35 minute downtime I could have forgiven, however the 90 minutes of downtime I fell victim to not 24 hours after is both unacceptable due to the repetition of downtime as well as the duration. Especially considering that this second downtime directly followed a previous downtime, and that the time to fix the second downtime was lengthy, I'm not sure why I wasn't immediately contacted and offered to be moved to another node. This would certainly have been a viable option for me especially considering that the size of my node is rather miniscule. But instead, the only solution I was given is that I should be appeased with a $5 coupon and that I throw you guys almost $500 more a year for load balancing to mitigate all this downtime.

Please consider that I have only been your customer for a small number of months, and I have had to endure 4-5 long periods of downtime, when I am paying you 400% more than your competitors, yet the only advice I am given is to spend $500 to implement a failover system myself. I'm not even asking you to price-match your competitors (who also comparatively to my linode have better uptime), but I am asking you to provide me with some solution or even some reason to stay with linode when I'm faced with such indifference to my unreliable experiences here.


Top
   
PostPosted: Thu Jan 02, 2014 5:57 pm 
Offline
Senior Member
User avatar

Joined: Tue May 26, 2009 3:29 pm
Posts: 1691
Location: Montreal, QC
reditr wrote:
Do you mind telling me where your linodes that have never been down are located? The last Linode could do (I should think) is put me on a service with better uptime, after the uptime disaster I've had to endure.


All of these linodes are in Newark. I would also reinforce that it's not the case that I've never had downtime, just that I've never suffered a host-specific failure. I was using the fact that I've had on average two linodes for five years and have never received an emergency maintenance mail to illustrate the point that your downtime has been due to bad luck. That said, Newark has traditionally been a pretty reliable datacentre. Fremont, for its part, had a long period of poor reliability, although I believe Linode switched to a different datacentre in Fremont since those issues.


Top
   
PostPosted: Thu Jan 02, 2014 7:51 pm 
Offline
Senior Member
User avatar

Joined: Fri Oct 24, 2003 3:51 pm
Posts: 965
Location: Netherlands
Your experience is exceptional. I have had a Linode in Fremont for over 10 years. In that time, I have suffered two outages due to power failure and two migrations when host servers began to fail. For you to have had as many troubles as you have in such a short period really is out of the ordinary.

_________________
/ Peter


Top
   
PostPosted: Thu Jan 02, 2014 8:07 pm 
Offline
Senior Member

Joined: Sun May 23, 2010 1:57 pm
Posts: 315
Website: http://www.jebblue.net
pclissold wrote:
Your experience is exceptional. I have had a Linode in Fremont for over 10 years. In that time, I have suffered two outages due to power failure and two migrations when host servers began to fail. For you to have had as many troubles as you have in such a short period really is out of the ordinary.


Seconded.


Top
   
PostPosted: Thu Jan 02, 2014 8:28 pm 
Offline
Senior Member
User avatar

Joined: Sun Dec 27, 2009 11:12 pm
Posts: 1038
Location: Colorado, USA
You're bummed at your Linode experience, so move. Random failure is not unique to Linode, so hopefully you'll land on the right side of the bell curve at your next provider - if not, give Linode another shot, just use a different location.

_________________
Either provide enough details for people to help, or sit back and listen to the crickets chirp.
Security thru obscurity is a myth - and really really annoying.


Top
   
PostPosted: Fri Jan 03, 2014 10:53 am 
Offline
Senior Newbie
User avatar

Joined: Wed Feb 29, 2012 7:49 pm
Posts: 11
reditr wrote:
akerl wrote:
reditr wrote:
The last Linode could do (I should think) is put me on a service with better uptime, after the uptime disaster I've had to endure.


If this were possible, we'd already be doing it for everybody. If we identify an issue that could cause future problems, we schedule maintenance in the future and alert affected users. If an issue occurs that we could not have seen coming, then we need to do emergency maintenance, as you've experienced. As part of the maintenance, our administrators assess whether we've corrected the issue, and if we believe there will be further instability we migrate Linodes off that host onto other hardware.

Unfortunately, statistically speaking some people will have periods of really bad luck. We do everything we can to detect issues proactively and fix them without affecting Linodes, but that isn't possible for all cases.

- Les


Even your reply here comes off to me as somewhat of a dodge. You are acknowledging that your service has been poor yet you are implicitly telling me to further endure this poor service. If my "bad luck" is an exception as you say, then you should have no problems offering to move me to a more historically stable server and offering me a slight monthly discount. For one instance of "bad luck" such actions should be extremely minor for you to do. The fact that neither of these things have been done really make me wonder how much linode cares about its customers, or what people think about linode's services in general.

If I pay linode an excess of money in contrast to what I'd be spending at other companies then I expect a better service. Your testimonials are mostly all excellent, and I have no problem paying the linode prices for this excellent service. Statistically since the conception of my account at linode however, I have yet to experience these levels of standards that are worthy of what I'm paying, and so for a subpar service I'd be better suited to switch companies and obtain that same subpar service for a fraction of the cost.

Once again, your technical support are friendly, and I greatly applaud your efforts towards making your service well received by your customers as proven by the excellent testimonials by many of your users. What I have a problem with is that I am an unfortunate example of where your service has been unsatisfactory, and I feel that I have been swept under a rug. The one day one occurrence of 35 minute downtime I could have forgiven, however the 90 minutes of downtime I fell victim to not 24 hours after is both unacceptable due to the repetition of downtime as well as the duration. Especially considering that this second downtime directly followed a previous downtime, and that the time to fix the second downtime was lengthy, I'm not sure why I wasn't immediately contacted and offered to be moved to another node. This would certainly have been a viable option for me especially considering that the size of my node is rather miniscule. But instead, the only solution I was given is that I should be appeased with a $5 coupon and that I throw you guys almost $500 more a year for load balancing to mitigate all this downtime.

Please consider that I have only been your customer for a small number of months, and I have had to endure 4-5 long periods of downtime, when I am paying you 400% more than your competitors, yet the only advice I am given is to spend $500 to implement a failover system myself. I'm not even asking you to price-match your competitors (who also comparatively to my linode have better uptime), but I am asking you to provide me with some solution or even some reason to stay with linode when I'm faced with such indifference to my unreliable experiences here.


+1

I think this is a very reasonable perspective that you have here. I'm very interested to see Linode's response to this.

Just an FYI: my experience with Linode has been exemplary; zero downtime.


Top
   
PostPosted: Fri Jan 03, 2014 11:02 am 
Offline
Senior Member

Joined: Mon Jul 05, 2010 5:13 pm
Posts: 392
reditr wrote:
If my "bad luck" is an exception as you say, then you should have no problems offering to move me to a more historically stable server and offering me a slight monthly discount. For one instance of "bad luck" such actions should be extremely minor for you to do. The fact that neither of these things have been done really make me wonder how much linode cares about its customers, or what people think about linode's services in general.


The point I was attempting to make is that this isn't an effective solution to the problem of unexpected downtime. Because we monitor proactively for potential issues, and correct issues whenever possible before they cause downtime for Linodes, and schedule maintenance where that cannot be done without some downtime, the remaining issues are those which could not be predicted. They are just as likely to affect a "historically stable" host as one that had another issue a few days prior. As such, migrating you to such a host doesn't affect future emergency maintenance.

With regard to reimbursement, we do have an SLA, and we give credit when that SLA is not met. The credit is based on the amount of downtime experienced; we don't provide persistent discounts on the basis of a temporary issue.

- Les


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: Dweeber and 2 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group