Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
 Post subject: Linode SAN
PostPosted: Tue Jun 25, 2013 6:08 am 
Offline
Senior Newbie

Joined: Fri Aug 24, 2012 10:00 am
Posts: 5
I'm sure this comes up every so often, but right now in order to do shared storage between Linodes you need to use DRBD, which works but it's a bit clunky and given the relatively high price of Linode's storage (understandable given how Linodes work) it's also a bit painful in that you have to have (in total) twice as much storage as you actually need (or N times as much if you have N linodes sharing it).

It’d be great if Linode offered a SAN product. I'm fairly sure that a lot of Linode's customers want features that are more easily provided by a SAN-based offering (such as redundancy, scalability, online provisioning/resize, the ability to share storage across a cloud of Linodes without DRBD ), and most of us are not likely to be worried about a small amount of extra latency in exchange.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jun 25, 2013 8:05 am 
Offline
Senior Member

Joined: Sun Mar 07, 2010 7:47 pm
Posts: 1970
Website: http://www.rwky.net
Location: Earth
You don't have to use DRBD, you could use NFS or GlusterFS.

_________________
Paid support
How to ask for help
1. Give details of your problem
2. Post any errors
3. Post relevant logs.
4. Don't hide details i.e. your domain, it just makes things harder
5. Be polite or you'll be eaten by a grue


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jun 25, 2013 9:37 am 
Offline
Senior Member

Joined: Fri Nov 02, 2012 4:20 pm
Posts: 60
We use NFS, but I'd love to swap that out for some kind of Linode provided, redundant, network storage. Scalability would be something else we'd like. I don't normally need a server with more than 2 Gigs of RAM, but I often need one with more than 48 Gigs of space.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jul 12, 2013 5:14 am 
Offline
Senior Newbie

Joined: Fri Aug 24, 2012 10:00 am
Posts: 5
obs wrote:
You don't have to use DRBD, you could use NFS or GlusterFS.


You could use NFS or GlusterFS, but neither of those provide any redundancy. A Linode-provided SAN system would, as tubaguy50035 says, provide a scalable redundant solution that could be used for data storage as well as allowing for shared access from multiple Linodes.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jul 12, 2013 5:43 am 
Offline
Senior Member

Joined: Sun Mar 07, 2010 7:47 pm
Posts: 1970
Website: http://www.rwky.net
Location: Earth
GlusterFS does provide redundancy you can replicate across multiple servers if one dies the other can still serve.

_________________
Paid support
How to ask for help
1. Give details of your problem
2. Post any errors
3. Post relevant logs.
4. Don't hide details i.e. your domain, it just makes things harder
5. Be polite or you'll be eaten by a grue


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jul 16, 2013 4:36 pm 
Offline
Senior Member
User avatar

Joined: Wed Mar 17, 2004 4:11 pm
Posts: 554
Website: http://www.unixtastic.com
Location: Europe
tubaguy50035 wrote:
We use NFS, but I'd love to swap that out for some kind of Linode provided, redundant, network storage. Scalability would be something else we'd like. I don't normally need a server with more than 2 Gigs of RAM, but I often need one with more than 48 Gigs of space.


Linode is great for things that fit on a Linode sized machine but it loses out on flexibility like this. Can you re-engineer your applications to use some form of cloud storage like s3 instead of local disk?


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jul 16, 2013 4:45 pm 
Offline
Senior Member

Joined: Fri Nov 02, 2012 4:20 pm
Posts: 60
sednet wrote:
Linode is great for things that fit on a Linode sized machine but it loses out on flexibility like this. Can you re-engineer your applications to use some form of cloud storage like s3 instead of local disk?


Of course we COULD!

Our storage needs are normally database related. Big databases, not a lot of use. So we have several big powerful linodes, that we hardly use (except storage). We've talked about hosting them elsewhere but we're worried about latency.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jul 16, 2013 5:17 pm 
Offline
Senior Member
User avatar

Joined: Wed Mar 17, 2004 4:11 pm
Posts: 554
Website: http://www.unixtastic.com
Location: Europe
tubaguy50035 wrote:
sednet wrote:
Linode is great for things that fit on a Linode sized machine but it loses out on flexibility like this. Can you re-engineer your applications to use some form of cloud storage like s3 instead of local disk?


Of course we COULD!

Our storage needs are normally database related. Big databases, not a lot of use. So we have several big powerful linodes, that we hardly use (except storage). We've talked about hosting them elsewhere but we're worried about latency.



I phrased that badly. I meant could you re-engineer your applications to use some form of cloud storage reasonably easily and in such a way they would still work acceptably? If you are using big SQL databases that's not going to be easy.

Flexible storage is something that would really rock, but people have been asking for it for years and it has never happened. Now Linode has a kick-ass network it should be possible to add a few iSCSI or NFS servers to each site.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jul 16, 2013 5:26 pm 
Offline
Senior Member

Joined: Fri Nov 02, 2012 4:20 pm
Posts: 60
sednet wrote:
I phrased that badly. I meant could you re-engineer your applications to use some form of cloud storage reasonably easily and in such a way they would still work acceptably? If you are using big SQL databases that's not going to be easy.

Flexible storage is something that would really rock, but people have been asking for it for years and it has never happened. Now Linode has a kick-ass network it should be possible to add a few iSCSI or NFS servers to each site.


Again, we could. It still ends up being easier for us to have it all at Linode.

I know people have been asking for a while. Hopefully you're right about the new network helping out.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Tue Jul 30, 2013 3:53 am 
Offline
Senior Member

Joined: Sat May 03, 2008 4:01 pm
Posts: 567
Website: http://www.mattnordhoff.com/
I'm not convinced of that -- sharing a couple gigabits per host is not spectacular for storage usage.

_________________
Matt Nordhoff (aka Peng on IRC)


Top
   
 Post subject: Re: Linode SAN
PostPosted: Wed Jan 08, 2014 11:09 pm 
Offline
Senior Newbie

Joined: Wed Jan 08, 2014 11:01 pm
Posts: 9
Thread revival!

I have been a Linode customer for 4 years now, and have been very happy with the service, but need more storage (big plus if it's redundant, but I do have offsite backup anyways), and Linode doesn't offer it. I need about 150GB of storage, but don't need much RAM and CPU at all, so it doesn't make sense to pay $80/mo, when I can get redundant and very flexible storage on AWS for $30/mo.

I have no choice but to switch to AWS, only reason being they have EBS.

It's something that's very easy for Linode to do, and would probably help keeping a lot of customers.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jan 10, 2014 6:51 am 
Offline
Senior Member
User avatar

Joined: Wed Mar 17, 2004 4:11 pm
Posts: 554
Website: http://www.unixtastic.com
Location: Europe
One netapps filer and the integration scripting that goes with it would get decent NFS storage to anyone who wants to pay for it. Netapps may lend Linode a play filer at no cost if Linode ask nicely. Or there is the cheap route of building NFS servers yourself.

It's unknown how many customers would pay for more storage though.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jan 10, 2014 6:58 am 
Offline
Senior Newbie

Joined: Wed Jan 08, 2014 11:01 pm
Posts: 9
Yeah there are a million ways they can do this, and none of them is really difficult.

I definitely would pay for it if reasonably priced (ie. not $40/mo for 96GB).

Building one myself is not really an option. It has to be at Linode with high bandwidth tubes to the VPSes. Of course, using another Linode is not an option either (way too expensive just for storage).

I actually tried using Amazon S3 with S3QL on my Linode before deciding to switch. It's just too slow, and too complicated. At that point it's much easier to switch the whole thing to AWS.


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jan 10, 2014 3:41 pm 
Offline
Senior Member

Joined: Tue Apr 27, 2004 5:10 pm
Posts: 212
matthewlai wrote:
Yeah there are a million ways they can do this, and none of them is really difficult.


Have you ever operated at the scale Linode is operating at?

I assure you, this sort of thing is most definitely **not** simple nor inexpensive to implement well.

_________________
Image


Top
   
 Post subject: Re: Linode SAN
PostPosted: Fri Jan 10, 2014 3:43 pm 
Offline
Senior Newbie

Joined: Wed Jan 08, 2014 11:01 pm
Posts: 9
Sure, there are challenges. But difficulty is relative. Implementing this sort of thing at the scale is much easier than implementing many other things they have already implemented at the scale.


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 3 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group