Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
 Post subject:
PostPosted: Fri Jun 18, 2010 8:11 pm 
Offline
Senior Member

Joined: Wed May 13, 2009 1:18 am
Posts: 681
bji wrote:
I have thought about making a really good S3 bucket mounting filesystem for Linux. Then I could have lots of cheap off-Linode storage, and use the local Linode hard drive as a file cache for the most frequently accessed files and as a write cache. (...)

I periodically think of trying to incorporate S3 for some aspects of my storage, but each time I look I conclude that it's not really all that cheap, once I take into account costs for actually performing updates. Though a much more static read-only long term storage would probably still be good.

BTW, you may already have seen this, but the last time I considered it again, I was intrigued by s3backer (http://code.google.com/p/s3backer/) and its design as a pure block storage device, rather than some of the other filesystem-approaches. And it can leverage local disk as a cache perhaps similarly to how you are thinking.

Of course, as a block device you may also risk heavier I/O charges compared to something that manages the S3 buckets differently, but there are some knobs to help with that as well.

-- David


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 8:42 pm 
Offline
Senior Member

Joined: Mon Oct 15, 2007 3:11 pm
Posts: 78
Website: http://www.avongauss.com
Location: Boynton Beach, FL
Maybe it's just me, but I see everybody doing comparisons to how much it costs to purchase a particular physical drive. Unless things have changed, isn't that really just a small part of the equation of putting a hard disk or storage in to a data center for online access?


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 8:57 pm 
Offline
Senior Member
User avatar

Joined: Sat Aug 30, 2008 1:55 pm
Posts: 1739
Location: Rochester, New York
bji wrote:
But I prefer to keep that money in my kids' college funds and have Linode suck it up and BUY SOME BIGGER DISKS!!! :x


I think the point we're trying to make, and that you're not quite getting, is that they don't make bigger disks. The release date on the 600 GB drive I mentioned was September 2009, so most of the drives out there are probably 300 or 450 GB.

Linode probably isn't going to spend $2000/server plus downtime to replace the disks in hundreds upon hundreds of servers with the same model of hard drive at the same time, either.


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 10:07 pm 
Offline
Senior Member

Joined: Thu Aug 28, 2003 12:57 am
Posts: 273
hoopycat wrote:
bji wrote:
But I prefer to keep that money in my kids' college funds and have Linode suck it up and BUY SOME BIGGER DISKS!!! :x


I think the point we're trying to make, and that you're not quite getting, is that they don't make bigger disks. The release date on the 600 GB drive I mentioned was September 2009, so most of the drives out there are probably 300 or 450 GB.

Linode probably isn't going to spend $2000/server plus downtime to replace the disks in hundreds upon hundreds of servers with the same model of hard drive at the same time, either.


OK, then, I would also be happy with fast-ish local network storage, that someone else pointed out as a possibility. What is the reason that that couldn't be done?


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 10:14 pm 
Offline
Senior Member
User avatar

Joined: Sun Dec 27, 2009 11:12 pm
Posts: 1038
Location: Colorado, USA
bji wrote:
What is the reason that that couldn't be done?

Um.....money?

Although this thread has seen reasonable action for this forum, nobody else has chimed in with a "me too, I need more storage".

I don't think the average VPS/LINODE user needs mass storage, and for the few that do (like you), it's not worth the capital investment (and maintenance, and management, and monitoring, and accounting) for Linode to provide such a service.

If Linode thought they could make a profit, don't you think they'd already be discussing the Storage Rollout Plans?


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 10:35 pm 
Offline
Senior Member

Joined: Thu Aug 28, 2003 12:57 am
Posts: 273
vonskippy wrote:
bji wrote:
What is the reason that that couldn't be done?

Um.....money?

Although this thread has seen reasonable action for this forum, nobody else has chimed in with a "me too, I need more storage".

I don't think the average VPS/LINODE user needs mass storage, and for the few that do (like you), it's not worth the capital investment (and maintenance, and management, and monitoring, and accounting) for Linode to provide such a service.

If Linode thought they could make a profit, don't you think they'd already be discussing the Storage Rollout Plans?


I guess I never really thought of myself and my usage of Linode as not being part of the target market ... I started my Linode in 2003 and I never really realized that its target audience grew into the group that you referenced.

So I guess that Linode may not, in fact, be ideally suited for me after all if that is the case. I am not sure what my alternatives are, though. Like I said, perhaps I should just get out of hosting my own stuff. "Vanity" web sites and photo galleries are pretty "2000's" I suppose in this day and age of Facebook and other social media sites. I guess I should just roll with the times and accept that hosting your own server just isn't as prevalent as it used to be.


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 11:16 pm 
Offline
Junior Member

Joined: Mon Feb 22, 2010 9:40 pm
Posts: 37
People have a good point here - that 10 cents a gigabyte is for 7200RPM drives, not the 15K ones linode uses.

Maybe you would be better off doing your mass storage somewhere that uses cheaper drives if performance isn't as much of an issue.


Top
   
 Post subject:
PostPosted: Fri Jun 18, 2010 11:24 pm 
Offline
Senior Member
User avatar

Joined: Tue Apr 13, 2004 6:54 pm
Posts: 833
FWIW, when I joined in 2004 I had a linode 64 with 3Gb disk (+1.5Gb free for yearly). Now I have 512 with 16Gb (+8Gb free - grandfathered plan). So memory has increased 8-fold and disk 5.3-fold.

I think that says more about how technology has changed; my non-scientific gut-feeling is that memory prices have dropped quicker than disk.

However I do think linode need to be careful; 512Mb of RAM is a massive amount for $20/month. It's more than some real-colo solutions provided a couple of years ago! People might start expecting physical server type resources as a result, which is clearly wrong - it's just a virtual server. Expectation management is key to customer happiness and linode may raise false expectations by providing so much memory.

Not that I'm complaining :-)

_________________
Rgds
Stephen
(Linux user since kernel version 0.11)


Top
   
 Post subject:
PostPosted: Sat Jun 19, 2010 12:16 am 
Offline
Senior Member

Joined: Sat Jun 12, 2010 4:53 pm
Posts: 77
SAS drives are crazy expensive.

http://www.newegg.com/Product/ProductLi ... AS%206Gb/s


Top
   
 Post subject:
PostPosted: Sat Jun 19, 2010 1:12 am 
Offline
Junior Member

Joined: Sun Apr 17, 2005 4:19 pm
Posts: 41
Reminds me of some guys at work who don't understand why we can't just buy a $100 SATA harddrive from newegg whenever one of the servers need more space.

That being said, I'm tight on space on one of three Linodes and I'm starting to look into S3 to store less frequently accessed media files.


Top
   
 Post subject:
PostPosted: Sat Jun 19, 2010 8:07 am 
Offline
Senior Member

Joined: Fri Sep 21, 2007 4:12 pm
Posts: 78
vonskippy wrote:
Although this thread has seen reasonable action for this forum, nobody else has chimed in with a "me too, I need more storage".


Eh, why not.

Me too, I need more storage (and I'm too cheap to purchase more!) :)


Top
   
 Post subject:
PostPosted: Sat Jun 19, 2010 11:32 am 
Offline
Senior Member

Joined: Sun Mar 07, 2010 7:47 pm
Posts: 1970
Website: http://www.rwky.net
Location: Earth
More storage might be nice but not essential I use aws for any big stuff that needs hosting, the only thing I'd like more disk space for is mysql storage since I can't really CDN that. But I'm still happy with what we have since I'm pretty sure linode's disks are top notch in speed so size will be smaller, I've been with other hosting companies (both managed and unmanaged) and they've never had the IO performance of linode.


Top
   
 Post subject:
PostPosted: Sat Jun 19, 2010 7:09 pm 
Offline
Senior Newbie

Joined: Sat May 29, 2010 2:48 pm
Posts: 5
Location: Cambs, UK
I'll add a +1 for more storage.

That said I too have looked into S3, and implemented Persistentfs mapping an S3 bucket back to my Linode, sym linking it as a directory.

Not a very efficient workaround, I have to account for bandwidth in and out and the resultant latency.

But it got me around a space issue for a download manager that I find a little bit perplexing (I'm using IPB Download manager for a hobby site) and doesn't make using a CDN easy for a fledgling php'er like me.

But the RAM upgrade is most welcome!


Top
   
 Post subject:
PostPosted: Sun Jun 20, 2010 9:11 am 
Offline
Senior Member

Joined: Wed May 13, 2009 1:32 pm
Posts: 737
Location: Italy
personally I prefer the RAM and the 15K RPM to a bigger disk running at 7200 RPM.
If they will give us more disk space by downgrading to 7200K I think that I will not be happy.
Think also that only 16Gb of disk space requires only 60$ for a 4 slots backup and this is another plus for me.

$0.02


Top
   
PostPosted: Sun Jun 20, 2010 10:39 pm 
Offline
Junior Member

Joined: Wed Apr 28, 2010 10:33 pm
Posts: 41
bji wrote:
Stever wrote:
bji wrote:
In August 2003, when Linode first started, hard drives cost about $2 per gigabyte. Today they cost around 10 cents per gigabyte. That means that the raw cost of hard drive space has gone down by a factor of 200 in that time.

Ummm, $2.00 / $0.10 = 20, not 200.

Doesn't seem like they are all that far off your expectations.


Gah, you're right. Something did seem pretty unexpected about those numbers when I wrote them, but it was late and, I'm kind of bad at math.


This. Maybe you could edit your first post to correct this and try to improve your argument. (I assume we can edit past posts here).

While the move from 1GB to 16GB in those years is good, I agree with you, BTW, that it would be good to have more disk space, provided that - given the elite RAID 10 and 15k etc hardware - I wouldn't want Linode to skimp in other areas, particularly customer service.


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 4 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group