Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
 Post subject: Re: QoS baby!
PostPosted: Tue Sep 14, 2004 10:48 pm 
Offline
Senior Member

Joined: Fri Aug 06, 2004 5:49 pm
Posts: 158
caker wrote:
The ideal situation is that the limiter is set with sky-high values, and only buckles down when it's time to share or a Linode is behaving badly.

...

My goals are that swap-thrashing Linodes are given lower-throughput values automatically, to eliminate the useless limiting of good behaving Linodes, and to always have a small supply of I/O bandwidth available for the host itself.

-Chris


That would definately be the best solution.


Top
   
 Post subject: IO-nice
PostPosted: Wed Sep 15, 2004 6:34 am 
Offline
Senior Member

Joined: Sat Dec 13, 2003 12:39 pm
Posts: 98
I agree an important goal will be for the Host IO usage to be optimal. Like caker said, no point in limiting IO for one linode when no other linodes need IO and there is plenty available.

But also I think more needs to be done to manage IO within one Linode. Perhaps this is a general Llinux issue and not just UML/Linode related. The thing is it's much much more important in a linode context where resources are shared. Again I am a happy camper here at Linode, but I just wanted to bring it up as an area for posisble improvement from my point of view. If I were a kernel programmer, I would do it myself and suggest the patch for inclusion, but I'm not. Before the IO Token patch, IO was a problem, and now with the patch, it's much better, but it's not ideal.

From my point of view, ideal would be being able to prioritize IO usage somehow, like CPU usage can be prioritized with nice. The bottom line is, this would produce a situation where you could have services running on hardware that was cheaper than before. There are physical hardware limits, of course, and there are software limits that can be changed once and implemented on many many servers for no additional cost (assuming open source etc). The postgres example is a case where software improvements in managing IO usage would cause me to absolutely not need a more expensive server. I know the IO capability is in the hardware, but the software side isn't able to manage it such that I can be confident enough to run that service on the same machine as an app server.

Getting the prioritization I'm after might be very hard. I say that because, to do it right, postgres itself would have to tag each IO request, for example distinguishing very low priority maintenance IO from high priority queries for web apps. But it would also involve UML, which is why I'm posting it here.


Top
   
 Post subject:
PostPosted: Wed Sep 15, 2004 2:43 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
What you're asking for *does* exist. It's part of the CFQ I/O scheduler.

http://kerneltrap.org/node/view/1596

This patch has been in mainline for the past few 2.6 kernel versions, however I've never been able to get ionice to work.

My suggestion to you is to wait until the next release of UML (2.6.9) and we'll give CFQ and ionice inside UML a shot.

-Chris


Top
   
 Post subject: cool
PostPosted: Thu Sep 16, 2004 12:45 am 
Offline
Senior Member

Joined: Sat Dec 13, 2003 12:39 pm
Posts: 98
Thanks, that sounds great to me. I will be looking forward to that improvement and IO bucket improvements. I didn't know an ionice patch existed, I just named the thread that cuz it sounded like a logical name.


Top
   
 Post subject: QOS BABY...
PostPosted: Wed Mar 16, 2005 5:30 am 
Offline
Senior Member
User avatar

Joined: Tue Aug 17, 2004 11:37 pm
Posts: 262
Website: http://www.our-lan.com
WLM: nf@our-lan.com
Location: Brisbane, Australia
So im corious to know if this ever got implemented or if its just one of those things that was kewl, but never got arround to happening

cheers


Top
   
 Post subject: Re: QOS BABY...
PostPosted: Wed Mar 16, 2005 12:31 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
Internat wrote:
So im corious to know if this ever got implemented or if its just one of those things that was kewl, but never got arround to happening

Yup. All the latest cfq-ts (CFQ TimeSliced) patches have the IO-nice support. It's just that cfq-ts isn't included in the vanilla kernel as of yet.

I've been holding up 2.6.11-um because of issues with porting the token-limiter to it, but I'll add cfq-ts to the list of additional patches when I build it.

-Chris


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group