Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
PostPosted: Wed Nov 24, 2004 12:32 pm 
Offline
Newbie

Joined: Wed Nov 24, 2004 11:37 am
Posts: 3
so bare with me... I'm just learning about this IO limits function of UML.

This all came to my attention when our linode on server host6 seemed to suffer from lack of being able to get to disk. After digging around the forums it appears that I'm not the only person seeing this issue and it seems that linodes can have different Token_refill and token_max values.

I've read that some people can have a token_refill=100 for being a hassle and using too much IO ... then later to have it set to a higher limit after someone deeming it appropriate to do so. Did this happen to me? If so… no big deal… but I want to avoid having issues with Disk IO and if I need to change something, knowing that I have been a problem with Disk IO, would help me understand that I have an issue that needs further attention..

My linode at this time shows this, which shows that it’s a lower amount then other linodes. (Again I don’t know anything about this stuff... so lower numbers could be indeed better... who knows!!?)

Quote:
io_count=888185 io_rate=0 io_tokens=19989 token_refill=100 token_max=20000



I guess I have 2 more questions.

1. How does it get decided what values are used for our linode?

2. How do I know that I've surpassed “appropriate" disk IO usage?

Thanks for any light you could shed on this.
Doubleg


Top
   
PostPosted: Wed Nov 24, 2004 12:45 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
doubleg wrote:
so bare with me... I'm just learning about this IO limits function of UML.

More info here: http://www.theshore.net/~caker/patches/

doubleg wrote:
This all came to my attention when our linode on server host6 seemed to suffer from lack of being able to get to disk. After digging around the forums it appears that I'm not the only person seeing this issue and it seems that linodes can have different Token_refill and token_max values.

I've read that some people can have a token_refill=100 for being a hassle and using too much IO ... then later to have it set to a higher limit after someone deeming it appropriate to do so. Did this happen to me? If so… no big deal… but I want to avoid having issues with Disk IO and if I need to change something, knowing that I have been a problem with Disk IO, would help me understand that I have an issue that needs further attention..

It's usually one of two reasons: either you're using too much I/O because of swap-thrashing, or I tweak the values at certain times when the hosts are very busy to more evenly distribute disk bandwidth. Host kernel upgrades (coming soon) have some decent improvements for sharing I/O, so I'm looking forward to that.

Anyway, if this is the account I'm thinking of, your swap was completely full. Not a good sign. You might want to double check swap usage next time you witness slowness (cat /proc/swaps).

doubleg wrote:
My linode at this time shows this, which shows that it’s a lower amount then other linodes. (Again I don’t know anything about this stuff... so lower numbers could be indeed better... who knows!!?)

io_count=888185 io_rate=0 io_tokens=19989 token_refill=100 token_max=20000


If io_tokens is zero or negative, you're effectively being limited to no more than token_refill IO operations/sec.

doubleg wrote:
1. How does it get decided what values are used for our linode?


The defaults are token_refill of 512, token_max of 400k

doubleg wrote:
2. How do I know that I've surpassed “appropriate" disk IO usage?


Look for negative io_tokens.

Hope that helps,
-Chris


Top
   
 Post subject:
PostPosted: Wed Nov 24, 2004 4:12 pm 
Offline
Senior Member

Joined: Thu Aug 28, 2003 12:57 am
Posts: 273
If you'd like to proactively monitor your io token usage, you can install mrtg from:

http://www.mrtg.org

And then you can add my io_token monitoring plugin discussed in this thread:

http://www.linode.com/forums/viewtopic. ... light=mrtg

Good luck!
Bryan


Top
   
 Post subject:
PostPosted: Wed Nov 24, 2004 5:05 pm 
Offline
Newbie

Joined: Wed Nov 24, 2004 11:37 am
Posts: 3
Chris

since i've noticed a change in our settings for the IO_status file I assume you were correct when you were taking notice about our linode taking up all our swap space. Thanks for the adjustment. You posted some very useful information. It has helped me learn a bit about this today.

But that leads me to another question more out of just being curious vs. learning anything...

Do you have a program that is watching disk I/O times and adjusts them on the fly or do you modify these settings on your own?

You must have spent a great deal of time writing this.... impressive

DoubleG


Top
   
 Post subject:
PostPosted: Wed Nov 24, 2004 5:07 pm 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
doubleg wrote:
Do you have a program that is watching disk I/O times and adjusts them on the fly or do you modify these settings on your own?

I have the beginnings of an automated script, but it's not deployed yet. Usually I just monitor the hosts and adjust when necessary...

doubleg wrote:
You must have spent a great deal of time writing this.... impressive

Thanks!

-Chris


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group