Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Post new topic  Reply to topic
Author Message
PostPosted: Wed Feb 08, 2012 1:43 am 
Offline
Senior Newbie

Joined: Wed Oct 12, 2011 8:27 am
Posts: 5
Website: http://www.jasonantman.com
AOL: inebriectomy
Location: NJ, USA
I'm trying to check the network transfer/disk/CPU stats of my linode without logging in to the manager web UI.

I found some references (http://www.linode.com/forums/viewtopic.php?t=1558 or http://www.linode.com/wiki/index.php/Bandwidth) as well as a number of other places, to being able to remotely retrieve these stats as well as host load and job queue, node uptime, node cpu utilization, etc.

It appears that the linode API only retrieves transfer used (account.info)... and the URLs given in the circa 2009 docs for this (http://www.linode.com/members/info/?user=linodeXXXXXX) are just giving me a "DENIED" error.

Does anyone have up-to-date information on how to get these metrics?

Thanks,
Jason


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 2:36 am 
Offline
Senior Member

Joined: Fri May 02, 2008 8:44 pm
Posts: 1121
There are tools that you can run inside your linode that give you a lot more information than the Dashboard graphs do. Try munin, for example. It's very good for monitoring memory usage and other metrics.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 9:40 am 
Offline
Senior Newbie

Joined: Wed Oct 12, 2011 8:27 am
Posts: 5
Website: http://www.jasonantman.com
AOL: inebriectomy
Location: NJ, USA
hybinet wrote:
There are tools that you can run inside your linode that give you a lot more information than the Dashboard graphs do. Try munin, for example. It's very good for monitoring memory usage and other metrics.


I'm more interested in:
    My monthly network transfer as Linode sees it
    Host (i.e. Xen dom0, Linode's physical box) load and status
    Host job queue length
    Physical disk IO
    My CPU usage as the Linode host sees it *


I'm most interested in the first three, as there's obviously no way to check any even vaguely related metric from domU.

Where did these data feeds go?

* Due to time slicing, there can potentially be large discrepancies between CPU usage reported inside a VM and in its host. If for some reason the VM host gives unfair shares to another VM, or is CPU-bound itself in the host OS / dom0, the guest itself will never see this.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 11:08 am 
Offline
Senior Member
User avatar

Joined: Tue May 26, 2009 3:29 pm
Posts: 1691
Location: Montreal, QC
Most of those must be measured from inside the linode (I also recommend Munin). There is no automated way to retrieve them from the manager in most cases.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 11:18 am 
Offline
Senior Newbie

Joined: Wed Oct 12, 2011 8:27 am
Posts: 5
Website: http://www.jasonantman.com
AOL: inebriectomy
Location: NJ, USA
Guspaz wrote:
Most of those must be measured from inside the linode (I also recommend Munin). There is no automated way to retrieve them from the manager in most cases.


Maybe I should just open a ticket for this...

I'm looking at
http://www.linode.com/forums/viewtopic.php?t=1558
and
http://www.linode.com/wiki/index.php/Bandwidth

Which state that there is (or was) an XML feed of this information. I know that network transfer/bandwidth usage is available via the accounts.info() API call.

Can ANYONE give me an informed answer on whether these XML feeds have moved, or were discontinued, or what the status is?

And, if they've been permanently shut off, whether there are plans to add at least host (dom0) status/load/job queue length and physical disk IO to the API?

I know Munin very well, though personally I perfer Cacti or Nagios/Icinga with pnp4nagios. I thought I did an adequate job of explaining why some of these metrics are IMPOSSIBLE to collect in the guest, and the others are not reliable.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 12:00 pm 
Offline
Senior Member
User avatar

Joined: Tue May 26, 2009 3:29 pm
Posts: 1691
Location: Montreal, QC
The official answer is to do it yourself in your linode:

viewtopic.php?p=30938#30938

You've done an adequate job of explaining why YOU think the metrics are impossible to collect in the guest, but that doesn't mean you're right. Of the metrics that you've listed, they're all either available for accurate measurement from within the guest, not available outside the management interface, or not available in *any* place.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 12:46 pm 
Offline
Senior Member
User avatar

Joined: Sat Aug 30, 2008 1:55 pm
Posts: 1739
Location: Rochester, New York
It works for me, but only via IPv4.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 4:15 pm 
Offline
Senior Member

Joined: Fri May 02, 2008 8:44 pm
Posts: 1121
jantman wrote:
Host (i.e. Xen dom0, Linode's physical box) load and status

Host job queue length

My CPU usage as the Linode host sees it *

* Due to time slicing, there can potentially be large discrepancies between CPU usage reported inside a VM and in its host. If for some reason the VM host gives unfair shares to another VM, or is CPU-bound itself in the host OS / dom0, the guest itself will never see this.

AFAIK there are ways to measure stolen CPU cycles from inside the VM, though this would have to be supported by the kernel and your measurement tools (munin, nagios, whatever). I've personally never had to worry about receiving an unfair amount of CPU here, and CPU usage measured from inside the VM is usually very close to CPU usage reported in the Dashboard.

Also, why would you want to monitor the host's load and queue length? Seriously, what the host machine is doing is none of your business. I never quite understood the point of showing it in the Dashboard in the first place, since it's always either "low" or "medium" and the difference between the two doesn't affect the VM's performance in any way.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 4:39 pm 
Offline
Senior Member
User avatar

Joined: Tue May 26, 2009 3:29 pm
Posts: 1691
Location: Montreal, QC
hybinet wrote:
I never quite understood the point of showing it in the Dashboard in the first place, since it's always either "low" or "medium" and the difference between the two doesn't affect the VM's performance in any way.


Mine shows "idle" :P


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 6:44 pm 
Offline
Senior Member
User avatar

Joined: Tue Nov 24, 2009 1:59 pm
Posts: 362
Guspaz wrote:
hybinet wrote:
I never quite understood the point of showing it in the Dashboard in the first place, since it's always either "low" or "medium" and the difference between the two doesn't affect the VM's performance in any way.


Mine shows "idle" :P


From what I heard, the "host load" readout was correct for UML, got broken and always shown "idle" for Xen, then got removed with the switch to new manager, and readded when some people complained(including me, but I was complaining about lack of the physical host name on the dashboard, not the load status).
Wouldn't be surprised if it again always show "idle" no matter what, I've never saw it say anything else. But maybe Linode's hardware is just THAT good. :)

_________________
rsk, providing useless advice on the Internet since 2005.


Top
   
 Post subject:
PostPosted: Wed Feb 08, 2012 8:22 pm 
Offline
Senior Member

Joined: Sun Mar 07, 2010 7:47 pm
Posts: 1970
Website: http://www.rwky.net
Location: Earth
I've seen it on high, a few days ago a host had a hardware failure and the drives had to be hot-swapped to a backup host (very quickly I might add thanks to the linode-awesomeness).

_________________
Paid support
How to ask for help
1. Give details of your problem
2. Post any errors
3. Post relevant logs.
4. Don't hide details i.e. your domain, it just makes things harder
5. Be polite or you'll be eaten by a grue


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic


Who is online

Users browsing this forum: No registered users and 4 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group