Linode Forum
Linode Community Forums
 FAQFAQ    SearchSearch    MembersMembers      Register Register 
 LoginLogin [ Anonymous ] 
Forum locked  This topic is locked, you cannot edit posts or make further replies.
Author Message
PostPosted: Fri May 28, 2004 5:21 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
I'm looking for just a few Linode 64 users currently on hosts in the Fremont datacenter (host9 and up) to help test a new performance patch to the host and UML.

UML works by using ptrace, a function of Linux to intercept system calls made by applications. When your UML makes a system call, the host intercepts the call, performs the work inside UML, and null-ifies the system call on the host by converting that system call to "getpid" on the host. The problem with this is that it generates two context switches on the host.

With the [url=http://perso.wanadoo.fr/laurent.vivier/UML/
]sysemu patches[/url] on the host and in UML, it doesn't bother running "getpid", thereby reducing number of context switches from 2 to 1.

Benchmarks

Here are some "real-world" benchmarks using Mysql's run-all-tests script:
http://www.theshore.net/~caker/uml/syse ... hmarks.txt

In short, the tests ran 33% faster than they did without the sysemu patches.

Details

  • We'll migrate you to host25, keeping your slot on the previous host reserved (in case we need to migrate you back). In case you've never migrated before, it's an automated process which moves your filesystem images to the new host. No changes are required on your end, and downtime is limited to however long it takes to copy your images (usually less than 15 minutes or so for 3GB).
  • Set your config profile to boot the 2.4.26-linode29-1um kernel
  • Try to break things

If things go well for a few days, I'll consider it stable and open up the server to the public. After another few weeks, we can move the other hosts to this kernel.

Secondly, this will help test 2.6.7-rc1 on the host, an upgrade from the current 2.6.4 kernel.

Thirdly, I would also like for some of you to test the 2.4.26-linode29-1um kernel, to make sure it still functions correctly on hosts without the sysemu patches. Please let me know your experience with this kernel. On non-sysemu enabled hosts, it should perform the same as the previous linode kernels.

Let me know if you're interested...

Thanks!
-Chris


Top
   
PostPosted: Fri May 28, 2004 7:17 am 
Offline
Linode Staff
User avatar

Joined: Sat Jun 21, 2003 2:21 pm
Posts: 160
Location: Absecon, NJ
Three updates in one test? You've got ball-balls Chris!

:D

-- James


Top
   
 Post subject:
PostPosted: Fri May 28, 2004 9:29 pm 
Offline
Junior Member

Joined: Wed Feb 11, 2004 8:49 pm
Posts: 25
AOL: MattKCowger
I'm interested....let do it!

_________________
--Matt Cowger


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 12:14 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
mcowger wrote:
I'm interested....let do it!


Great. I haven't patched a 2.6-um kernel with the sysemu patches yet, so for now go with the 2.4.26-linode29-1um kernel. I'll update this thread when the 2.6 version is out.

Thanks!
-Chris


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 4:29 am 
Offline
Senior Newbie

Joined: Wed May 05, 2004 5:29 am
Posts: 7
I'm game. What do I need to do?

Terry


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 4:31 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
terryr wrote:
I'm game. What do I need to do?


Login, shutdown, and press the migrate button. After the migration, reboot.

BTW, 5 users have moved over to host25 and so far so good.

-Chris


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 4:39 am 
Offline
Senior Newbie

Joined: Wed May 05, 2004 5:29 am
Posts: 7
Done! Are you looking for any specific feedback?


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 4:41 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
terryr wrote:
Done! Are you looking for any specific feedback?

I pretty much know there's a performance improvement already, but hearing about that would be nice. It might be kind of difficult to pin down, unless you run specific tests and compare them against the linode28 kernel. Secondly, I wanted to generate some load on the host kernel, and the linode29 kernel, just to make sure the stability is still there.

Thanks!
-Chris


Top
   
 Post subject:
PostPosted: Sat May 29, 2004 5:53 am 
Offline
Senior Newbie

Joined: Wed May 05, 2004 5:29 am
Posts: 7
I loaded a fresh Fedora Core 1 distro. Noticed immediately how much faster it is. Ran locate -u which was noticeably faster. Ran top and saw something strange. About every two seconds, there's a cycle. See pics below. irq goes up to 0.9% and softirq goes up to 49.5% and iowait is 49.5%, then it all drops to 0 for 2 seconds and goes back up again for two seconds.

Image
Image

I don't recall this happening when I looked at top on the old host. Or did I just miss it?

Terry


Top
   
 Post subject:
PostPosted: Mon May 31, 2004 7:58 am 
Offline
Senior Newbie

Joined: Fri Apr 23, 2004 3:08 pm
Posts: 19
I am seeing stragne problems with mysql that I did not see before moving over. Whenever, I try to connect I get this message:

ERROR 2002: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)

This is because mysqld either keeps hanging or completely crashes.
It will run fine for a few hours and then just die. I can't explain why.

I will keep everyone posted.

John


Top
   
 Post subject:
PostPosted: Mon May 31, 2004 8:13 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
jftuga wrote:
I am seeing stragne problems with mysql that I did not see before moving over. Whenever, I try to connect I get this message:

ERROR 2002: Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2)

This is because mysqld either keeps hanging or completely crashes.
It will run fine for a few hours and then just die. I can't explain why.

I've noticed your Linode using a lot of swap, so perhaps you're running out of memory and the OOM (Out Of Memory) killer is kicking in...

-Chris


Top
   
 Post subject:
PostPosted: Mon May 31, 2004 8:18 am 
Offline
Linode Staff
User avatar

Joined: Tue Apr 15, 2003 6:24 pm
Posts: 3090
Website: http://www.linode.com/
Location: Galloway, NJ
terryr wrote:
I don't recall this happening when I looked at top on the old host. Or did I just miss it?

I'll give this a shot, too, but.. would you mind rebooting into the linode28 kernel and seeing if you can reproduce this?

I somehow doubt the SYSEMU patch would be the cause of this, or the mysql problem...

-Chris


Top
   
 Post subject:
PostPosted: Mon May 31, 2004 8:24 am 
Offline
Senior Newbie

Joined: Fri Apr 23, 2004 3:08 pm
Posts: 19
I have modified the mysql server for a small memory footprint using the my-small.cnf that comes with the src distro.

I will let you kno if this helps.

Also, I am using a lot of swap, and am considering upgrading to a 96 or 128 when they become available.

-John


Top
   
 Post subject:
PostPosted: Mon May 31, 2004 8:41 am 
Offline
Senior Newbie

Joined: Wed May 05, 2004 5:29 am
Posts: 7
caker wrote:
I'll give this a shot, too, but.. would you mind rebooting into the linode28 kernel and seeing if you can reproduce this?


Did that yesterday with no change, but when I checked this morning, I'm at 0.1% for irq and softirq and it cycles with iowait at 0.2%. The high initial numbers didn't seem to affect performance at all.

--
Terry


Top
   
 Post subject: how to migrate
PostPosted: Fri Jun 04, 2004 6:29 pm 
Offline
Senior Newbie

Joined: Fri May 07, 2004 9:00 am
Posts: 9
Website: http://www.akins.org
where is the migrate button? I shutodown and clicked around but I never found it.


Top
   
Display posts from previous:  Sort by  
Forum locked  This topic is locked, you cannot edit posts or make further replies.


Who is online

Users browsing this forum: No registered users and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum

Search for:
Jump to:  
RSS

Powered by phpBB® Forum Software © phpBB Group