I've never run Load Impact before, but here are the results for one of my sites on a Linode 512,
HemOnc.org:
http://loadimpact.com/load-test/hemonc. ... d242987aa2. It tested for up to 50 users and had no issues on this Mediawiki installation, which also uses MySQL.
On a really light page on the same server,
Dryang.org, it got up to 50 users with still 25ms load times:
http://loadimpact.com/load-test/dryang. ... 5cdf01abcbI did not adjust many settings from default, so it definitely seems to be something with your configuration or site.