So back in 2006 I was running with a company my Dad had used since the late 90s for his web hosting needs. In the late 90s the only way to get SOLID web hosting was to run your site off of a VPS plan. Shared hosting sucked because no one really knew what they were doing. If you want a laugh, check out their product page, especially the price:
http://www.rhyton.com/products/virtual-mini.htm . Now that I look back, I believe this plan was actually 128MB up until late 2009.
Anyway, I decided to try out some stuff on my own and ended up getting a Linode after a recommendation from some people from an IRC server I frequented. This was back when it was a Linode 128. Anyway for a while I installed Webmin which was just not cutting it. I'm a sucker for pretty interfaces and such. Long story short I ditched any interface (except phpMyAdmin, I still use that) and went all command line. If course breaking the server is part of the process. It was only my site which got very few views, so no harm in starting from scratch.
I feel like you're requesting two things: a place to host your sites, and a place to learn. Linode is great for both. The cost to spin up a new Linode and then cancel it is very small. For instance, my customers probably could have dealt with their websites being down for 30min at 2am, but I wanted to learn the proper way to do a migration. I wanted to move from a somewhat unpleasant file structure to a more manageable one. I ordered a new Linode, installed the OS, copied files between them using scp/rsync and got my file structure exactly how I wanted it. After I was sure the new Linode was perfect I shut down both, swapped IPs, and booted them up. Sites were down for less than 2 minutes. If I wanted to be perfect I could simply have changed the DNS and then deleted the old Linode later.
I guess the moral of the story is that you can just mess around and learn and break things, or you can get serious and go for reliability, or you can do both (in my case, experimenting with my file system structure on a second Linode).
That being said, I believe that a properly configured Linode will get much more performance and reliability than 99% of the shared hosting solutions out there. The freedom to run anything you want (beyond a website, such as an IRCd or Minecraft/SRCDS Server) make it that much more of an obvious choice.
Thanks,
Smark