See http://www.lowendbox.com/ for < $10/m.

Look around, you'll find them. I found a Minecraft server host that actually gives me root access to a VPS with MC preinstalled. I disabled MC and now have a VPS with which to do what I please.

I don't know if it's the best deal out there because I haven't looked in a while, but the host I'm on is http://redstonehost.com/ if you're curious.

I am in Czech Republic, so it will probably be no use to you

I pay the equivalent of 7.39 USD/month

http://www.bezobav.cz/vps-virtualni-server.html