Sounds like you're in the middle of a discouragement trough. Before you completely abandon it, think about this:
1) without a car, you're at the mercy of someone elses schedule if you need to get stuff. Don't give up that independence to hop on the bus
2) You sound like you want a modded car to show off and compete in. The question is, what kind of tuner are you? If you want something you can get ready for competition fast, that doesn't require much research to put together, easy parts access, and minimal headaches, then a camry isn't for you. Pick up a Civic/Integra, get your parts at Kragen or Pep Boys, read all the "Tuner" magazines about parts and their hp, and be satisfied.
If you're not the common tuner, you don't mind spending weeks waiting to put your ride together. That's what sets us Camry folks apart from the Accord folks - we don't have 20 different turbo kits available to us. We have to spend time researching, testing, and building custom parts for our rides or swapping engines in. It's more frustrating, more time consuming, a more individual process, but the satisfaction factor (IMO) is much higher for us than them. We don't just buy parts recommended by Super Street or Modified because they don't do that. We figure it out ourselves. And when it's all said and done, we get respect, because we take a car that was only conceived to get groceries from the store to the house and kids to and from school and make it into something that can compete with the "other pre-fabbed rice rockets." And we end up having more knowledge than the rest, and usually end up helping them figure out what's wrong with theirs. If that fact does appeal to you, keep the camry. If it doesn't, we understand.