I own an 07 se v6 and so far here are the things I have discovered both personally and from other owners and my mechanic friends:
-DOHcammer is correct in that there are unusual transmission flare problems in the early makes of this camry model with the V6 engine. I got mine because the previous owner had already replaced the tranny at the dealer while under warranty.
-make sure they have had the oil line TSB done to the car!!! I can not stress this one enough. If they have not, it is practically guaranteed to go out on you. The problem is a metal clamp holding down a rubberhose with hot oil going through it on the out side of the engine. When it finally pops, you get oil all over your engine bay and absolutely no warning lights until the engine is bone dry. Happened to me personally.
-Check all the tension arms for your belts as these evidentally can become loose around the 40-50k mark. Mine did.
-Take it out and when you accelerate, if you hear a rattle that seens to be coming from the dash or behind the radio area, then they never got the TSB done for dash rattle. This is minor, but can be really really annoying.
-You might hear a popping in the roof when going over driveways or uneven surfaces. Again, this is a TSB for I believe a bad support joint or something like that. Again, very minor, but annoying.
-The obvious TSB of the floor mats, which was the reason for a lot of recalls.
-Being a mechanic you would probably know better than me, but the V^ engine is pretty loud and kind of has a tapping, rattle, almost slight knocking sound towards the top front of it. I have been told by numerous Toyota Techs, mechanics, and via online searches, that this is normal.
So far those are the negatives that I have experienced or personally know for a fact exist. I am surprised to hear it shook on the freeway, because when I test drove mine, is was the fact it felt so smooth on the freeway that really sold me. Most of the things I have mentioned are minor and can be fixed with preventative work before they become serious issues. All in all, I love my car. It is powerful, looks great, drives well, and as long as I maintain it, it should last for years. I hope this doesn't deter you from getting it, just wanted you to go in with a heads up of known issues so you can check. Hope it helps.