Keep up that regular maintenance and you'll be enjoying your Camry for a long time. Our '98 Sienna (same 1MZ-FE engine as the V6 Camry) has 277,700 miles on it. We drove it from Kentucky to Canada in April, and to Florida in June. 24 mpg and comfortable cruising all the way, and I'd hit the road for a long trip first thing tomorrow morning without a worry (because the maintenance is current).
I agree with TedL -- Because you're not racking up the miles, age is going to become a factor for you the same as mileage in your situation. In addition to rust, things like vacuum leaks may start appearing due to hoses and connectors starting to age. It's nothing to lose any sleep over, though.