It sounds like we have a similar problem.
94 Camry 4 cyl strange cold start problem
I think mine is possibly battery related though... I'm not sure. It turns over almost as if its got a low battery, does it a couple more times and if I keep the starter going it will fire up. Or I release the key, turn the car off, try to start it and it fires up. Then when driven for a while or w/e it will start fine, but leaving it for a day or so and bam... does the same thing.
It happened after I changed my timing belt, but then the temperatures have dropped here so I don't know right now. My battery could be going bad. It drops to around 11.5V or less over night after running the car (when the car is running its outputting 14V or so, when I turn the car off the battery shows 12.2V).
I also have a NSS that is going bad, but that's not your problem.