Thanks again Jetwhine.
Found out the problem. I took it to the dealer, where I bought the car, and they said it's the water pump. Ouch. It's going to cost me a few bucks. It's going to get done on tuesday. I took off the engine cover and noticed there's a pinkish calky substance underneath one of the hoses.
OK, here's a stupid question, where exactly is the water pump. I know it's must be where the coolant hose enters the engine.
From this picture, is it the pulley (wheel) in the center of this pic?
Here's a picture taken from under the car. You'll notice some pinkish substance on the small U shaped hose.