Since you suspect the starter, I assume you are sure this is happening before the engine actually starts? If not, you may want consider a different oil viscosity that allows easier cold weather starts.

If the sound is definitely before the engine starts, Is it maybe a clicking noise? If so, your battery may need to be replaced. You can take your car to Advance Auto Parts, Auto Zone, or O'Reilly, they will test your battery for free in the parking lot. Best to go when they are not busy.

A battery delivers less cranking power the colder it is, like at night or first thing in the morning. If the battery is marginal to begin with, then you get a clicking noise coming from the starter, but in that case the fault is the battery, not the starter.

 

Maybe not a fix, but a consolation ?
I get the same noise when it's cold, immediately when the engine starts. I run full synthetic 5W30. On mine it sounds like the belt, but I just ignore it.

 

Take the belt off the tensioner. Spin pulley by hand. The bearing inside the pulley is dry. It could also be alternator or water pump pulley.

Spray water on the belt to see if noise goes away. If it does, then it's the belt. If not, then it's pulley.

 

Wouldn't dry bearings continually make noise, and not just for a second on cold start-ups?
When my water pump bearing was dry, I could clearly hear it inside the cabin. Same with the tensioner. But those sounds were constant.

 

Not necessarily. If you catch it early, it is just a chirp. But yes, over time, it will become constant chatter.

 

ive been trying to record it to see if that helps figure it out but it hasn't done it once since I posted this. I say the starter because maybe it has trouble retracting when the engine starts. It is right when it starts up and a little less than a second. I just want to make sure its nothing major .

it doesn't make the sound when it cranks but when it starts

I assume its what 75aces said because it doesn't have that many miles. I also say the start because my grandma used to own it used it for many short trips so I suspect it might be the starter.

 

not 75aces, I mean mark888, though it wouldnt make sense becuase sometimes it happens when I start it when its like 70 degrees outside

 

How cold is cold? I know when it is below freezing my Camry when starting likes to give a nice... creaking... sound upon start up. I think the starter just likes to get sticky when it gets cold but as long as it always starts then I have had no issue with it.

 

To confirm the health of the starter, take it to AutoZone and they can bench test it for you to confirm it's good or going bad.

 

Either the plunger or the Bendix is failing. You can buy rebuild kit for your starter. Just don't buy an aftermarket one.

 

I will try and see if the starter is ok, I have an autozone down the street,

Now its a lot less common but seems random and lasts a bit longer

if it is a bearing how would I check?