just so you know the glove box light only comes on if your headlights or parking lights are on.... with that said, here's how to remove it.
covering the light is a little grille piece, you push up on it from the front (there is a small ledge to push on) and it pops up. next you have to remove the housing. to do so, you may either have to spin counter clockwise or clockwise (forgot which way it is) and the housing comes out. last you may want to disconect the wire.
the lightbulb was either a 74 or a 194....
EDIT : these are instructions for the gen3 camry, sorry... it might be the same for the gen 4.