You don't need to remove the shifters trim, or at least I did not have to on my 1997 Camry.
After you remove the trim/ashtray around the radio, remove the knobs, like you said, you removed those two screws. Did you also remove the ac vent head thing? I had to get some pliers with some grip to yank that out.
Then remove the 4 golden screws around the temp control (pretty sure you did this too)
Now, when you pull it out, you don't got much room to work with. There's two black tabs on top, you just lift them UP, and they slide over that bump.
Then you can reach the green bulbs.
This should help you too
Gen 4-4.5 DIY Changing your bulbs inside your center console