Do you mean the panel that controls the air? I think you actually need to take the glove compartment out and disconnect the mechanism that controls the outside/inside air. Pretty sure there maybe one more thing holding it in, besides the electrical components.

I just did this in the afternoon.

 

unless your talking about the center console not coming out of the shifter area? if so, you push in on both sides halfway down where you took those 2 screws out and pull back.
The front center console piece has two bolts under the trim around your headunit, one screw on each underside driver/passenger, 3 screws near the latch on glove box, and a bolt in between the kickpanel and the door.

 

I'm talking about the one covering the shifter area.

I should have been clearer, or include a picture. But I'm talking about the piece by the shifter area.

And I now understand that the answer is after I've taken the two screws out, I squeeze the piece together, then pull back on it.

 

Open the middle console pull out the material that is in there and you will see two philips screws undo them and then remove the bezel from the actual shifter it will pop right out and there are two bolts in there i believe

 

Yeah That had me stumped for about two mins when I had to remove mine to repair with plastic weld some of the broken pieces and cracks