I took mine off to install new speakers. It's a little tricky but not too tough. It all depends on your mechanical skills.
1) There's a plastic triangle (mine's black) in the corner. If you have power or manually adjustable, you pry it out. If you have the little lever to adjust the mirror, you have to unscrew that and then pry off the triangle.
2) Remove the screw attaching your door handle. Pull out the handle and then you have to rotate it to disconnect it from the linkage rod.
3) There's a plastic phillips "screw" (it's actually a clip) on the edge of the door. It's the same color as your door panel. Turn it a quarter turn and pry it out.
4) Stick something under the door armrest pad to pry it up. When that's out, there are 2 screws behind that. Remove those.
5) If you have manual windows, you'll have to remove the window crank. It's connected with a "C" clip behind it.
6) Now you'll just have to pry around the door panel to release the retaining clips. I can't remember how many there are but when you pry it off a little, you can see the clips. Once those are un-clipped, you just take the panel off. If you have power windows or mirrors, you'll have to disconnect them as well.
It's a lot easier if you have a picture of the steps but I hope that helped.