once you removed the caliper bracket, it should come off free, if the parking brake is released, and if the parking brake drum shoes is not holding it,
if the whole rotor is loose and it will not come off
you need to adjust the parking brake through the brake rotor's plug hole with a flat head screw driver,
ply the shoes adjusting screw one direction will either loose or tighten the parking brake.
if the parking brake is too tight, it will spread shoes and hold the rotor in place and won't come loose.
see below link for more detail on how to adjust the parking brake.
How do you adjust the parking brake on a Camry w/ rear discs