Don't pry. Make sure you got the top bolt out. There is one at 11 o'clock that isn't quilte out on the flange surface. It is in & down a bit.
I found it helps to have a buddy to drop the exhaust. A metal tonka truck is even better. Put it under the rear muffler & it allows things to roll back & forth, if yer doing this on jackstands in the garage, like the white trash that I am.