My guess?
Leaky injectors and or valve being held open when not supposed to be.
You're blowing off the vacuum draw for the crank case by the idle control valve. I would check your injectors. You say that the car sits an hour or so then when you start it up it bangs. Definitely sounds like a leaky injector ontop of a hot valve... but I am not sure.
Be sure to check the intake manifold if this is happening frequently - it only takes a few backfires to melt/explode the plastic intake.