Smite is aimed at the bag of holding. Not at the boss itself.

Going by the rules. When a bag of holding is destroyed. The contents contained within are scattered to the Astral Plane.