I'm going to go out on a limb and say that the OP (SheriffJB) has "fixed" his sight by now.
But I'll add a couple tips since the post as been resurrected.
Be sure to support the sight base properly or you could tear it from the barrel while trying to drift the sight out!
I have made a triangular drift for the purpose of tapping sights mounted in dovetails.
A soldering gun may be able to put "pin point" heat next to the dove tail to help loosen the "adhesive" used from the factory. A heatgun may melt the paint off the sight.
I agree with the green Loctite for mounting sights. In a pinch, red could be used, just keep in mind that it will not really dry if exposed to the moisture in air. In using red Loctite for screws, etc. keep in mind that a little goes a long way. Any excess should be wiped off immediately because it will not help "lock" anything, just make a mess...