I would suggest trying some magnum primers and reducing the powder charge a little, working back up.
Rifle primers are longer than Pistol primers and the primers are going to protrude past the case head. These should not work in your pistol, and should hit the recoil shield.
Stick one in the case without powder or bullets and try if you want. RIFLE PRIMER IS NOT THE DIRECTION TO TAKE.