I had the same problem and corrected it with two changes.RangerM9 said:
First, I made sure the gun followed the knuckles of my finger and not my thumb. When I naturally (without thought) hold a Steyr, it's position to the left, and not straight down my arm. I need to move the muzzle to the right so that it 'seats' better in my hands and aligns straight down my arm.
Poor explanation I know, but hopefully you'll know what I mean.
Second, make sure you pull the trigger with the fat part of your finger and not the joint area. This also made me pull to the left.
I hope this helps.