Try a C-clip on the inside of the butt plate to hold the second screw in place. should hold it in just fine, and you'll be able to tighten it up so it won't come loose.
I second the single screw suggestion, if it's snug then you shouldnt have an issue.
__________________
|