Well, for one, the Glock and the XD have very similar safety features. The XD has both a trigger ang grip safety, while the Glock has a trigger only (internals aside). So, if you have an issue with the Glock safety, why not the XD?
As far as shooting low... shoot something else, too! Really, you should try to rent as many guns as you're interested in, hold and shoot them all. At the end of the day, get what makes you happy!
Which Beretta were you shooting? The 92FS (like Mel Gibson's in Lethal Weapon), or their new PX4?
I have an XD9 Subcompact and I love it. It's a great little carry gun, and it fit my hand and wallet the best, which is why I bought it. I also have a Beretta 96 (a .40 cal) and it's a nice shooting gun too. They both have been incredibly reliable. I shoot more accurately with the XD, however. As for a couple of other guns similar to the Glock and XD, you should look at the Taurus PT111 and Walther P99 (and it's Smith and Wesson brother). Of all these guns, I'm pretty sure the Taurus will be the most affordable, definitely if you're looking for a NEW gun. I've seen them for $349 around here, where all the others seem to start around $450-500 dollars new.
Lastly, if you're going to use it also as a "stopping" weapon for camping, what will you be stopping? People or animals? If you're worried about a big beast, like a bear, closing in on you, you'll pretty much just piss it off on its way to devouring you if you're shooting any of the calibers you listed. I'm sure others will chime in, but in threads like these in the past, for a camping gun everyone always seems to recommend a large revolver, like a .44mag, IIRC.