I am not a fan of the 40, myself. I like the 9mm and the 45 ACP. Right now, I have gone to all 9mm guns so I can afford to shoot every other weekend.
I had a Glock 26 for 8 years - good gun. Switched to a Walther P99 compact A/S last year, and I much prefer that - My aim is better than with the Glock - but, the G26 was a good gun. If the XD in 40 is too much for U, I'd go with a 9mm