I would not carry - worrying about someone in body armor. None of the handgun rounds will penetrate higher levels of body armor anyway. Carry the gun and round you are comfortable with.
Here is a very good thread I posted before... Its got good info:
Recent events and rethinking CCW caliber... - M4Carbine.net Forums