A properly made holster (think $150-$200) along with proper trigger control damn near eliminates the possibility of a ND. Besides, carrying a gun without one in the tube is just one step better than not carrying a gun at all.
For instance, lets say the fateful day comes where you have to draw your weapon in defense of yourself or your family. If you're tied up hand to hand with some bad guy, you won't be able to charge the weapon, so it's pert neer like not even having one. (same goes for those that choose not to carry a spare magazine, but that's a different story)
Guns just don't go off by themselves. With the proper equipment and proper training, you can reduce (note I said reduce) the possibility of a ND to almost zero. I've been carrying for over 16 years now and I've never had an issue, knocks on wood, and I've carried a 1911 for most of that time. This all takes time and money. If you're not comfortable at this point with carrying it with one in the tube, either sell it and get a different gun, or understand that carrying without one in the tube has it's own set of limitations and pitfalls.
DO NOT carry with one in the tube and the hammer down. More times than not, with a 1911, ND's happen when someone is trying to lower the hammer on a 1911.