That's not uncommon, remember that your frame is aluminum and the barrel and slide are steel. What you're seeing is the anodizing wearing off the frame as the steel is harder than the alloy+finish.
Unless there is physical damage ie cracks, peening, dents etc. the wear is just cosmetic. It looks like there is possible damage to the left front rail, but it's hard to tell in the pics.