Yep, I have a Les Baer custom carry with the fcs and I don't carry it for that reason. I don't like the fact when I draw it from the holster I get a wad of leather shavings on the front of the slide and the fcs also slows my draw way down. Some people really like them but there just not for me.
In answer to your questions ... No and No. I have a 5" 1911 with FCS and have carried it in many different leather holsters without damage to the holster, I even use a Hellwig competition holster, which is a leather lined kydex holster and no damage to the leather lining, after 15 years of use. As far as slowing down the draw, I don't think it's an issue. That Hellwig holster is faster than I can use it.