Patti Smith - and indeed, all punk other than the Ramones - eluded me in my younger years. I didn't hear any of it until my late teens. Manson, however, I first heard at the age of 9, and started listening properly at 13. Because of this, and myriad other factors, I am obviously biased, except in the case of original songs that are almost indisputably better than Manson's cover (Personal Jesus).
Punk, even what is produced by those near and dear to my heart (Iggy Pop, Black Flag) tends to blend together and become background noise if I listen to it for too long, and this has created a bias against it when compared to other styles.
So, that's what happened there. I still prefer Manson's version, but I imagine most wouldn't.