Infection, only. plastic scratches = grub gets into the fissures and can (potentially) withstand standard cleaning regimes.
Just be extra careful not to scratch the inside of the carboy. I used to use plastic carboys for my ginger beer, but found they're harder to maintain in the long run.