Naked players should have a much slower speed, due to being leeching trolls.
How to make it sound reasonable: Naked have it very cold, so move slow. Or in the desert: naked have it very warm, and will sweat so much they get dehydrated, cause slow movement.
Also, sunburns for everyone not wearing a traditional strawhat.