It will slow your movement speed down, but only by the amount of weight the shield is as if it were weapons carried.
Carrying two (or more) shields gives you a big penalty though. Only ever carry a single shield.
So yeah, carrying a shield on your back isn't a bad thing unless you're counting every bit of weight and agility backpeddling. No effect on WPF.