Um, no. Heavy armor should be recognizable as such on the battlefield, so that people can adjust their tactics accordingly (use pierce/blunt weapon, attempt kicks, try to kite, etc).
The biggest downside to plate isn't being slow, it's alerting everyone that you are slow.