"Almost everyone", err... source?
Removing ladders from battle: Very rarely the ladders were fun when both teams tried to conquer the same roof. In general ladders slow you down so much that carrying them for long is annoying so in most cases this didn't happen, and if enemy already had a foothold on a roof the ladder hp was so low they could easily become inaccessible again if someone planted new ladders.
Result: Removing ladders was mostly a good thing.
Removing ladders from siege: Defending finally isn't just camping the flag in many maps. Some maps are pretty hard for attackers now, but in general the mode is more balanced.
Result: Awesome thing too.
Sure, ladders could've been made high hp / immune to friendly fire or whatever, but really, this makes the game so much more enjoyable instead of the roofcamp fests. Cavalry gets more powerful, but that's just because 90% of footmen - both infantry and archers - are retarded. No sense of surroundings and no-one carrying a spear even if they'd have the 2 slots required for bamboo spear.