Each time you throw ladders they should spawn randomly inside of radius of defined size(for example 5 meters) around you. This would reduce the chance of pinpointing ladders on highest walls of the castle, giving better chance for defenders.
Well considering that a lot of ppl dont know that placed ladders destroy any new ladders that touch it and that a lot of ppl arent expert ladder placers Id have to say nay for this one sorry.