Breaking opponents ladders is not against the rules.
If a group is on a roof and you break the ladder just to force the other team to violate the unreachable location rule, then you run around a corner and say "hah now you gota come down your violating the rules".
Then yes you can be kicked for "trolling". Your post was a correct recap of the events. You just left out your attempt of manipulating the rules. Your team had the other team outnumbered 2 to 1, and they were doing fine attacking the roof top campers until you got involved.
Seeing the Hospitaller kids play regularly, they like to let their team die and sit back in an extremely advantaged position and camp.
It seems like by knocking the ladder down, OP, you made them actually need to come down and fight.
In regards to Darkwulf saying you kicked him for "trolling" for saying the the OP stated something to the effect of "haha now you have to come down" -- that is nowhere near trolling, it's just stating a fact. You obviously have absolutely no idea what trolling is.
I really don't even see a kickable offense here; the guy broke down an enemy ladder. So what? He didn't grief, he didn't tk, he wasn't interrupting gameplay at all -- as a matter of fact, he made a sound tactical decision by forcing the enemy to retire from their advantaged position, that's not "manipulating" the rules, that's being intelligent.
Abuse forum, Sam.