I don't get the hate for horse archers and horse crossbowmen in general. They are funny to watch zip around the battlefield and bump unaware melee players into the ground. Whenever they get dismounted, they either try to run, which is funny because they are like fat kids running with their 0 ath or they try to fight which is equally funny because they do no damage with their fists or 0 slot swords. Of course this is from the perspective of someone who has been getting 1-2 shot by anything and everything since 2011.
Moral of the story: If you get used to wearing light armor and getting killed by everything, horse archers won't really bother you