I don't deny that HA can be annoying, but I don't agree at all that the class is game breaking. If there were no ranged cavalry the servers would be over run with lancers, and 1h/2h cavalry. Every class brings a balance to the game.
Have you seen Gigglebyte on his horse lately? When I play my hoplite, I can't stab him as he charges me, because the second I drop my shield, he shots me, interrupting my stab. Then he still runs me over with an armored horse. When I play my 9Ath build, he just runs away because he is faster, shooting over his left shoulder with ridiculous accuracy. It's going to be the same for a 1h shielder.
Against an archer, he moves faster and is more maneuverable making him harder to hit, while drawing with the same speed. He can constantly interrupt crossbower's reload unless he is up some stairs and behind cover.
He can shoot from outside a thrower's effective distance with higher range and accuracy.
He doesn't have to go anywhere near infantry.
There is no one on one counter, and if ever presented with a team of archers, he will simply go to the other side of the map and pick off targets there while his team hopefully kills all the archers.
So unless he's being an idiot and runs into some trees or a rock or whatever tactics you're talking about, how do you stop him?