If the cav is heading straight towards you, a sidestep and a left to right slash to the horses face is possible. Usually, it'll drop unarmoured horses in one shot.
You'll only get this chance though if the cav is either a) stupid or b)unaware you're aware hes behind you ( using the tilde key) c)you're awesome and have controlled positionning very well