Well... All the hybrid builds need a very good situational awareness, to utilize all of the available skills/abilities, not to mention a good cRPG experience.
It is not a good beginner build for sure.
Personally, i would drop IF and some Athletics to get higher Agility, in order to reach 140 WPP in crossbow. You will not have enough gold to sustain medium/heavy armor, crossbow and a horse, so might as well stay on horse, and compensate lower athletics by using light armor

On the other hand, you are far better player then me, so i am sure you know what you are doing.