Yes, riding ability also influences your riding speed and maneuver. Also, I believe that horse throwing might be the most unrewarding class at the moment (seeing that throwing got nerfed to the ground). To be quite honest, I haven't seen one horse thrower since the patch.
As for the build, I would go for 18/18, so you can have 6 power throw and 6 riding.