PD and PT only affect attacks made with weapons that use that skill. No skills interfere with each other.
Putting leftover points into riding as polearm infantry is a good idea, you can always pull out a lance and couch some dudes if you feel like it.
