My suggestion:
More strength, less agility and don't worry too much about your wpf for anything except archery and throwing.
You can certainly kill people with 1 wpf in polearms, 2h and 1h, especially if your strength is high. No, you probably won't be beating many people in a duel but if you're good with timing you can often get in a good hit while they're distracted with someone else. Footwork, feints and delaying swings probably do more than wpf anyway (put a 1 wpf vet against a 150 wpf noob and see who wins).
Archery and throwing are different since it impacts their accuracy, and a 1 wpf in throwing will have you miss people at 3 meters, but a well timed Great Maul at 1 wpf will bash through someone's shield and knock them to the floor just fine.
When I played an archer, if I ran out of arrows or particularly if there were people on the flag in siege, I'd often drop my bow, pick up the nearest large weapon (1 wpf), ready an overhand and see who I could brain. It worked well enough.