One question I have to ask, is the the "too slow" referring to weapon speed or, what it probably is, movement speed from athletics? If it is the latter, I have some interesting stuff for you espo.
You retire fairly often, right? 
Break the traditional mould and do something interesting one of your generations, like this:
Level 30 (4 420 577 xp)
    Strength: 21
    Agility: 21
    Hit points: 56
    Skills to attributes: 14
    Ironflesh: 0
    Power Strike: 7
    Shield: 0
    Athletics: 7
    Riding: 0
    Horse Archery: 0
    Power Draw: 0
    Power Throw: 0
    Weapon Master: 3
    One Handed: 1
    Two Handed: 132
    Polearm: 1
    Archery: 1
    Crossbow: 1
    Throwing: 1
It is funny, you'll be fast and hit kinda hard. Although, no iron flesh isn't the best thing ever.
imo go this if you want effectiveness
Level 30 (4 420 577 xp)
    Strength: 21
    Agility: 18
    Hit points: 70
    Skills to attributes: 8
    Ironflesh: 7
    Power Strike: 7
    Shield: 0
    Athletics: 6
    Riding: 0
    Horse Archery: 0
    Power Draw: 0
    Power Throw: 0
    Weapon Master: 3
    One Handed: 1
    Two Handed: 132
    Polearm: 1
    Archery: 1
    Crossbow: 1
    Throwing: 1
You don't need WM on a non hybrid, in all honesty.