Still not as much as the 14% increase in damage from each PD point, and you only have one athletics. Try running from people and horses and shooting your bow slowly.
It's for that reason that I just said screw it on my STF and went Powerstrike over Athletics. At least I can kind of defend myself with a hand axe or bore the enemy to death with blox.