The primary benefit to increased proficiency for melee characters is the additional damage. The speed difference is nearly imperceptible at any ratings that aren't a contrast of a hundred points or more.
Were you to wear heavier armor the difference between points would become more of an issue, but as my build emphasizes athletics, heavier armor negates a lot of why I chose this playstyle.