Well the issue in this case is, that athletic does not have a linear bonus.
As i have rethought my agi build i have made some little tests, as well.
With low athletics every additional skill point gives you a noticeable boost, with high athletics you will still get faster, but the overall effect is quite small.