I thought punching didn't gain speed from any wpf, and "100" weapon speed means it is the same speed as punching (when you have that weapon's wpf at 100).
With 120 1H wpf and +0 stones set to alt fire (120 speed, 12 blunt damage) it sure feels like you are swinging faster than a punch.