Why would they jerk around more than any other player? The lag is between them and the server, but what other, non-lagging clients receive is the state of the agent on the server. They would jerk around if the netcode was utter garbage and allowed players to send positions instead of actions, but fortunately that's not the case.
And yes, there is client prediction, but it doesn't really make a difference in this case.