I get this multiple times a round, that's exactly what happens to me. Been happening the last few weeks after I moved back to my apartment. It's definitely the connection, but it's not like the connection is that bad. I feel like it's partly something with the game/server, too, in a way..
Edit: Also, if this happens on horse, it begins to veer off in random directions, even if you haven't touched A/D. It's a terrible situation to be in (run over teammates, crash into obstacle, etc.)