I got the same problem and troubleshooted it. Found that the game server host, some german one, has problems in their network. Seems like one of the routes where traffic reach them get pretty busy at weird times for no reason or it is just borked. I already sent chadz some info about the subject and even emailed the company myself. Making it short. If you are joining the server from the west of its main location, you may be routed in the same route i am. You will notice about 60-80 more ping average at random times. The problem is in the hetzner.de network. The first hop once you reach the network is ok, the next 3 arent, making my latency twice that it should be. Can any of the admins tell the paying person to send them an email?. Having a gaming server meant for the whole europe, and then having borked routes for many players is just bad for a company hosting gaming servers... thanks.