His this might sound silly... But how do you call off an attack on some one?
Don't, you will be teleported anywhere on the map, this is not a bug, this is to prevent "blocking army" spam.
Blocking army is when a small army attack a bigger one to block and hold it, you can block attacking army going to your village (to have time to get reinforcements) or you can block enemy reinforcement while you attack another army (for example).
