Most annoying enemies were any of the smaller enemies, especially the dogs, and the four-legged skeleton thing. The hardest and most irritating bosses for me were probably the four kings (before I knew just to tank up) and the Bed of Chaos (for the trial and error, and having to run back to the room every time).