Even steel buckler +3, which is one of the fastest shields, has a notable delay when blocking compared to no shield. So having a shield forces you to really anticipate instead of just react to attacks. I can relatively safely manually block most attacks including holds, feints and chambers, but I am bad at anticipating them. Shields are great for catching arrows, but in the actual melee I'd rather go without.
Comes down to preferences though.