Looks like the garrison upkeep needs to be tweaked. I agree that defense is pretty easy in strat ( depending on the castle/fief of course and if it has any bugs). there should be some sort of attrition for attacking castle/fiefs, but fat chance of that happening.
ALL HAIL M:E