After taking down a castle wall with catapults.
There should be a one week period where it stays down or gets up again day by day like per one hit with catapult one day to repair that damage.
EDIT: if so then it may be suitable to increase the costs of catapults. Also i don't know if the materials stay in your stock when catapults didn't get destroyed it is arguable that they should.