Currently castles are pretty useless. Not near enough gold compared to a city and worse recruitment than villages. It would be nice if castles had an increased transfer and visual range and could transfer directly to villages/towns or steadier rates of gold gain and recruitment.
Either of these would make castles more important for logistics or production respectively.