Annoying?.....
Even if you are casual, 240g(max which will be HARD to achieve) wouldn't hurt much. If anything, it makes it so that those who own fiefs get like a "inn" tax for all the fools staying in it, otherwise, why should factions allow randoms to just hide in their fiefs? They'll just kick them out all the time and then let someone attack them to get rid of them.
Shouldn't you encourage factions to let randomers in? What better way than letting the factions make small, long term income off of it. You might even see more open borders.
If cap it out at 10g max per hour(or maybe a daily rate of 100 cap), it won't affect casuals nor will it really hurt traders and actives. (it'll only hurt if you AFK for like 1 week with little money)