I love this idea. Fuck yes!
And I agree with kinngrimm that these hideouts should have S/D and stuff like that (I dont even strat). Now, this is just me making shit up, but hypothetically a bandit camp would have the potential to be more than just a place to store loots and troops. Over time, it would only be natural to see such a camp grow to include some sort of trade, whether it be a lone merchant or two, or a small market.
I'm fine with this camp thingy just being a loot/troop dump, tho.