...No, that's wrong. You need to have the skills required to use it before you heirloom it, otherwise it won't even appear as an eligible item to heirloom.
This is why you have to plan accordingly...for example:
You want to have some heirloomed items when you play as an archer? Play 2 generations as another build so that you can have triple-heirloomed arrows (bodkin recommended) the gen of your archer build.