It is not because you're against massive immigration from Third World countries that you are racist. I find all cultures interesting ,but that doesn't mean I want them to be my neighbour.
Also, like Oberyn said, it would be more intelligent to help them re-build their country instead of spending money to get them here. It is in fact worsening the problem, because most of their skilled workers
and elites are leaving their countries for Europe and North America.