Not necessarily. You could be anti-immigration for racist reasons, or out of “cultural-erosion” fears. Or, if you believe most immigrants are non-working, non-consuming entities who will somehow place a cost on the system, you could believe that free enterprise needs the support of the powerful state to control market conditions. But otherwise, yeah....