This paper provides the first causal evaluation of the political impact of asylum seekers in the UK. Although they are dispersed across areas on a no-choice basis, political bargaining between central and local governments introduces potential endogeneity in their allocation. We address this concern with a novel IV strategy that exploits predetermined public-housing characteristics. Focusing on 2004-2019, we estimate a sizeable increase in the Conservative-Labour vote share gap in local elections: a one within-area standard deviation increase in dispersed asylum seekers widens the gap by 3.1 percentage points in favour of the Conservatives. We observe a similar shift to the right in national elections and longitudinal survey data on voting intentions, along with an increase in the Leave vote in the Brexit referendum. Electoral gains are observed for UKIP as well, although this finding is less robust. No effect is detected for non-dispersed asylum seekers, who forgo subsidised housing and make independent residential choices. Turning to mechanisms, voters move to the right without becoming more hostile towards foreigners. Leveraging the universe of MPs' speeches, we show that representatives from more exposed areas emphasise asylum and migration more, with no systematic change in tone or content. This heightened salience appears to shape voters' choices, with Conservative MPs particularly effective at channelling discontent.