There certainly rascists around in this country, but this isn't a UK-specific disease. Every country to a degree harbours rascism. I think the specific problem the UK has is that we surrendered national pride to the NF in the 70s.
Since then, whenever people speak in favour of tighter immigration policies, or pride in their country, it sounds exactly like NF/BNP sympathies, and there's no room left for you moderates (and yes, I'm including Ward~Minter in that...I see through his occasional stirrings as easily as grandma's underwear).
By the way, we're not 'swamped' by immigrants. Non-Britons make up around 6% of the population. Remember that immigrant populations are concentrated in urban areas, which may give the impression that numbers are greater than they are.