To be fair, in your example, he was telling the nasty and mean people to sod off.
�For I was hungry and you gave me nothing to eat, I was thirsty and you gave me nothing to drink, I was a stranger and you did not invite me in, I needed clothes and you did not clothe me, I was sick and in prison and you did not look after me��.whatever you did not do for one of the least of these, you did not do for me.�
They just got what they deserved - that is God�s judgement. Similarly we cast judgement on people who are selfish and unkind and will generally disassociate ourseleves from them (or at least give them dagger looks).
We, like God, look after the good and true as we expect they would look after us.