Don't forget the French refer to us as 'roast beef' and a lot of yanks refer to us as 'limeys' (sp?).
It's never been classed as racist.
Let's be honest, I'd say more countries have a disliking of the English than any other nation (America might catch up soon). Even our closest neighbours the Welsh, Scots and Irish contain many people who hate us.
It's like the Milwall song 'no-one likes us, we don't care'.
As for telling someone who doesn't live her to f*ck off home, that's not racist. It may rude, abusive and wholey inapropriate, but it's not racist.