I have a Viet friend, and Americans of Euro descent have often said things they've learned in Chinese or Japanese to him (not saying that this behaviour is exclusive to any ethnic group, it just happened this way to him). It pisses him off to no end. AFAIK, no one has yelled at him, but it's still offensive to him.