It's still not racist. How those people in the predominantly black community perceive it still doesn't make it racist. It's a stereotype. If I ask a latino man if he wants a taco when he's at the restaurant it's crude, judgemental and STEREOTYPICAL. Not racist. I'll reiterate again, his remark was rude and not acceptable, but still isn't defined as racist.
Stereotypes are based upon many things... some on sex, some on race, some on other things. The fact is that this stereotype is based on race and therefore the comment was a racist one. If somebody used a stereotype that had something to do with women, it would be a sexist comment.