Do people fear you because of your skin color?

[SvennoJ]

Not for my skin color as I'm within the preferred color range in this world.
Yet when I still had long hair I was 'randomly' picked an awful lot for extra security checks at airports. Probably more so with the expectation of finding drugs than anything else.