Do people fear you because of your skin color?

[Madword]

I remember walking home once and as I was walking up the road a woman in her car locked the doors, she obviously thought I looked dodgy.

Also I recently got told after giving a presentation (for indie funding) that I looked much better when smiling because I looked scary otherwise :(

Ps I am white. So the thing is, are people scared of skin colour or scared of face/look? I would think there are some people who are scared of skin colour, but I think how a person looks makes a big difference, for example people wearing scruffy looking hoodies...