In America I look boring, average, and tall. So I rarely get a look from anyone. Most people get out of my way as I walk, and usually say sorry if they run into me. But mostly I am just invisible. My friend is really skinny and tall and sometimes gets confronted by drunk dudebros and beggars/robbers, something I rarely have to deal with.
When I went to Japan I stood out as tall and could feel some of the gaijin stigma. But nothing too ridiculous.