Is "Bugger" a swear word???

[--OkeyDokey--]

lol. I say this word maybe two, three times a day.

I don't think of it as a swear word... more of a replacement for a swear word. Ya know "bugger off", "funny bugger" etc...