Isn't calling someone a troll trolling as well? I seem to remember hearing about warnings being handed out for that.
You're right. I can't say I called him a troll, but it seems you did. I'd give you a warning but it seems a simple slap on the wrist should suffice.