I get what you're saying. There was another of our members here at VGC who late last year made a similar contention about not letting others define me when I mused about embracing the term moderate and it resonated with me at the time. The label "progressive" has just become a burden to me at this point though. It's not worth calling myself a progressive only to inevitably have to spend the rest of a given conversation defending my legitimacy as one. It subtracts from my ability to talk about issues at this point rather than adding clarity to where I stand.
I think that is fair too, but it begs the question, why are you searching for a label in the first place? I think in some ways I'm probably more "progressive" than you, but I don't think I've ever called myself a progressive. Labels can be a valuable shorthand for expressing your opinions, but if they don't fit, you don't really need to go on a vision quest to find a new one.
I want a label because if I don't label myself, if I don't define myself that way, somebody else will and I'd like that less.