While I personally place some weight on someone's physical appearance (okay - quite a bit actually), it's the person inside the appearance that counts.
So yeah, if I happen to meet and develop feelings for a handicapped person, why not? You don't suddenly become a subhuman just because you've lost an arm or something.
Warning: The preceding message may or may not have included sarcasm, cynicism, irony, full stops, commas, slashes, words, letters, sentences, lines, quotes, flaeed gramar, cryptic metaphors or other means of annoying communication. Viewer discretion is/was strongly advised.