Don't worry, lolita, we all feel the same. I mean, I know some 200ish kanji, and I'm proud of it, but at the same time, I wish that the writing system would be easier. What Akvod said is true in a sense, there are related kanjis that use all the same radical, like
浴びる = to shower
海 = ocean
泳ぐ = to swim
They all use the same radical, which means water, which makes sense
But for every kanji that does make sense, there are sadly two that don't, and that's the hard part, at least for me