I'm less concerned about high difficulty, and more about low difficulty being too easy, or a vastly different experience.
It was Resident Evil 4 (OG) that scarred me for life.
I started playing on Normal, but after beating the game I decided to start over on Easy and unlock all the New Game + stuff so I could boot up that file if I ever want to just have some mindless fun with max upgraded weapons/infinite ammo etc vs easier enemies.
Well, while I discovered that entire sections of the game were removed from the Easy mode. Or rather, you were locked out of them. (The garden maze, the clock tower, a portion of the castle, etc)
After that, I didn't want to select Easy on any game again.