I will admit that in VR, it's probably as scary as you claim, but that's more the technology. If some of these other horror games were in ultra realistic virtual reality, I'd easily call them scarier. In a way it's the scariest, but not because it deserves the title.
The Silent Hill series will probably blow this away the moment they make a virtual reality horror game. Those silly indie horror games with like one monster chasing you don't even really count. Things that rely entirely on jump scares are garbage.