If you build high it’s easier to scale down. Like Witcher 3 or Hellblade on Switch. Unless you can confirm Xbox Studios making cross gen games build low and scale up then maybe.
But then you have to factor in they make all games for PCs as well, which are likely spec’d higher then Xbox One specs. Which basically means my theory is more likely then yours (build high and scale down).