If this rumor is true: It's probably 3.5 to compensate for how bad the OS on the ps3 was with the amount of ram it had. They could make the OS use less ram in the future, but for now, since no games need over 4 rams yet - they're using it for the OS instead and will work to optimize it over time and allot more ram to be available for developers. At least that's what many people were saying on gaf.
There really isn't another reason why the ps4 needs more ram for its OS than the xbox one. I'm guessing they don't want something like cross-game chat to be an issue this gen or make multitasking as good as possible. If rumors are to be believed- the ps4's OS was once only using 512 megs - but then they doubled the amount of ram on the ps4 from 4 to 8. Why not use the extra space to future proof the OS and make it as smooth as possible.
But honestly, Eurogamer's track record for these things lately have been bad and I doubt we'll see 3.5 for the OS at launch.