He didn't pass through time, he sat there for seven years. My brother and I always had this joke where we thought since Link didn't starve to death, Rauru must've been feeding him, not to mention dressing him and cleaning up after him, or when he woke up Link would've looked like a Hylian hobo/junkie, holding the master sword, weighing 50 pounds, dressed in ripped up 7 year old rags designed for someone half his size and standing in 7 years worth of his own waste.