Major time travel issue I never see considered

[Vertigo-X]

I imagine it wouldn't be a problem because it would only be the same location relative to your frame of reference; i.e. being on Earth your time travelling would be subject to being 'pushed'/'pulled' with the planet/solar system/galaxy.