I'd say that dark matter is the other dimension, anti-mater is merely the return to the void before the big bang - before human consciousness began to determine quantum direction through observation.
That which is not seen has no set destination in the quantum world. However, to utilize such a trait for time travel, one has to fail to see it; a paradoxical impossibility IMO.
The multi-verse would have to exist to allow for time travel in the sense of going to times that have not, or have already, happened. I suspect if multi-verse isn't real, then time travel in the "physical" sense is also not real.
That said, we already experience a form of time "travel," every time we view a star we are seeing the past. Thus it is perspective more so than time - change your perspective and you change the time you are viewing - as simple as changing the channel on the TV (another form of time "travel.") Experiencing it, or re-experiencing it, however, is an entirely different matter...