Before you can worry about entering the town, you need to reach the desert itself. The easiest path starts from Gerudo Canyon ...

Breath of the Wild initially seemed to resolve problems for the shared Zelda timeline, but only raised further questions.