You are at the highest point of the Via Claudia Augusta cycle route between Ehrwald and the Inn Valley. From now on it's (almost) all downhill.
The route to Fernstein Castle over the Fernpass was expanded a few years ago so that you no longer have to cross the busy main road. All you have to do is follow the signs for Via Claudia.