Which direction should I head in.

Started about 2 weeks ago and feel like I’m walking the wrong way. I’ve finished 2 of the memories, but now all my side quests are in unexplored areas, I wondered off and got the big horse quest, but I’m way too underpowered even for that.

So not really sure which side of the open world I’m meant to explore and have a chance of actually achieving anything?