You are still on the path to the castle, or back to the Dwarven village, whichever way you wish to go. The path continues to the north and south.