If your soul remembers lessons from one life to the next, then you can carry knowledge to the next. All we have to do is to make it so that this knowledge is open and accessible in the next life, and the life after that.
The issue is that with every life, you forget who you were and what you did. And since you never die, every life is just a continuation of the last. So if you die in a certain frame of mind, you will start your next life from that frame of mind, which determines the types of things you attract in your life. So if you want your life to get better, you must change your mindset.
Moreso, if one wishes to visit their past lessons and knowledge, one must access the akashic record. And I suppose if someone were to write a story but it was never shared or finished, another life could learn about it and write it/continue it, then share it with others.
But...what if one of the reasons we forget is to give us more free will? The longer you associate yourself with an identity, the less open you are to become something else. But if you forget who you were, and your connection to that, you get to experience new things and make new choices.
Respawning = Reincarnation (forgetting everything at the start of a new life)
Permashifting = New life w/o forgetting
The only way not to forget your memories in a new life is to permashift. All you have to do is shift once while scripting that when you arrive in your DR shifting is easy and you have a 100% success rate every time, and you can continue on easily.