Dhampy's answer needs to be repeated.
People often invent memories for something they don't remember but think they should.
Leia's reminiscences are illusory.
They don't even square with the story in the trilogy. Obi-Wan said that the twins were hidden at birth to keep them secret from Vader and the Emperor. This implies that the mother--we did not know she died in childbirth at the time--was a non-factor from birth.
Jeebus, it's not rocket surgery,