What is your earliest memory? For most people, it is a fragment of something that happened when they were 3 or 4 years old. You cannot access most of your childhood memories by the time you grow up. But your memories did become easier to retrieve after you were old enough to describe them in words. It may be that your early memories were laid down in a form that your mind either cannot understand or cannot find.