Over time, there is a build-up of toxins such as tau proteins and beta-amyloid plaques in the brain that correlate to the aging process and associated cognitive decline. Although this is a natural part of growing older, many factors can exacerbate it. Stress, neurotoxins such as alcohol and lack of (quality and quantity) sleep can speed up the process.