There is some shrinkage on average, our brains become a little smaller. Our brains also become less efficient in their use of energy. Without the presence of a disease there is no significant impact on the aging brain.