Findings reveal the relationships between socioeconomic status, brain size, and cognition are established early in life.