This study investigates how individual’s sociodemographic characteristics and contextual factors are associated with change in social connectedness in later life. I use longitudinal and nationally representative data on 1,314 older adults from the National Social Life, Health, and Aging Project. I use between-within models to disentangle between- and within-individual effects of sociodemographic characteristics and contextual factors on three aspects of social connectedness in later life. I find that patterns of network change vary by people of different social backgrounds. Racial and ethnic minority status as well as less education are associated with smaller network size, higher frequency of contact, and proportion of kin. Functional and mental health, changing in working status, household size, and neighbor ties are also linked to network change. In summary, disadvantaged backgrounds and contextual factors are associated with certain network characteristics which helps to explain the concentration of social disadvantage on certain population.