Cognitive changes associated with PASC may not be uniform across populations. We conducted individual-level pooled analyses and meta-analyses of cognitive assessments from eight prospective cohorts, comprising 2,105 patients and 1,432 controls from Argentina, Canada, Chile, Greece, India, Italy, Russia, and the UK. The meta-analysis found no differences by country of origin. The profile and severity of cognitive impairment varied by age, with mild attentional impairment observed in young and middle-aged adults, but memory, language, and executive function impairment in older adults. The risk of moderate to severe impairment doubled in older adults. Moderately severe or severe impairment was significantly associated with infection diagnoses (chi-square = 26.57, p ≤ 0.0001) and the severity of anosmia (chi-square = 31.81, p ≤ 0.0001). We found distinct age-related phenotypes of cognitive impairment in patients recovering from COVID-19. We identified the severity of acute illness and the presence of olfactory dysfunction as the primary predictors of dementia-like impairment in older adults.