Moseley was born in Chicago, Illinois, the son of Marion (Wilder) and Carlton Moseley, who was President of the Chicago office of Chase & Sanborn Coffee Company.[3]
In 1937, Moseley was divorced by his wife, Ethel Spencer Moseley, at Geneva, Illinois, on grounds of desertion.[4] His son Spencer Dumaresq Moseley was also a football star at Yale. He was captain of the 1942 team and was also an All-American.[5] His grandson is actor Bill Moseley.[6][7]