Willey was a native of Cherryfield, Maine, who threw and batted right-handed, stood 6 feet (1.8 m) tall and weighed 175 pounds (79 kg). He missed the first three months of the 1964 season after having his jaw broken by a line drive hit by Gates Brown during a spring training game.[2] After his playing career ended, Carlton Willey served as a scout for the Philadelphia Phillies.