Swisher was drafted in the first round in June 1973 by the Chicago White Sox. He spent his first year of professional baseball with the Knoxville Sox and six games with the Iowa Oaks, batting .211 and .286 respectively. He was traded along with Steve Stone and Ken Frailing from the White Sox to the crosstown Cubs for Ron Santo on December 11, 1973.[2]Jim Kremmel was also sent to the Cubs to complete the transaction one week later on December 18.[3] Swisher was selected as the Cubs' representative for the 1976 MLB All-Star Game; he hit .236 that season with five home runs and 42 runs batted in.[4][5] In a 2014 piece for ESPN.com, Jim Caple listed Swisher as one of the "five worst players named All-Stars".[5]
Swisher, who had appeared in 109 games in his All-Star season, saw his playing time drop to 74 games in 1977, while batting just .190 with five home runs. In December 1977, he was traded to the St. Louis Cardinals in a four-player deal and played sparingly over the next three seasons. In late 1980, he was sent to the San Diego Padres in a multiplayer trade. Swisher never appeared in more than 45 games in a season with the Cardinals or Padres. He was granted free agency after the 1982 season and never played in the major leagues again.[4]
He subsequently spent single seasons as the manager of the Class AAA New Orleans Zephyrs (1997) and Class AA Reading Phillies (2005).[6] After being hired by Reading in late 2004, Swisher suffered a fall down a staircase and was rendered comatose. He had recovered enough to manage Reading in 2005, but his tenure there was punctuated by personality conflicts and the team did not renew his contract after that season.[7]