Hermann was drafted by the New York Giants in the 10th round (117th overall) of the 1956 NFL draft. He played two games for the Giants before being cut. He signed two weeks later by the Baltimore Colts and finished the year with them.[1]
In 1959, Hermann joined the UCLA coaching staff as the head coach of the freshman football team. He also coached the Bruins quarterbacks, tight ends, and running backs until the end of the 1964 season when he was dismissed by incoming head coach Tommy Prothro. John then became head coach of Compton College (1965) before joining the coaching staff at Los Angeles State College in 1966. He became head coach of the Diablos in 1967 and athletic director in 1970.