Brown attended Marion County High School in Jasper, Tennessee, and graduated in 1970. At the University of Tennessee, he was a safety and punt returner. In 1973, he was team captain as a senior and was a first-team All-America selection by Football News.[1]
Brown was drafted by the Cleveland Browns in the eighth round of the 1974 NFL draft. He was traded to the Washington Redskins during the 1975 season, and was an All-Pro and Pro Bowl selection during the 1976 and 1977 seasons. In 1976, he led the National Football League in punt return yardage with 646 and was second in yards per return at 13.5. He also had a 71-yard return for a touchdown that season. In 1977, he led the NFL in punt returns with 57. On October 9, 1977, his 11 punt returns against the Tampa Bay Buccaneers set an NFL single-game record.[2]
Traded to the Los Angeles Rams in 1978 for offensive lineman Jeff Williams, Brown played that season and 1979 for the Rams.
Brown returned to professional football in 1983 with the Chicago Blitz of the United States Football League. He had six interceptions, including one returned for a touchdown, that season.[3] He played for the USFL's Arizona Wranglers in 1984 and had two interceptions.[4]
Brown was inducted into the Tennessee Sports Hall of Fame in 2002.[5]