Peck was born in 1840 in Henderson, New York, the oldest of three children of David B. and Alzina P. (Joslin) Peck.[2] In 1843, the family moved to what is now Cold Spring, Wisconsin. Peck attended public school until age 15 when he was apprenticed in the printing trade. He married Francena Rowley in 1860 and they had two sons. In 1863 he enlisted in the 4th Wisconsin Cavalry Regiment as a private. He was taken prisoner and held at Libby Prison in Richmond, Virginia. After he was released in a prisoner exchange, he was appointed to the United States Military Academy by Abraham Lincoln. He was promoted to lieutenant and served until the regiment mustered out in 1866.[3]
Peck became a newspaper publisher who founded newspapers in Ripon and La Crosse, Wisconsin. His La Crosse newspaper, The Sun, was founded in 1874. In 1878 Peck moved the newspaper to Milwaukee, renaming it Peck's Sun. The weekly newspaper contained Peck's humorous writings, including his famous "Peck's Bad Boy" stories.[4]
In the spring of 1890, Peck ran for mayor of Milwaukee. A Democrat, Peck was elected despite a Republican majority in the city.[4] The state's Democratic leaders took notice and made Peck the party's nominee for the 1890 gubernatorial race. Peck won the election, beating the incumbent William Hoard, and resigned as Milwaukee's mayor on November 11, 1890. He was reelected as governor in 1892, defeating Republican John C. Spooner, but lost a third term to William Upham in 1894. He ran again in 1904 but lost to the incumbent Robert M. La Follette Sr.[3]