Concurrent with his federal judicial service, Gholson served in the Mississippi State Militia as a lieutenant in 1846.[2]
Later career and death
During the American Civil War, Gholson served in the Confederate States Army as a private, captain, colonel, and brigadier general, and as a major general of Mississippi state troops.[1] Gholson initially enlisted as a private, taking part in the battles of Fort Donelson, Iuka, and Corinth in 1862.[3] In the spring of 1863 he was appointed as major general of the Mississippi State Troops, and the following year was commissioned as a brigadier general of Confederate cavalry transferred from state service. Gholson was severely wounded in the December 1864 Battle of Egypt Station, and lost his right arm.[3] After the war, he was a member of the Mississippi House of Representatives from 1865 to 1866, and in 1878.[2] He was its Speaker in the 1865-1866 session, the last session before 1870.[4] He resumed private practice in Aberdeen, Mississippi from 1866 to 1878, and from 1878 to 1883.[2] He died on October 16, 1883, in Aberdeen.[2] He was interred in Odd Fellows Cemetery in Aberdeen.[1]