From 1931 to 1939, Matthias was in private practice of law in Columbus, was elected to the Ohio House of Representatives from Franklin County, Ohio in 1934, lost re-election in 1936, but was elected again in 1938. He was elected to the Columbus Municipal Court in 1939, and was sworn in by his father on January 1, 1940.[1] In 1944, GovernorJohn W. Bricker appointed Matthias presiding judge of the Columbus Municipal Court, and he was elected to six-year terms in 1945 and 1951.[1]
Matthias's father died in 1953, and Governor Frank Lausche appointed Democratic judge John H. Lamneck to the seat. John M. Matthias ran for the remaining two years of his father's term in 1954, winning the Republican primary without party support, and defeating Lamneck in 86 of 88 Ohio counties. He won a six-year term in 1956, and was re-elected in 1962 and 1968.[1]
At the beginning of 1970, Matthias could not perform his duties due to failing health, and Robert E. Leach sat on assignment for him. Matthias resigned September 25, 1970, and Governor Jim Rhodes named Leach to replace him.[1]
Matthias married Lois Kirkpatrick on March 20, 1939. They had one son, the writer and educator, John Matthias (b. 1941). John M. Matthais died at his Upper Arlington, Ohio home on January 25, 1973, and was buried at Green Lawn Cemetery[1]