Rogers was elected as a Democrat to the 73rd and four succeeding Congresses (March 4, 1933 – January 3, 1943). He served as chairman of the Committee on Indian Affairs in the 74th through 77th Congresses. While serving as a Representative at-large, he was an unsuccessful candidate for nomination in 1941 to fill the vacancy caused by the death of Sam C. Massingale in the seventh district for the 77th Congress. He was not a candidate for renomination in 1942.
Following his retirement, Rogers engaged in building and real estate management. He was a resident of McLean, Virginia, until his death on August 3, 1983, in Falls Church, Virginia. He was cremated and his ashes were interred at National Memorial Park in Falls Church.