Kline was an unsuccessful candidate for election in 1912, but was elected as a Republican to the Sixty-seventh Congress. He was an unsuccessful candidate for reelection in 1922. He resumed the practice of his profession in Sunbury, and died in DeLand, Florida. Interment in Pomfret Manor Cemetery, in Sunbury.