In 1883, Kabayama changed from the army to the navy, becoming taifu (senior vice minister) of Navy with the rank of rear admiral, and was also ennobled with the title of viscount (koshaku) under the kazoku peerage system. The following year he was promoted to vice admiral.
Kabayama became Vice Navy Minister in 1886. He visited the United States and Europe from 25 September 1887 to 19 October 1888. He then served in several positions before being appointed Navy Minister under the first Yamagata and Matsukata cabinets from 1890 to 1892. Although not a politician, he spoke out harshly against representative democracy and civilian influence on the government in a speech Banyu Enzetsu made during the second Imperial Diet session. He retired in 1892.
Kabayama was commander of the Japanese invasion force for Taiwan. On 10 May 1895, he was promoted to full admiral and became the first Japanese Governor-General of Taiwan, being responsible for moving the seat of government to Taipei. He was elevated to hakushaku (Count) on 5 August 1895 and also awarded the Order of the Rising Sun (first class).
Despite his best efforts to stabilise Japan's rule over Taiwan, his 13 months term as Governor-General were not peaceful. From December 1895 to January 1896, uprisings surfaced in many parts of the island, and he was forced to request reinforcements from home. In the ensuing action, 2800 Taiwanese were killed. Kabayama was succeeded by Lieutenant General Katsura Tarō.[4]
After his return to Japan in June 1896, Kabayama subsequently served on the Privy Council, as Home Minister under the 2nd Matsukata Cabinet, and Education Minister under the 2nd Yamagata cabinet.
Kabayama retired again from duty in 1910. His grave is at the Somei Reien Cemetery, in Sugamo, Tokyo.
Ching, Leo T.S. (2001). Becoming Japanese: Colonial Taiwan and the Politics of Identity Formation. University of California Press. ISBN0-520-22553-8.
Keene, Donald (2005). Emperor Of Japan: Meiji And His World, 1852-1912. Columbia University Press. ISBN0-231-12341-8.
Paine, S.C.M. (2001). The Sino-Japanese War of 1894-1895: Perception, Power, and Primacy. Cambridge, MA: Cambridge University Press. ISBN0-521-61745-6.
Sims, Richard (1998). French Policy Towards the Bakufu and Meiji Japan 1854-1894. RoutledgeCurzon. ISBN1-873410-61-1.