The second Knesset started with David Ben-Gurion forming the third government of Israel (the first Knesset had two governments) on 8 October 1951. His Mapai party formed a coalition with Mizrachi, Hapoel HaMizrachi, Agudat Yisrael, Agudat Yisrael Workers and the three Israeli Arab parties, the Democratic List for Israeli Arabs, Progress and Work and Agriculture and Development. Like the first Knesset, there were 15 ministers. The government resigned on 19 December 1952 due to a dispute with the religious parties over religious education.
Ben-Gurion formed the fourth government on 24 December 1952, dropping the ultra-orthodox parties (Agudat Yisrael and Agudat Yisrael Workers) and replacing them with the General Zionists and the Progressive Party. The new government had 16 ministers. Ben-Gurion resigned on 6 December 1953 as he wished to settle in the Negevkibbutz of Sde Boker.
Moshe Sharett formed the fifth government on 26 January 1954 with the same coalition partners and ministers. Sharett resigned on 29 June 1955, when the General Zionists refused to abstain from voting on a motion of no-confidence brought by Herut and Maki over the government's position on the trial of Malchiel Gruenwald, who had accused Rudolf Kastner of collaborating with the Nazis.
Sharett formed the sixth government on 29 June 1955, eliminating the General Zionists and the Progressive Party from the coalition and reducing the number of ministers to 12. The new government did not last long, as a general election was called for 26 July 1955.