Jan Kempdorp was laid out on the farm Andalusia and at first bore that name. During the Second World War it was the site of a concentration camp housing German men regarded as potentially dangerous by the authorities. The first settlers bought plots in 1938, and the town was proclaimed in 1953 and named after General Jan Kemp, a former Minister of Lands. Municipal status was attained in 1967. Originally, the border between the Cape and Transvaal provinces ran through the town, making it the only town in South Africa that was in two provinces. This also led to confusion about the administration until in 1964 it was decided by Parliament that the town would be deemed to fall in the Cape for legal purposes.[2]
When new provincial boundaries were drawn in 1994, Jan Kempdorp was still divided, now between the Northern Cape and North West provinces. The whole of the town was, however, included in the cross-border Phokwane Local Municipality. In 2006 cross-border municipalities were eliminated and the whole of the town was included in the Northern Cape.
During South Africa's Border War Jan Kempdorp was the location of a munitions store, guarded 24 hours a day by National Servicemen who were first required to be of a lowered medical classification.
Jan Kempdorp is located on the N18 national road, which branches from the N12Kimberley–Johannesburg road at Warrenton and runs through Jan Kempdorp to Vryburg, Mahikeng and the Botswana border. It is also situated on a railway line that branches from the Kimberley–Johannesburg main line at Fourteen Streams and runs parallel to the N18 to Mahikeng and Botswana.