The observatory building commenced to designs by Henry Keene in 1772, and was completed in 1794 to the designs of James Wyatt, with a prominent octagonal tower based on the Tower of the Winds in Athens. Its tower is topped with a statue by John Bacon of Atlas holding up the World.
Until 1839, the Savilian Chair of Astronomy was responsible for the observatory. At this date the appointment of George Henry Sacheverell Johnson an astronomer with no observational experience caused the creation of the new role of Radcliffe Observer.
Because of the viewing conditions, weather, urban development and light pollution at Oxford, the observatory moved to South Africa in 1939. Eventually that site, in Pretoria, also became untenable and the facility was combined with others into the South African Astronomical Observatory (SAAO) in the 1970s.