The house was originally owned by Lemuel Bowers, who probably operated it as a tavern. William Livingston, the first governor of New Jersey, leased the house from 1777 to 1780. He returned to his home, Liberty Hall, in 1780. Thomas Osborn bought the property in 1785.[4]