"These residences of the 1820s were almost all builder's, carpenter's, or stonemason's homes, and there were several blocks of them at one time. In 1899 Montgomery Schuyler, the critic, wrote that they were 'the most respectable and artistic pattern of habitation New York has ever known.'" The house was listed April 19, 1966, as a New York City Landmark.[4]
The structure retains all original window frames and lintels (except in the dormers).[4] At least until 1971, when the property was nominated to the National Register of Historic Places, the trim was white and many original interior features of the house remained. Some minor exterior changes were made during the Victorian period. The house was added to the National Register of Historic Places in 1972 for its architecture.
From 1959 to 1968, the photographer Diane Arbus lived in the former stable behind the main house at 131 Charles St. The address of the back house is 131½ Charles St.[5]