The home was purchased by Benjamin Brown for his family. When Benjamin Holt, a business man whose family-held companies would eventually merge to form the Caterpillar Tractor Company, married Brown's daughter Anna, Holt moved into their family home. At the time that Brown purchased the house, it was adjacent to the El Dorado Brewing Company and diagonally across from the state mental hospital.[3][4]
The house is a two-story, Colonial Revival, wood-frame structure, that has had numerous additions since it was first built. A garage was added in 1904 to house the family's new car.[2] The living area is 5,542 square feet (514.9 m2) on a half-acre lot.[5]
Since 1980, part of the property has served as headquarters for the Forty-Niner Council, Boy Scouts of America.[2]