William Patterson, a founder of the B&O railroad, built Springfield as a summer home and slave plantation on 3,000 acres. The estate was later purchased by Frank Brown who would become the Governor of Maryland. While serving as governor, he sold the estate to the State of Maryland for a mental hospital.[2]