In the late 1950s, the industry was again in decline, facing low-cost competition from elsewhere in the United States and abroad. Stanton managed the company as president and his son Jack served as treasurer. Jack Stanton was expected to take over as president. Seabury's brother, Otis Stanton, managed sales at the company and often conflicted with his brother, eventually selling his shares to Warren Buffett after a meeting at the Wamsutta Club.
In 1962, Warren Buffett began buying shares of Berkshire because he thought the company was selling at a discount to its actual value after noticing a pattern in the price direction of its stock whenever the company closed a mill. Eventually Buffett acknowledged that the textile business was waning and the company's financial situation was not going to improve. In 1964, Stanton made a verbal tender offer of $111⁄2 per share for the company to buy back Buffett's shares. Buffett agreed to the deal. In May 1964, Buffett received the tender offer in writing, but the tender offer was for only $113⁄8. Buffett later admitted that this lower (undercutting offer) made him angry.[2] Instead of selling at the slightly lower price, Buffett bought more of the stock to take control of the company and fire Stanton.
In December 1916, Stanton married Jean Kellogg Austin.
Stanton was Chairman of the Northern Textile Association from 1959 through 1962. He also served as a Director of the association from 1944 through 1950, again from 1951 through 1959, and from 1962 through 1965.
In 1962, Stanton published a book on Berkshire, titled Berkshire Hathaway, Inc. A saga of courage.