To the north of the hamlet, on the coast, is an ancient moated site, dating from the 12th to 14th centuries, formerly the site of a fortified medieval manor house. It was the seat of the Grimston family until a fire in the mid-17th century.[2]
The family then built a new manor house at Grimston Garth in 18th-century Gothic style. Grimston Garth lies south of the hamlet on a private road. The stable block at Grimston Garth was designated a Grade II* listed building in 1966 and is now recorded in the National Heritage List for England, maintained by Historic England.[3]
