Frazier Brook begins in Danbury, New Hampshire, just south of the town center, and flows south through the town of Wilmot into Andover. Eagle Pond and Bog Pond interrupt the brook's flow. Shortly below Bog Pond, the brook reaches the Blackwater River at the village of Cilleyville.
Frazier Brook is paralleled for most of its length by U.S. Route 4.