Chavagnes en Paillers is known as one of the two villes saintes (holy towns) of the Vendée. (The other is Saint-Laurent-sur-Sèvre). It is home to the mother-houses of two religious congregations: the Sons of Mary Immaculate and the Ursulines of Jesus, both founded by the Roman Catholic priest Louis-Marie Baudouin in about 1802 in the wake of the French Revolution (1789) and the War in the Vendée (mainly 1793-1796).
Still present also in Chavagnes is the seminary Baudouin founded for the training of boys and men destined for the priesthood. It was the first junior seminary to be approved in France after the Revolution. It now continues as Chavagnes International College, an international Catholic boarding school for boys, teaching through the medium of English.
The word Chavagnes is thought to come from the dog Latin cabanas, meaning cabins. The inhabitants are known as Chavagnais.