Two games into the 2006 season, Spencer suffered a broken leg and was out for the year. He missed the entire 2007 season due to this injury as well. He was released on July 22, 2008.
Carolina Panthers
A day after being waived by the Texans, Spencer was claimed off waivers by the Carolina Panthers. He was waived again on August 7, with Panthers head coach John Fox citing "conditioning and weight" as the reason.[4]
Jacksonville Jaguars
On September 3, 2008, Spencer was signed by the Jacksonville Jaguars. The move came a day after Jaguars offensive tackleRichard Collier was shot and hospitalized with life-threatening injuries. Collier was placed on the reserve/non-football injury list to make room for Spencer on the roster. He was waived on December 21 without having played a game for the Jaguars.
Spencer was re-signed to a future contract by the Jaguars on January 12, 2009. However, he was released on April 29, 2009.