Williams played a pivotal role as a saxophonist in the Waitresses from 1980 to 1983, contributing to hit songs like "Christmas Wrapping," "Square Pegs," and "I Know What Boys Like." His involvement with the Psychedelic Furs began in 1983 when he filled in for their saxophonist during a tour, leading to a tenure that extended until 1989. Williams later rejoined the Psychedelic Furs in 2005, continuing until his final tour dates in October.