Joy Zipper's second album, American Whip was co-produced and mixed with Kevin Shields (My Bloody Valentine) and DJ/Producer David Holmes (Oceans 11, Out of Site). The recording was started at Cava Studios in Glasgow, Scotland with Tony Doogan ( Belle & Sebastian, Snow Patrol, Mogwai). Mick Cooke of Belle & Sebastian played Flugelhorn on a number of the songs. Joey Waronker (Beck, R.E.M.) played the drums on American Whip which were recorded at George Martin's AIR Studios in London by David Holmes. The album was mixed at Ray Davies' Konk studio in Hornsey and The Dairy studio in Brixton with Kevin Shields and Guy Fixsen (Laika). It was released on Vertigo/Mercury Records in 2003 and in America on Dangerbird Records in 2005.

In December 2019 The Guardian newspaper listed Christmas Song as one of the 50 Greatest Christmas songs.