The band was formed by twin brothers Ray and Brandon Carlisle, following the dissolution of their previous band, Homeless Wonders, in 2000. Their music is heavily influenced by co-singer guitarist Kody Templeman's other band, The Lillingtons, and punk rock acts such as Screeching Weasel, The Ramones, Bouncing Souls, and Misfits.