Baroness formed in mid-2003,[1] founded by former members of the punk/metal band Johnny Welfare and the Paychecks.[2] Singer John Dyer Baizley creates the artwork for all Baroness albums, and has done artwork for other bands and labels such as Darkest Hour, The Red Chord, Vitamin X, Skeletonwitch, Sounds of the Underground, Kylesa, Kvelertak, Black Tusk, Daughters, Torche, Pig Destroyer, and the Magrudergrind/s**tstorm split grindcore CD on Robotic Empire.[3]
From 2004 to 2007, Baroness recorded and released three EPs, named First, Second and A Grey Sigh in a Flower Husk (aka Third), with the third one being a split album with Unpersons.