Music and lyrics
AllMusic's Amy Hanson categorized the track as a "deep rolling bass-led cacophony,"[3] while Sasha Frere-Jones of New Yorker argued that its "rhythm section vamps around a menacing bass figure while the guitar lurches back and forth, unsure of whether to make noise or form chords."[6] Cave’s barely comprehensible yowling vocals on the track also contrasts with "the ominous baritone with which he’s now indelibly associated."[7]

Lyrically, the song was meant to be a self-parody, caricaturing the band's gothic associations. The title and lyrics of the track employs typical gothic themes, with attacking phrases such as "sex horror sex bat sex sex horror sex vampire sex bat horror vampire sex."[8]

Reception and legacy
AllMusic critic Amy Hanson described the track as "the quintessential Birthday Party song," stating: "The song's title alone ensured that "Release the Bats" became a mantra for the gothic generation as vampires, blood, and biting were so popular with the caped crowd."[3] The song formed a basis for the gothic rock genre,[9] which was later dismissed by Cave.[3]

NME listed the track as number 7 on its list of "The 20 Greatest Goth Tracks."[9] The single was also featured on Fact magazine's list of "20 best: Goth records ever made" as number 5.[7]