the name devils on horseback was chosen as a counterpart to angels on horseback (bacon wrapped oysters), which preceded them on the culinary scene. a substantial amount of cayenne pepper was called for in the original devils on horseback recipe, which made them devilishly hot. hence the name.