what do capers taste like? capers, though quite small, pack a big punch: they're quite tangy and add a lemony, olivey burst of flavor to dishes. the caper's intensity comes from the mustard oil (methyl isothiocyanate) that is released from glucocapparin molecules.