the yeast, while it feeds and gives off the gas that causes the dough to rise, produces other substances which contribute to the flavour. so, a dough used as a pizza base which was not leavened with yeast isn't going to taste the same because it's not going to have these yeasty byproducts in it.