what is the difference between yellow cake and vanilla cake? so a yellow cake is a type of vanilla cake. vanilla cakes will either be white if they use egg whites or yellow if they use whole eggs and butter. many white cakes will use oil and colorless flavorings like almond oil to keep the color light.