does it need to be refrigerated? the dump cake needs to be refrigerated once it has been baked and cooled. the fruit in the cake will spoil fast if left on the counter. you can refrigerate the cherry cake in the fridge for up to 5 days.