do they taste like oranges? kumquats have a flavor of their own, and as you'll learn, the juice is quite sour, whilst the skin is sweet (when fully ripe). they don't taste like oranges because they are a different fruit, however, they are still citrus, so it won't be a shocking flavor you will be surprised by.