final thoughts. so, it can be seen that there are many reasons as to why your banana bread tastes bitter. however, they all relate to the baking soda in the recipe. baking soda that is out of date or not sieved properly can add a bitter taste.