if your supposedly "sweet" peppers taste bitter, the most likely culprit is lack of water. pepper plants need to be consistently moist. drought-stressed peppers go into survival mode, hastily ripening fruits and seeds without putting much energy into flavor. the resulting peppers are thin-walled and bitter.