horseradish can cause side effects including stomach upset, bloody vomiting, and diarrhea. it may also slow down the activity of the thyroid gland. when used on the skin, horseradish is possibly safe when preparations containing 2% mustard oil or less are used, but it can cause skin irritation and allergic reactions.