you don't need to worry if you accidentally ingest a small sip of spoiled milk, but avoid drinking it in large -- or even moderate -- quantities. drinking spoiled milk can cause digestive distress, such as vomiting, abdominal cramping, and diarrhea.