if the temperature gets higher than that, bacteria can start to grow in the milk, which is what causes the rotting and the smell. (though, for what it's worth, you can generally leave milk out of the fridge for up to two hours without any serious issues.)