mash potatoes with a potato masher on the heat for 1 to 2 minutes (doing so will allow the excess moisture to evaporate). remove from heat and continue mashing until mostly smooth. add olive oil and mash to incorporate, then add milk, salt, and pepper and mash until smooth and creamy.