how to make hasselback sweet potatoes. to start, scrub, wash and dry the sweet potatoes thoroughly. this is an important step since you'll be eating the skin of the potatoes. if you prefer not to eat the skin, you can peel it before baking so that you still get a crispy exterior.