freeze celery leaves along with the stalks, or dry leaves in a parchment-lined box lid. to freeze celery leaves solo, roll them into a cigar shape that fits snugly in the base of a freezer bag.