today, fudge can be made with just chocolate and condensed milk at its simplest form. chocolatiers often make fudge in its original form of chocolate, cream, butter, and sugar. the actual history of fudge is foggy, but it is known that it was invented in baltimore around the end of the 1800s.