you may substitute water, yes, but be sure to also add in a flavorless oil, egg and some vanilla. the water should only be a bout a cup or so so as to not dilute the batter to much.