Make sure the container that you are storing the milk in is clean. Containers should be made of glass or hard plastic bottles. Lids should be tight-fitting to seal out germs.