Each cap is equipped with a plug to help put the bottle on the cooler. Sometimes this does come dislodged and floats in the water bottle. This is nothing to be concerned about. The caps are sanitary and will not affect the quality or taste of the water.