If you swim with contacts on, do not open your eyes under water.
In saltwater, the salt will draw water out of the contact lens, making it tight and hard to remove; trying to remove a tight lens can damage the cornea.
In freshwater, the contact lens will take in water, becoming loose with a chance that the lenses will be lost.