A growing interest in healthy eating has lead to an increase in the consumption of vegetables, associated with a rising number of bacterial outbreaks related to fresh produce. This is the case of the outbreak in Germany, caused by a O104:H4 enteroaggregative E. coli strain lysogenic for a Stx phage. Temperate Stx phages released from their hosts occur as free particles in various environments. This study reports the occurrence of Stx phages in vegetables (lettuce, cucumber, and spinach) and cropland soil samples. Infectious Stx2 phages were found in all samples and many carried also Stx1 phages. Their persistence in vegetables, including germinated sprouts, of Stx phage 933 W and an E. coli C600 (933 W∆stx::gfp-cat) lysogen used as surrogate, showed reductions below 2 log10 units of both microorganisms at 23 °C and 4 °C over 10 days. Higher reductions (up to 3.9 log10) units were observed in cropland soils at both temperatures. Transduction of a recombinant 933 W∆stx::kan phage was observed in all matrices. Protecting against microbial contamination of vegetables is imperative to ensure a safe food chain. Since the emergence of new Stx strains by Stx phage transduction is possible in vegetable matrices, methods aimed at reducing microbial risks in vegetables should not neglect phages.