Burst suppression is a clinically relevant EEG pattern used to monitor sedation depth in critically ill patients. This is the first study to evaluate EEG foundation models for burst detection in reduced-montage ICU EEG without patient-specific calibration, comparing REVE-base, LUNA-large, and LuMamba-Tiny against adaptive thresholding and EEGNet baselines with an event-based evaluation protocol. The best model achieved an event-based F1-score of 0.868 and reduced burst-per-minute error by up to 52.1%, supporting foundation models for scalable EEG monitoring in the ICU.