Context dependence of information has been shown to be based, at least in part, on the attention contexts received at the time of training. Recent research suggests that attention to irrelevant contexts may be a byproduct of the activation of a general exploratory attentional mechanism prompted by high prediction errors associated with situations of uncertainty. Alternatively, low prediction errors may engage an attentional mechanism of exploitation in situations in which contexts play a relevant role. A selective review discusses the potential of this approach to explain context switch effects from an attentional perspective.