This study tested the hypothesis that even the simplest cognitive tasks require the storage of information in working memory (WM), distorting any information that was previously stored in WM. Experiment 1 tested this hypothesis by requiring observers to perform a simple letter discrimination task while they were holding a single orientation in WM. We predicted that performing the task on the interposed letter stimulus would cause the orientation memory to become less precise and more categorical compared to when the letter was absent or when it was present but could be ignored. This prediction was confirmed. Experiment 2 tested the modality specificity of this effect by replacing the visual letter discrimination task with an auditory pitch discrimination task. Unlike the interposed visual stimulus, the interposed auditory stimulus produced little or no disruption of WM, consistent with the use of modality-specific representations. Thus, performing a simple visual discrimination task, but not a simple auditory discrimination task, distorts information about a single feature being maintained in visual WM. We suggest that the interposed task eliminates information stored within the focus of attention, leaving behind a WM representation outside the focus of attention that is relatively imprecise and categorical.

Computational models of motion perception suggest that the perceived direction of weak motion signals may sometimes be directly opposite to the true stimulus motion direction. However, this possibility cannot be assessed by using standard 2AFC motion discrimination paradigms because two opposite directions of motion were used in most studies (e.g., leftward vs. rightward). We were able to obtain robust evidence of opposite-direction motion reports by using a random-dot-kinematogram (RDK) paradigm in which the motion direction varied over 360° and observers were asked to estimate the exact motion direction. These opposite-direction motion reports were replicable across multiple display types and feedback conditions, and observers had greater confidence in their opposite-direction responses than in true guess responses. When we fed RDKs into a computational model of motion processing, we found that the model estimated substantial motion activity in the direction opposite to the coherent stimulus direction, even though no such motion was objectively present in the stimuli, suggesting that the opposite-direction motion perception may be a consequence of the properties of motion-selective neurons in visual cortex. Together, these results demonstrate that the known properties of the visual system may lead to reports of motion that are directly opposite to the true direction.

The present study sought to determine whether scalp electroencephalogram (EEG) signals contain decodable information about the direction of motion in random dot kinematograms (RDKs), in which the motion information is spatially distributed and mixed with random noise. Any direction of motion from 0 to 360° was possible, and observers reported the precise direction of motion at the end of a 1500-ms stimulus display. We decoded the direction of motion separately during the motion period (during which motion information was being accumulated) and the report period (during which a shift of attention was necessary to make a fine-tuned direction report). Machine learning was used to decode the precise direction of motion (within ±11.25°) from the scalp distribution of either alpha-band EEG activity or sustained event-related potentials (ERPs). We found that ERP-based decoding was above chance (1/16) during both the stimulus and the report periods, whereas alpha-based decoding was above chance only during the report period. Thus, sustained ERPs contain information about spatially distributed direction-of-motion, providing a new method for observing the accumulation of sensory information with high temporal resolution. By contrast, the scalp topography of alpha-band EEG activity appeared to mainly reflect spatially focused attentional processes rather than sensory information.

The reported perception of a visual stimulus on one trial can be biased by the stimulus that was presented on the previous trial. In the present study we asked whether encoding the previous-trial stimulus is sufficient to produce this serial dependence effect, or whether the effect also depends on postencoding processes. To distinguish between these possibilities, we designed a task in which participants reported either the color or the direction of a set of colored moving dots on each trial. The to-be-reported dimension was indicated by a postcue after stimulus offset, so participants were required to encode both features of every stimulus. We assessed serial dependence for motion perception as a function of which feature dimension had been reported on the previous trial. In Experiment 1, we found a serial dependence effect for motion only when participants had reported the direction of motion on the previous trial, and not when they had encoded the direction of motion but reported the color of the stimulus. Experiment 2 confirmed that this pattern of results was not driven by the difficulty of the color task. When we used the same response modality for both motion and color reports in Experiment 3, we found significant serial dependence effects following both color-report and motion-report trials, but the effect was significantly weaker following color-report trials. Together, these findings indicate that postperceptual processes play a critical role in serial dependence and that the mere encoding of the previous-trial target is not sufficient to produce the serial dependence effect.

Recent experiences influence the processing of new information even when those experiences are irrelevant to the current task. Does this reflect the indirect effects of a passively maintained representation of the previous experience, or is this representation reactivated when a new event occurs? To answer this question, we attempted to decode the orientation of the stimulus on the previous trial from the electroencephalogram on the current trial in a working memory task. Behavioral data confirmed that the previous-trial stimulus orientation influenced the reported orientation on the current trial, even though the previous-trial orientation was now task irrelevant. In two independent experiments, we found that the previous-trial orientation could be decoded from the current-trial electroencephalogram, indicating that the current-trial stimulus reactivated or boosted the representation of the previous-trial orientation. These results suggest that the effects of recent experiences on behavior are driven, in part, by a reactivation of those experiences and not solely by the indirect effects of passive memory traces.

We investigated whether the representations of different objects are maintained independently in working memory or interact with each other. Observers were shown two sequentially presented orientations and required to reproduce each orientation after a delay. The sequential presentation minimized perceptual interactions so that we could isolate interactions between memory representations per se. We found that similar orientations were repelled from each other whereas dissimilar orientations were attracted to each other. In addition, when one of the items was given greater attentional priority by means of a cue, the representation of the high-priority item was not influenced very much by the orientation of the low-priority item, but the representation of the low-priority item was strongly influenced by the orientation of the high-priority item. This indicates that attention modulates the interactions between working memory representations. In addition, errors in the reported orientations of the two objects were positively correlated under some conditions, suggesting that representations of distinct objects may become grouped together in memory. Together, these results demonstrate that working-memory representations are not independent but instead interact with each other in a manner that depends on attentional priority.

In human scalp EEG recordings, both sustained potentials and alpha-band oscillations are present during the delay period of working memory tasks and may therefore reflect the representation of information in working memory. However, these signals may instead reflect support mechanisms rather than the actual contents of memory. In particular, alpha-band oscillations have been tightly tied to spatial attention and may not reflect location-independent memory representations per se. To determine how sustained and oscillating EEG signals are related to attention and working memory, we attempted to decode which of 16 orientations was being held in working memory by human observers (both women and men). We found that sustained EEG activity could be used to decode the remembered orientation of a stimulus, even when the orientation of the stimulus varied independently of its location. Alpha-band oscillations also carried clear information about the location of the stimulus, but they provided little or no information about orientation independently of location. Thus, sustained potentials contain information about the object properties being maintained in working memory, consistent with previous evidence of a tight link between these potentials and working memory capacity. In contrast, alpha-band oscillations primarily carry location information, consistent with their link to spatial attention.SIGNIFICANCE STATEMENT Working memory plays a key role in cognition, and working memory is impaired in several neurological and psychiatric disorders. Previous research has suggested that human scalp EEG recordings contain signals that reflect the neural representation of information in working memory. However, to conclude that a neural signal actually represents the object being remembered, it is necessary to show that the signal contains fine-grained information about that object. Here, we show that sustained voltages in human EEG recordings contain fine-grained information about the orientation of an object being held in memory, consistent with a memory storage signal.

Multivariate pattern classification (decoding) methods are commonly employed to study mechanisms of neurocognitive processing in typical individuals, where they can be used to quantify the information that is present in single-participant neural signals. These decoding methods are also potentially valuable in determining how the representation of information differs between psychiatric and non-psychiatric populations. Here, we examined ERPs from people with schizophrenia (PSZ) and healthy control subjects (HCS) in a working memory task that involved remembering 1, 3, or 5 items from one side of the display and ignoring the other side. We used the spatial pattern of ERPs to decode which side of the display was being held in working memory. One might expect that decoding accuracy would be inevitably lower in PSZ as a result of increased noise (i.e., greater trial-to-trial variability). However, we found that decoding accuracy was greater in PSZ than in HCS at memory load 1, consistent with previous research in which memory-related ERP signals were larger in PSZ than in HCS at memory load 1. We also observed that decoding accuracy was strongly related to the ratio of the memory-related ERP activity and the noise level. In addition, we found similar noise levels in PSZ and HCS, counter to the expectation that PSZ would exhibit greater trial-to-trial variability. Together, these results demonstrate that multivariate decoding methods can be validly applied at the individual-participant level to understand the nature of impaired cognitive function in a psychiatric population.

BACKGROUND: Impairments in working memory (WM) have been well documented in people with schizophrenia (PSZ). However, these quantitative WM impairments can often be explained by nonspecific factors, such as impaired goal maintenance. Here, we used a spatial orientation delayed response task to explore a qualitative difference in WM dynamics between PSZ and healthy control participants (HCs). More specifically, we took advantage of the discovery that WM representations may drift either toward or away from previous trial targets (serial dependence). We tested the hypothesis that WM representations would drift toward the previous trial target in HCs but away from the previous trial target in PSZ. METHODS: We assessed serial dependence in PSZ (n = 31) and HCs (n = 25) using orientation as the to-be-remembered feature and memory delays lasting from 0 to 8 seconds. Participants were asked to remember the orientation of a teardrop-shaped object and reproduce the orientation after a delay period of varying length. RESULTS: Consistent with prior studies, we found that current trial memory representations were less precise in PSZ than in HCs. We also found that WM for the current trial orientation drifted toward the previous trial orientation in HCs (representational attraction) but drifted away from the previous trial orientation in PSZ (representational repulsion). CONCLUSIONS: These results demonstrate a qualitative difference in WM dynamics between PSZ and HCs that cannot be easily explained by nuisance factors such as reduced effort. Most computational neuroscience models also fail to explain these results because they maintain information solely by means of sustained neural firing, which does not extend across trials. The results suggest a fundamental difference between PSZ and HCs in longer-term memory mechanisms that persist across trials, such as short-term potentiation and neuronal adaptation.

A frequent finding when studying substrates of working memory (WM) deficits in people with schizophrenia (PSZ) is task-induced hyperactivation relative to healthy control subjects (HCS) when WM load is low. Hyperactivation accompanying similar performance is commonly attributed to cognitive deficits rendering relatively easy operations more resource-consuming. To test if hyperactivation at low load really is secondary to cognitive impairment in PSZ, we re-analyzed functional MRI data showing left posterior parietal cortex (PPC) hyperactivation in PSZ when holding a single color-item in WM. In subgroups matched for the number of items successfully stored in WM (K) by excluding the highest-performing HCS and lowest-performing PSZ, performance was almost identical across all set sizes (1-7). While BOLD activation at the larger set sizes did not differ between groups, PSZ still robustly hyperactivated left PPC when a single item had to be maintained. The same pattern was observed in subgroups matched for model-based estimates of WM capacity or attentional lapse rate. Given that in the K-matched subsamples PSZ performed as well as HCS even in the most challenging load conditions and that no BOLD signal difference was seen at high loads, it is implausible that PSZ over-recruited WM-related neural structures because they were more challenged by maintaining a single item in WM. Instead, the findings are consistent with a primary schizophrenia-related processing abnormality as proposed by the hyperfocusing hypothesis, which suggests that an abnormally narrow but intense focusing of processing resources is central to many aspects of impaired cognition in PSZ.