Dr Yetta Kwailing Wong

Most theories of visual processing propose that object recognition is achieved in higher visual cortex. However, we show that category selectivity for musical notation can be observed in the first ERP component called the C1 (measured 40-60 msec after stimulus onset) with music-reading expertise. Moreover, the C1 note selectivity was observed only when the stimulus category was blocked but not when the stimulus category was randomized. Under blocking, the C1 activity for notes predicted individual music-reading ability, and behavioral judgments of musical stimuli reflected music-reading skill. Our results challenge current theories of object recognition, indicating that the primary visual cortex can be selective for musical notation within the initial feedforward sweep of activity with perceptual expertise and with a testing context that is consistent with the expertise training, such as blocking the stimulus category for music reading.

Line junctions are well‐known to be important for real‐world object recognition, and sensitivity to line junctions is enhanced with perceptual experience with an object category. However, it remains unclear whether these very simple visual features are involved in expert object representations at the neural level, and if yes, at what level(s) they are involved. In this EEG study, 31 music reading experts and 31 novices performed a one‐back task with intact musical notation, musical notation with line junctions removed and pseudo‐letters. We observed more separable neural representations of musical notation from pseudo‐letter for experts than for novices when line junctions were present and during 180–280 ms after stimulus onset. Also, the presence of line junctions was better decoded in experts than in novices during 320–580 ms, and the decoding accuracy in this time window predicted the behavioral recognition advantage of musical notation when line junctions were present. These suggest that, with perceptual expertise, line junctions are more involved in category selective representation of objects, and are more explicitly represented in later stages of processing to support expert recognition performance. Our findings clarify how the well‐known behavioral phenomenon of line junction advantage in expert object recognition is instantiated at the neural level. We provide evidence that line junctions are more involved in category selective representation of objects, and are more explicitly represented in later stages of processing to support expert recognition performance. These results shed light on how local visual features are processed in object recognition with perceptual expertise at the neural level.

Perceptual learning (PL) and perceptual expertise (PE) are two fields of visual training studies that investigate how practice improves visual performance. However, previous research suggests that PL can be acquired in a task-irrelevant manner while PE cannot and that PL is highly specific to the training objects and conditions while PE generalizes. These differences are difficult to interpret since PL and PE studies tend to differ on multiple dimensions. We designed a training study with novel objects to compare PL and PE while varying only the training task, such that the training objects, visual field, training duration, and type of learning assessment were kept constant. Manipulations of the training task sufficed to produce the standard effects obtained in PE and PL. In contrast to prior studies, we demonstrated that some degree of PE can be acquired in a task-irrelevant manner, similar to PL. Task-irrelevant PE resulted in similar shape matching ability compared to the directly trained PE. In addition, learning in both PE and PL generalizes to different untrained conditions, which does not support the idea that PE generalizes while PL is specific. Degrees of generalization can be explained by considering the psychological space of the stimuli used for training and the test of transfer.

Crowding occurs when the perception of a suprathreshold target is impaired by nearby distractors, reflecting a fundamental limitation on visual spatial resolution. It is likely that crowding limits music reading, as each musical note is crowded by adjacent notes and by the five-line staff, similar to word reading, in which letter recognition is reduced by crowding from adjacent letters. Here, we tested the hypothesis that, with extensive experience, music-reading experts have acquired visual skills such that they experience a smaller crowding effect, resulting in higher music-reading fluency. Experts experienced a smaller crowding effect than did novices, but only for musical stimuli, not for control stimuli (Landolt Cs). The magnitude of the crowding effect for musical stimuli could be predicted by individual fluency in music reading. Our results highlight the role of experience in crowding: Visual spatial resolution can be improved specifically for objects associated with perceptual expertise. Music-reading rates are likely limited by crowding, and our results are consistent with the idea that experience alleviates these limitations.

Visual perceptual learning (PL) and perceptual expertise (PE) traditionally lead to different training effects and recruit different brain areas, but reasons for these differences are largely unknown. Here, we tested how the learning history influences visual object representations. Two groups were trained with tasks typically used in PL or PE studies, with the same novel objects, training duration and parafoveal stimulus presentation. We observed qualitatively different changes in the cortical representations of these objects following PL and PE training, replicating typical training effects in each field. These effects were also modulated by testing tasks, suggesting that experience interacts with attentional set and that the choice of testing tasks critically determines the pattern of training effects one can observe after a short-term visual training. Experience appears sufficient to account for prior differences in the neural locus of learning between PL and PE. The nature of the experience with an object's category can determine its representation in the visual system.

Holistic processing was initially characterized a unique hallmark of face perception (e.g., Young et al., 1987 ) and later argued a domain-general marker of perceptual expertise (e.g., Gauthier et al., 1998 ). More recently, evidence for holistic processing - measured by interference from task-irrelevant parts - was obtained in novices, raising questions for its usefulness as a test of expertise. Indeed, recent studies use the same task to make opposite claims: Hsiao & Cottrell (2009) found more interference in novices than experts for Chinese characters, while Wong, Palmeri & Gauthier (2009) found more interference in experts than novices with objects. Offering a resolution to this paradox, our work on the perception of musical notation ( Wong & Gauthier, in press ) suggests that expert and novice interference effects represent two ends of a continuum: interference is initially strategic and contextual, but becomes more automatic as holistic processing develops with the acquisition of perceptual expertise.

Holistic processing (i.e., the tendency to process objects as wholes) is associated with face perception and also with expertise individuating novel objects. Surprisingly, recent work also reveals holistic effects in novice observers. It is unclear whether the same mechanisms support holistic effects in experts and in novices. In the present study, we measured holistic processing of music sequences using a selective attention task in participants who vary in music-reading expertise. We found that holistic effects were strategic in novices but were relatively automatic in experts. Correlational analyses revealed that individual holistic effects were predicted by both individual music-reading ability and neural responses for musical notation in the right fusiform face area (rFFA), but in opposite directions for experts and novices, suggesting that holistic effects in the two groups may be of different natures. To characterize expert perception, it is important not only to measure the tendency to process objects as wholes, but also to test whether this effect is dependent on task constraints.

Prior neuroimaging work on visual perceptual expertise has focused on changes in the visual system, ignoring possible effects of acquiring expert visual skills in nonvisual areas. We investigated expertise for reading musical notation, a skill likely to be associated with multimodal abilities. We compared brain activity in music-reading experts and novices during perception of musical notation, Roman letters, and mathematical symbols and found selectivity for musical notation for experts in a widespread multimodal network of areas. The activity in several of these areas was correlated with a behavioral measure of perceptual fluency with musical notation, suggesting that activity in nonvisual areas can predict individual differences in visual expertise. The visual selectivity for musical notation is distinct from that for faces, single Roman letters, and letter strings. Implications of the current findings to the study of visual perceptual expertise, music reading, and musical expertise are discussed.

The Thatcher Illusion or Thatcher Effect (TE-Thompson 1980, Perception 9 483-484) reflects the difficulty in perceiving the local inversion of parts when the whole object, generally a face, is globally inverted. We tested the generality of the TE with a range of faces and non-face objects, and observed the TE with many non-face categories including cars, buildings, bikes, and letter strings. In terms of magnitude, the face TE is not exceptionally large compared to other object categories, and the magnitude of the TE can be predicted by performance on this task for upright stimuli, regardless of whether the object is a face or not. We did not observe evidence for a unique mechanism contributing to the TE for faces. We discuss factors that influence the magnitude of the TE, some common across domains and others more specific to a particular category.