DECODING SECOND ORDER ISOMORPHISMS IN THE BRAIN: The case of colors and letters.
Hanson, S. J.; Caglar, L. R.; Hanson, C.
Show abstract
We introduce a new method for decoding neural data from fMRI. It is based on two assumptions, first that neural representation is distributed over networks of neurons embeded in voxel noise and second that the stimuli can be decoded as learned relations from sets of categorical stimuli. We illustrate these principles with two types of stimuli, color (wavelength) and letters (visual shape), both of which have early visual system response, but at the same time must be learned within a given function or category (color contrast, alphabet). Key to the decoding method is reducing the stimulus cross-correlation by a matched noise voxel sample by normalizing the stimulus voxel matrix thus unmasking a highly discriminative neural profile per stimulus. Projection of this new voxel space (ROI) to a smaller set of dimensions (with e.g., non-metric Multidimensional scaling), the relational information takes a unique geometric form revealing functional relationships between sets of stimuli, defined by R. Shepard, as second-order isomorphisms (SOI). In the case of colors the SOI appears as a nearly equally spaced set of wavelengths arranged in a color wheel, with a gap between the "purples" and "reds" (consistent with the gap in the original Ekmans color set). In the case of letters, a cluster space resulted from the decorrelated voxel neural profiles, which matched the phrase structure of the mnemonic used for more than 100 years to teach children the alphabet (across multiple languages), The Alphabet Song.
Matching journals
The top 6 journals account for 50% of the predicted probability mass.
Similar papers in this journal
- Comparing Functional Connectivity Matrices: A Geometry-Aware Approach applied to Participant Identification 95%
- Micro-probing enables high-resolution mapping of neuronal subpopulations using fMRI 95%
- Coordinated multivoxel coding beyond univariate effects is not likely to be observable in fMRI data 94%
Similar papers in this journal
- Neural encoding of biomechanically (im)possible human movements in occipitotemporal cortex 95%
- Priority-based transformations of stimulus representation in visual working memory 94%
- Moving in on human motor cortex. Characterizing the relationship between body parts with non-rigid population Response Fields. 94%
Similar papers in this journal
Similar papers in this journal
Similar papers in this journal
- A hierarchy of processing complexity and timescales for natural sounds in human auditory cortex 94%
- Decoding across sensory modalities reveals common supramodal signatures of conscious perception 93%
- Neural Tracking Measures of Speech Intelligibility: Manipulating Intelligibility while Keeping Acoustics Unchanged 93%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.