1
681.06: Automatic cortical labeling system for neuroimaging studies of normal and disordered speech Jason A. Tourville1,3 Frank H. Guenther1,2,3 1Department of Speech, Language, and Hearing Sciences, 2Department of Biomedical Engineering, 3Center for Computational Neuroscience and Neural Technology (CompNet) aTFg aPHg pTFg Lg TOFg TP FP OC aITg pITg ITO FOC FMC SCC pPHg aINS aFO pFO TP vMC dSC OC pdPMC FP SFg aINS pINS aFO PO aCO Hg PT PP pCO dIFo vIFt aSMg pSMg aSTg pSTg aMTg pMTg aITg pITg vSC Ag vPMC dMC mdPMC adPMC SPL pMFg aMFg FOC ITO MTO dIFt vIFo midPMC midMC pFO adSTs avSTs pdSTs pvSTs aIFs pIFs pCGg PCN preSMA SMA FMC SCC dSC pdPMC OC SFg aCG midCGg FP dMC aPHg Lg pPHg Lateral Medial Ventral Inflated Surface Pial Surface Lateral Medial Ventral Dorsal References Fischl, B., Sereno, M.I., Dale, A.M., (1999). Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System. NeuroImage, 9(2):195-207. Fischl, B., Salat, D.H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., Montillo, A., Makris, N., Rosen, B. and Dale, A.M. (2002). Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron, 33(3): 341-355. Fischl, B., van der Kouwe, A., Destrieux, C., Halgren, E., Segonne, F., Salat, D.H., Busa, E., Seidman, L.J., Goldstein, J., Kennedy, D., Caviness, V., Makris, N., Rosen, B. and Dale, A.M. (2004). Automatically parcellating the human cerebral cortex. Cerebral Cortex, 14(1): 11-22. Satrajit S. Ghosh, Sita Kakunoori, Jean Augustinack, Alfonso Nieto-Castanon, Ioulia Kovelman, Nadine Gaab, Joanna A. Christodoulou, Christina Triantafyllou, John D.E. Gabrieli, Bruce Fischl (2010). Evaluating the validity of volume-based and surface-based brain image registration for developmental cognitive neuroscience studies in children 4 to 11 years of age. NeuroImage 53 (2010) 85–93 Nieto-Castanon, A., Ghosh, S.S., Tourville, J.A. and Guenther, F.H. (2003). Region of interest based analysis of functional imaging data. Neu- roimage, 19(4): 1303-1316. Background Volume-based inter-subject averaging methods fail to account for cortical variability, resulting co-regis- tration of functionally distinct regions and a loss of statistical power. This is particularly problematic for neuroimaging studies of speech because functionally distinct regions in the peri-Sylvian region that are distant along cortical surface are proximal in the volume. Individual region of interest (ROI)-based analy- sis analysis of cortical responses significantly improves statistical power (Nieto-Castanon et al., 2003) but requires lengthy, tedious labeling by an expert. Freesurfer’s (http://surfer.nmr.mgh.harvard.edu/) individual cortical surface-based inter-subject averag- ing (Fischl et al., 1999) improves upon volume-based methods (eg., Ghosh et al, 2010) but packaged cor- tical labeling atlases fail to distinguish putative functionally distinct areas that underlie speech process- es. Here, we describe a cortical labeling system tailored for neuroimaging studies of speech that was used to generate a Freesurfer-based labeling atlas. We applied the atlas to T1 volumes of 18 fluent speakers and 20 persons who stutter to assess the performance of the automatic atlas. Anatomical variability after volume-based normalization and co-registration. Left: Mean voxel overlap of superior temporal ROIs at various group sizes. Little of no overlap is seen with groups of 9 subjects. Right: The alignment of major sulci. Sulci were drawn on 2 individual surfaces (top) and then overlaid on the same surface (bottom), aligned to the Sylvian fissure. Acknowledgments This research was supported by NIDCD R01 grants DC007683 and DC002852 (PI: FG). We would like to thank Bobbie Holland for editing brain labels and Jennifer Segawa and Shanqing Cai for providing the T1 volumes. Conclusions The SpeechLabel system divides the cortex into regions that are tailored for neuroimaging studies of speech production. The SLaparc Freesurfer atlas automatically applies the system to T1 MRI volumes with relatively little user input/anatomical expertise, providing cortical ROIs at a huge time savings: Fully manual operator editing time: 8-16 hours/brain Fully automatic operator editing time: .5-1 hours/brain Auto+manual cleanup time: 1-2 hours/brain Freesurfer tools provide an easy means to create surface and volume-based cortical AND white matter regions of interest . 2 Useful applications for neuroimaging research: i. individually derived ROIs for group comparative analyses, e.g., morphometric analyses, func- tional analysis, diffusion tensor analyses, that is not dependent upon inter-subject image volume averaging [See POSTER 681.12 and POSTER for examples] ii. provides a common substrate for localizing effects within a surface-based template But, accuracy of automatic classifier needs improvement in some key speech processing regions, in- cluding medial and inferior frontal areas. Why? Bounding landmarks in these areas are highly vari- able and boundaries are not well captured by surface curvature (only affects Application (i)!). As we continue to refine and expand the labeling system, need to develop piece-wise labeling tem- plates based on better understanding of region/sulcal variability. ots rhs cos olfs aals ahls crs its sros rhs cos ccs pos sbps cas cgs AC pocs ls hs ſtts crs crs aals ahls sfrs ifrs prcs cs csts1 itps sts its aocs pals csts2 csts3 * phls ** Anatomical landmarks Bounding sulci are shown on the mean surface curvature of the inflated fsaverage surface template for the left hemisphere. Red (positive curvature) indicates a sulcal region; green (negative curvature) indi- cates a gyral regions. Additional dividing landmarks include sulcal intersections and the anterior com- missures . White stars indicate landmarks that are note easily viewed on the average template. See Table 2 for landmark abbreviation key. Table 2: Landmarks aals anterior ascending ramus of the lateral sulcus ahls anterior horizontal ramus of the lateral sulcus aocs anterior occipital sulcus cas callosal sulcus ccs calcarine sulcus cgs cingulate sulcus cos collateral sulcus crs circular insular sulcus cs central sulcus csts1 caudal superior temporal sulcus, first segment csts2 caudal superior temporal sulcus, second segment csts3 caudal superior temporal sulcus, third segment ftts first transverse temporal sulcus hs Heschl's sulcus ifrs inferior frontal sulcus ihs interhemispheric sulcus itps intraparietal sulcus its inferior temporal sulcus locs lateral occipital sulcus ls lateral sulcus olfs olfactory sulcus ots occipitotemporal sulcus pals posterior ascending ramus of the lateral sulcus pcs paracentral sulcus phls posterior horizontal ramus of the lateral sulcus pis primary intermediate sulcus pocs postcentral sulcus pos parietooccipital sulcus prcs precentral sulcus rhs rhinal sulcus sbps subparietal sulcus sfrs superior frontal sulcus sros superior rostral sulcus sts superior temporal sulcus ti temporal incisure Table 1: Regions aCGg anterior cingulate gyrus pCGg posterior cingulate gyrus aCO anterior central operculum PCN precuneus cortex adPMC anterior dorsal premotor cortex pCO posterior central operculum adSTs anterior dorsal superior temporal sulcus pdPMC posterior dorsal premotor cortex aFO anterior frontal operculum pdSTs posterior dorsal superior temporal sulcu Ag angular gyrus pFO posterior frontal operculum aIFs anterior inferior frontal sulcus pIFs posterior inferior frontal sulcus aINS anterior insula pINS posterior insula aITg anterior inferior temporal gyrus pITg posterior inferior temporal gyrus aMFg anterior middle frontal gyrus pMFg posterior middle frontal gyrus aMTg anterior middle temporal gyrus pMTg posterior middle temporal gyrus aPHg anterior parahippocampal gyrus PO parietal operculum aSMg anterior supramarginal gyrus PP planum polare aSTg anterior superior temporal gyrus pPHg posterior parahippocampal gyrus aTFg anterior temporal fusiform preSMA presupplementary motor area avSTs anterior ventral superior temporal sulcus pSMg posterior supramarginal gyrus dIFo dorsal inferior frontal gyrus, pars opercularis pSTg posterior superior temporal gyrus dIFt dorsal inferior frontal gyrus, pars triangularis PT planum temporale dMC dorsal motor cortex pTFg posterior temporal fusiform dSC dorsal somatosensory cortex pvSTs superior temporal sulcu FMC frontal medial cortex SCC subcallosal cortex FOC frontal orbital cortex SFg superior frontal gyrus FP frontal pole SMA supplementary motor area Hg Heschl's gyrus SPL superior parietal lobule ITOg inferior temporal occipital gyrus TOFg temporal occipital fusiform gyrus Lg lingual gyrus TP temporal pole mdPMC middle dorsal premotor cortex vIFo ventral inferior frontal gyrus, pars opercularis midCG middle cingulate gyrus vIFt ventral inferior frontal gyrus, pars triangularis midMC middle motor cortex vMC ventral motor cortex midPMC middle premotor cortex vPMC ventral premotor cortex MTOg middle temporal occipital gyrus vSC ventral somatosensory cortex Methods SpeechLabel System: Each hemisphere is divided into 63 cortical regions based on individual anatom- ical landmarks. Superior temporal, inferior frontal, precentral regions are divided into multiple gyral and sulcal components. SLaparc Atlas Generation: Image segmentation, cortical surface reconstruction, surface-based co-registration, and initial surface labeling was performed on T1 MRI volumes from 17 neurologically normal subjects (9 Female, Age: 20-43, Mean: 29) using Freesurfer v5.0. T1 data aqcuisition: Siemens TIM Trio 3T scanner, MPRAGE sequence, 1mm3 voxel size. Surface labels were edited to conform to the SpeechLabel system (editing was overseen by a trained neuroanatomical expert). The labeled surfaces were used as a training set to generate the SLaparc atlas using standard Freesurfer tools (Fischl et al. 2004). Atlas Application: The atlas was used to automatically label 18 additional fluent speakers (PFS; 4 Female, Age 19-35, Age Range: 19-35) and 20 matched persons who stutter (PWS; 5 Female, Age: 18-47, Mean: 27; SSI-4: 13-43, Median: 26 ). [See POSTER 681.12 for further analysis of these data] To assess the performance of the automatic atlas, labels were corrected by a trained expert to conform to the SpeechLabel system and the automatic and manually corrected labels were compared in terms of percent overlap. Cortical regions were mapped to the each subjects T1 volume for these comparisons. Region % overlap, PO, given by Dice coefficent: PO = Labeled fsaverage: The Freesurfer fsaverage surface template was labeled by SLaparc and manually edited as needed. 2 |X Y| |X|+|Y| Overlap of automatic and manually edited labels PFS: Mean PO: 88% +/- 10%, Range: 46-100; PWS: Mean PO: 88% +/- 9%, Range: 52-100 Good overall overlap b/w auto and edited labels and no difference b/w groups (2-tailed paired t-test of mean over- laps for each region: p > .41). But are specific regions of low overlap, especially subdivisions of the inferior frontal gyrus region (see plot below). PO of speech regions with PO < 75% in one of the groups subject groups. Right vIFo Left dIFt Right pIFs Right dIFt Left vIFt Right vIFt Right aFO Left dIFo Left pdPMC Left SMA Left vIFo Right aIFs Left aIFs Left pIFs Right dIFo 40 80 70 60 50 % Overlap (Dice) PWS PFS The SpeechLabel Cortical Labeling System Regions are plotted on the Freesurfer fsaverage surface template for the left hemisphere. Each cortical hemisphere is divided into 63 regions of interest based on individual anatomical landmarks. Superior temporal, in- ferior frontal, precentral, and medial frontal regions are divided into functionally meaningful subunits for neuroimaging studies of speech. See table 1 for region abbreviation key.

Jason A. Tourville Frank H. Guenther

  • Upload
    tranque

  • View
    230

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Jason A. Tourville Frank H. Guenther

681.06: Automatic cortical labeling system for neuroimaging studies of normal and disordered speechJason A. Tourville1,3 Frank H. Guenther1,2,3

1Department of Speech, Language, and Hearing Sciences, 2Department of Biomedical Engineering, 3Center for Computational Neuroscience and Neural Technology (CompNet)

aTFgaPHg

pTFg

Lg

TOFgTP

FP OC

aITgpITg ITO

FOC

FMC SCC

pPHgaINS

aFO pFO

TP

vMC

dSC

OC

pdPM

C

FP

SFg

aINSpINS

aFO

PO

aCOHg

PT

PP

pCOdIFo

vIFt

aSMg pSMg

aSTg

pSTg

aMTg

pMTg

aITg

pITg

vSC Ag

vPM

C

dMC

mdPMC

adPMC SPL

pMFg

aMFg

FOC ITO

MTOdIFtvIFo

midP

MCmidM

C

pFO

adSTsavSTs

pdSTs

pvSTs

aIFs

pIFspCGg

PCN

preSMASMA

FMCSCC

dSC

pdPMC

OC

SFg

aCG

midCGg

FP

dMC

aPHg

Lg

pPHg

Lateral Medial

Ventral

In�ated Surface Pial Surface

Lateral Medial

VentralDorsal

ReferencesFischl, B., Sereno, M.I., Dale, A.M., (1999). Cortical Surface-Based Analysis II: In�ation, Flattening, and a Surface-Based Coordinate System. NeuroImage,

9(2):195-207.Fischl, B., Salat, D.H., Busa, E., Albert, M., Dieterich, M., Haselgrove, C., van der Kouwe, A., Killiany, R., Kennedy, D., Klaveness, S., Montillo, A.,

Makris, N., Rosen, B. and Dale, A.M. (2002). Whole brain segmentation: automated labeling of neuroanatomical structures in the human brain. Neuron, 33(3): 341-355.

Fischl, B., van der Kouwe, A., Destrieux, C., Halgren, E., Segonne, F., Salat, D.H., Busa, E., Seidman, L.J., Goldstein, J., Kennedy, D., Caviness, V., Makris, N., Rosen, B. and Dale, A.M. (2004). Automatically parcellating the human cerebral cortex. Cerebral Cortex, 14(1): 11-22.

Satrajit S. Ghosh, Sita Kakunoori, Jean Augustinack, Alfonso Nieto-Castanon, Ioulia Kovelman, Nadine Gaab, Joanna A. Christodoulou, Christina Triantafyllou, John D.E. Gabrieli, Bruce Fischl (2010). Evaluating the validity of volume-based and surface-based brain image registration for developmental cognitive neuroscience studies in children 4 to 11 years of age. NeuroImage 53 (2010) 85–93

Nieto-Castanon, A., Ghosh, S.S., Tourville, J.A. and Guenther, F.H. (2003). Region of interest based analysis of functional imaging data. Neu-roimage, 19(4): 1303-1316.

BackgroundVolume-based inter-subject averaging methods fail to account for cortical variability, resulting co-regis-tration of functionally distinct regions and a loss of statistical power. This is particularly problematic for neuroimaging studies of speech because functionally distinct regions in the peri-Sylvian region that are distant along cortical surface are proximal in the volume. Individual region of interest (ROI)-based analy-sis analysis of cortical responses signi�cantly improves statistical power (Nieto-Castanon et al., 2003) but requires lengthy, tedious labeling by an expert.

Freesurfer’s (http://surfer.nmr.mgh.harvard.edu/) individual cortical surface-based inter-subject averag-ing (Fischl et al., 1999) improves upon volume-based methods (eg., Ghosh et al, 2010) but packaged cor-tical labeling atlases fail to distinguish putative functionally distinct areas that underlie speech process-es. Here, we describe a cortical labeling system tailored for neuroimaging studies of speech that was used to generate a Freesurfer-based labeling atlas. We applied the atlas to T1 volumes of 18 �uent speakers and 20 persons who stutter to assess the performance of the automatic atlas.

Anatomical variability after volume-based normalization and co-registration. Left: Mean voxel overlap of superior temporal ROIs at various group sizes. Little of no overlap is seen with groups of 9 subjects. Right: The alignment of major sulci. Sulci were drawn on 2 individual surfaces (top) and then overlaid on the same surface (bottom), aligned to the Sylvian �ssure.

AcknowledgmentsThis research was supported by NIDCD R01 grants DC007683 and DC002852 (PI: FG). We would like to thank Bobbie Holland for editing brain labels and Jennifer Segawa and Shanqing Cai for providing the T1 volumes.

ConclusionsThe SpeechLabel system divides the cortex into regions that are tailored for neuroimaging studies of speech production.

The SLaparc Freesurfer atlas automatically applies the system to T1 MRI volumes with relatively little user input/anatomical expertise, providing cortical ROIs at a huge time savings: Fully manual operator editing time: 8-16 hours/brain Fully automatic operator editing time: .5-1 hours/brain Auto+manual cleanup time: 1-2 hours/brain

Freesurfer tools provide an easy means to create surface and volume-based cortical AND white matter regions of interest .

2 Useful applications for neuroimaging research:i. individually derived ROIs for group comparative analyses, e.g., morphometric analyses, func-tional analysis, di�usion tensor analyses, that is not dependent upon inter-subject image volume averaging [See POSTER 681.12 and POSTER for examples]ii. provides a common substrate for localizing e�ects within a surface-based template

But, accuracy of automatic classi�er needs improvement in some key speech processing regions, in-cluding medial and inferior frontal areas. Why? Bounding landmarks in these areas are highly vari-able and boundaries are not well captured by surface curvature (only a�ects Application (i)!).

As we continue to re�ne and expand the labeling system, need to develop piece-wise labeling tem-plates based on better understanding of region/sulcal variability.

ots

rhs cos

olfs

aalsahls crs

its

sros

rhs

cos

ccs

pos

sbpscas

cgs

AC

pocs

ls

hs

ftts

crs

crsaals

ahls

sfrs

ifrs

prcs

cs

csts

1

itps

sts

its

aocs

pals

csts

2cst

s3

*

phls

**

Anatomical landmarksBounding sulci are shown on the mean surface curvature of the in�ated fsaverage surface template for the left hemisphere. Red (positive curvature) indicates a sulcal region; green (negative curvature) indi-cates a gyral regions. Additional dividing landmarks include sulcal intersections and the anterior com-missures . White stars indicate landmarks that are note easily viewed on the average template. See Table 2 for landmark abbreviation key.

Table 2: Landmarksaals anterior ascending ramus of the lateral sulcusahls anterior horizontal ramus of the lateral sulcusaocs anterior occipital sulcuscas callosal sulcusccs calcarine sulcuscgs cingulate sulcuscos collateral sulcuscrs circular insular sulcuscs central sulcuscsts1 caudal superior temporal sulcus, �rst segmentcsts2 caudal superior temporal sulcus, second segmentcsts3 caudal superior temporal sulcus, third segmentftts �rst transverse temporal sulcushs Heschl's sulcusifrs inferior frontal sulcusihs interhemispheric sulcusitps intraparietal sulcusits inferior temporal sulcuslocs lateral occipital sulcusls lateral sulcusolfs olfactory sulcusots occipitotemporal sulcuspals posterior ascending ramus of the lateral sulcuspcs paracentral sulcusphls posterior horizontal ramus of the lateral sulcuspis primary intermediate sulcuspocs postcentral sulcuspos parietooccipital sulcusprcs precentral sulcusrhs rhinal sulcussbps subparietal sulcussfrs superior frontal sulcussros superior rostral sulcussts superior temporal sulcusti temporal incisure

Table 1: RegionsaCGg anterior cingulate gyrus pCGg posterior cingulate gyrusaCO anterior central operculum PCN precuneus cortexadPMC anterior dorsal premotor cortex pCO posterior central operculumadSTs anterior dorsal superior temporal sulcus pdPMC posterior dorsal premotor cortexaFO anterior frontal operculum pdSTs posterior dorsal superior temporal sulcuAg angular gyrus pFO posterior frontal operculumaIFs anterior inferior frontal sulcus pIFs posterior inferior frontal sulcusaINS anterior insula pINS posterior insulaaITg anterior inferior temporal gyrus pITg posterior inferior temporal gyrusaMFg anterior middle frontal gyrus pMFg posterior middle frontal gyrusaMTg anterior middle temporal gyrus pMTg posterior middle temporal gyrusaPHg anterior parahippocampal gyrus PO parietal operculumaSMg anterior supramarginal gyrus PP planum polareaSTg anterior superior temporal gyrus pPHg posterior parahippocampal gyrusaTFg anterior temporal fusiform preSMA presupplementary motor areaavSTs anterior ventral superior temporal sulcus pSMg posterior supramarginal gyrusdIFo dorsal inferior frontal gyrus, pars opercularis pSTg posterior superior temporal gyrusdIFt dorsal inferior frontal gyrus, pars triangularis PT planum temporaledMC dorsal motor cortex pTFg posterior temporal fusiformdSC dorsal somatosensory cortex pvSTs superior temporal sulcuFMC frontal medial cortex SCC subcallosal cortexFOC frontal orbital cortex SFg superior frontal gyrusFP frontal pole SMA supplementary motor areaHg Heschl's gyrus SPL superior parietal lobuleITOg inferior temporal occipital gyrus TOFg temporal occipital fusiform gyrusLg lingual gyrus TP temporal polemdPMC middle dorsal premotor cortex vIFo ventral inferior frontal gyrus, pars opercularismidCG middle cingulate gyrus vIFt ventral inferior frontal gyrus, pars triangularismidMC middle motor cortex vMC ventral motor cortexmidPMC middle premotor cortex vPMC ventral premotor cortexMTOg middle temporal occipital gyrus vSC ventral somatosensory cortex

Methods SpeechLabel System: Each hemisphere is divided into 63 cortical regions based on individual anatom-ical landmarks. Superior temporal, inferior frontal, precentral regions are divided into multiple gyral and sulcal components.

SLaparc Atlas Generation: Image segmentation, cortical surface reconstruction, surface-based co-registration, and initial surface labeling was performed on T1 MRI volumes from 17 neurologically normal subjects (9 Female, Age: 20-43, Mean: 29) using Freesurfer v5.0. T1 data aqcuisition: Siemens TIM Trio 3T scanner, MPRAGE sequence, 1mm3 voxel size.

Surface labels were edited to conform to the SpeechLabel system (editing was overseen by a trained neuroanatomical expert). The labeled surfaces were used as a training set to generate the SLaparc atlas using standard Freesurfer tools (Fischl et al. 2004).

Atlas Application: The atlas was used to automatically label 18 additional �uent speakers (PFS; 4 Female, Age 19-35, Age Range: 19-35) and 20 matched persons who stutter (PWS; 5 Female, Age: 18-47, Mean: 27; SSI-4: 13-43, Median: 26 ). [See POSTER 681.12 for further analysis of these data]

To assess the performance of the automatic atlas, labels were corrected by a trained expert to conform to the SpeechLabel system and the automatic and manually corrected labels were compared in terms of percent overlap. Cortical regions were mapped to the each subjects T1 volume for these comparisons.

Region % overlap, PO, given by Dice coe�cent: PO = Labeled fsaverage: The Freesurfer fsaverage surface template was labeled by SLaparc and manually edited as needed.

2 |X ∩ Y| |X|+|Y|

Overlap of automatic and manually edited labelsPFS: Mean PO: 88% +/- 10%, Range: 46-100; PWS: Mean PO: 88% +/- 9%, Range: 52-100

Good overall overlap b/w auto and edited labels and no di�erence b/w groups (2-tailed paired t-test of mean over-laps for each region: p > .41). But are speci�c regions of low overlap, especially subdivisions of the inferior frontal gyrus region (see plot below).

PO of speech regions with PO < 75% in one of the groups subject groups.

Righ

t vIF

o

Left

dIFt

Righ

t pIF

s

Righ

t dIF

t

Left

vIFt

Righ

t vIF

tRi

ght a

FO

Left

dIFo

Left

pdPM

C

Left

SMA

Left

vIFo

Righ

t aIF

s

Left

aIFs

Left

pIFs

Righ

t dIF

o

40

80

70

60

50% O

verla

p (D

ice)

PWSPFS

The SpeechLabel Cortical Labeling SystemRegions are plotted on the Freesurfer fsaverage surface template for the left hemisphere. Each cortical hemisphere is divided into 63 regions of interest based on individual anatomical landmarks. Superior temporal, in-ferior frontal, precentral, and medial frontal regions are divided into functionally meaningful subunits for neuroimaging studies of speech. See table 1 for region abbreviation key.