View
1
Download
0
Category
Preview:
Citation preview
����������� �������������������������! "�$#%��&� �#'����()#*�+��,-.���,-�&����/����#'���021436587:9<;6=<>@?*ACBED4FHGI>6J45LKM?N567�OP3QBNF6RMJ4SESTK:9U;8=<SEVW5@XYJZB[]\]^`_'a4bdcfe�^`g%c�h4ikjmln^`oTcdbfpqo`arlsa4gLt�uvhre�_'wNcf^EbUjmgMxypng'^E^Ebfpng'xMz{}| ^�~yh | g'�<��hr_'�*png'���Ig'pn�Z^Ebf�dp�c��%zN�varl�cfpne�hrbf^2��\��*���*�`��I� ar��hrb�aYcfhrbd��hrik�H^Ebf�dhrgLa4lqp�c���arg't�uvhrxyg'p�cfpnhyg8z��� u��4�I�����4�����2zM�4�y y ���a4c | a4g�¡ | h%o��¢\Ib�£qz'�}a4lncfpne�h4bf^yz6��\��%�Y�r�4¤
¥U¦*§r¨k©kª«§%¬�U®¯¦%°}±�²Y³¢´6µ�¶�·'¸º¹/¸¼»�»M½�¾s¿
À 36Á8A�VWÂ�ÂEJrÃ�Ä«ÅMSÇÆ636Á6ÈÉVÉXr?%ÂEVWÅM5CÂEÅÊ2Ë8Ë@Ì8Í%Î8ÏPÐ4ÑyÒÓÐYÔÖÕ�×2ØÇÒÓÕ*Ù�Ð`Ú*ÒÓÛEÍ*ÎsÜ]Ë'ÝNÒÞËQÐ`ÐYß�ÒÞËLÝR'?*5L38?*SEK�àrá8FsàráMáNâ
ãäÅ*Â`?*Ès5L36A¢ÁQJ4SPÅ*ÄäÆ@?*7NJyå4æ<ç'è
A Survey of Current Methods in Medical ImageSegmentation
DzungL. Phamé�ê , ChenyangXué , Jerry L. PrinceéëDepartmentof ElectricalandComputerEngineering,TheJohnsHopkinsUniversity
3400N. CharlesSt. Baltimore,MD 21218ìLaboratoryof PersonalityandCognition,NationalInstituteon Aging
5600NathanShockDr., Baltimore,MD 21224
KEYWORDS: medicalimaging,imageprocessing,classification,deformablemodels,magneticresonanceimaging
ABSTRACT: Imagesegmentationplaysacrucialrolein many medicalimagingapplicationsby automat-ing or facilitatingthedelineationof anatomicalstructuresandotherregionsof interest.We presenthereina critical appraisalof thecurrentstatusof semi-automatedandautomatedmethodsfor thesegmentationofanatomicalmedicalimages.Currentsegmentationapproachesarereviewed with an emphasisplacedonrevealingthe advantagesanddisadvantagesof thesemethodsfor medicalimagingapplications.The useof imagesegmentationin differentimagingmodalitiesis alsodescribedalongwith thedifficultiesencoun-teredin eachmodality. We concludewith a discussionon the future of imagesegmentationmethodsinbiomedicalresearch.
1 Introduction
Diagnosticimagingis aninvaluabletool in medicinetoday. Magneticresonanceimaging(MRI), computedtomography(CT), digital mammography, andotherimagingmodal-ities provide an effective meansfor noninvasively mappingthe anatomyof a subject.Thesetechnologieshave greatlyincreasedknowledgeof normalanddiseasedanatomyfor medicalresearchandareacritical componentin diagnosisandtreatmentplanning.
With the increasingsizeandnumberof medicalimages,theuseof computersin fa-cilitating their processingandanalysishasbecomenecessary. In particular, computeralgorithmsfor thedelineationof anatomicalstructuresandotherregionsof interestarea key componentin assistingandautomatingspecificradiologicaltasks. Thesealgo-rithms,calledimage segmentationalgorithms,play a vital role in numerousbiomedicalimagingapplicationssuchasthequantificationof tissuevolumes[98], diagnosis[176],localizationof pathology[208], study of anatomicalstructure[198], treatmentplan-ning [90], partial volumecorrectionof functional imagingdata[128], andcomputer-integratedsurgery[6, 61].
Methodsfor performingsegmentationsvarywidelydependingonthespecificapplica-tion, imagingmodality, andotherfactors.For example,thesegmentationof braintissuehasdifferentrequirementsfrom thesegmentationof theliver. Generalimagingartifactssuchasnoise,partialvolumeeffects,andmotioncanalsohavesignificantconsequenceson the performanceof segmentationalgorithms. Furthermore,eachimagingmodalityhasits own idiosyncrasieswith which to contend.Thereis currentlyno singlesegmen-tationmethodthatyieldsacceptableresultsfor every medicalimage.Methodsdo exist
1
ImageSegmentation 2
that aremoregeneralandcanbe appliedto a variety of data. However, methodsthatarespecializedto particularapplicationscanoftenachieve betterperformanceby takinginto accountprior knowledge. Selectionof anappropriateapproachto a segmentationproblemcanthereforebeadifficult dilemma.
This chapterprovidesanoverview of currentmethodsusedfor computerassistedorcomputerautomatedsegmentationof anatomicalmedicalimages.Methodsandapplica-tionsthathave appearedin therecentliteraturearebriefly described.A full descriptionof competingmethodsis beyond the scopeof this chapterandthe readersarereferredto referencesfor additionaldetails. We focusinsteadon providing thereaderan intro-ductionto thedifferentapplicationsof segmentationin medicalimagingandthevariousissuesthat mustbe confronted.Also, we refer only to the mostcommonlyusedradi-ological modalitiesfor imaginganatomy:magneticresonanceimaging(MRI), X-raycomputedtomography(CT), ultrasound,andX-ray projectionradiography. Most of theconceptsdescribed,however, areapplicableto otherimagingmodalitiesaswell.
This chapteris organizedasfollows. In Section2, commonterminologyandissuesassociatedwith thesegmentationof medicalimagesaredefinedanddiscussed.In Sec-tion 3, webriefly describemethodologiesusedin commonsegmentationapproaches.InSection4, we review thewaysin which segmentationmethodshave recentlybeenap-plied in differentimagingmodalities.Finally in Section5, importantissuesrelatingtothefutureof medicalimagesegmentationarediscussed.
2 Background
In thissectionwedefineterminologythatwill beusedthroughoutanddescribeimportantissuesin thesegmentationof medicalimages.
2.1 Definitions
An imageisacollectionof measurementsin two-dimensional(2-D)or three-dimensional(3-D) space.In medicalimages,thesemeasurementsor image intensitiescanberadia-tionabsorptionin X-ray imaging,acousticpressurein ultrasound,or RFsignalamplitudein MRI. If a singlemeasurementis madeat eachlocationin the image,thenthe imageis calleda scalar image. If morethanonemeasurementis made(eg. dual-echoMRI),the imageis calleda vectoror multi-channel image. Imagesmay be acquiredin thecontinuousdomainsuchasonX-ray film, or in discretespaceasin MRI. In 2-D discreteimages,thelocationof eachmeasurementis calledapixelandin 3-D images,it is calleda voxel. For simplicity, we will oftenusethe term“pixel” to refer to both the2-D and3-D cases.
Classically, imagesegmentationis definedasthe partitioningof an imageinto non-overlapping,constituentregionswhich arehomogeneouswith respectto somecharac-teristicsuchasintensityor texture[66, 59, 132]. If thedomainof theimageis givenbyí, thenthe segmentationproblemis to determinethe sets î}ï�ð í
whoseunion is theentireimage
í. Thus,thesetsthatmake upasegmentationmustsatisfy
í�ñ òóï%ôIõ î}ï (1)
whereî�ï]ö÷îsø ñúùfor û"üñþý
, andeachî�ï is connected.Ideally, asegmentationmethodfindsthosesetsthatcorrespondto distinctanatomicalstructuresor regionsof interestintheimage.
ImageSegmentation 3
Whentheconstraintthat regionsbeconnectedis removed,thendeterminingthesetsî}ï is calledpixel classificationandthesetsthemselvesarecalledclasses. Pixel classi-fication ratherthanclassicalsegmentationis often a desirablegoal in medicalimages,particularlywhendisconnectedregionsbelongingto the sametissueclassneedto beidentified.Determinationof thetotal numberof classesÿ in pixel classificationcanbea difficult problem[97]. Often,thevalueof ÿ is assumedto beknown basedon priorknowledgeof theanatomybeingconsidered.
Labelingis theprocessof assigninga meaningfuldesignationto eachregion or classandcanbeperformedseparatelyfrom segmentation.It mapsthenumericalindex û ofset î}ï , to ananatomicaldesignation.In medicalimaging,the labelsareoftenvisuallyobviousandcanbedetermineduponinspectionby a physicianor technician.Computerautomatedlabelingis desirablewhenlabelsarenotobviousandin automatedprocessingsystems.A typical situationinvolving labelingoccursin digital mammographywheretheimageis segmentedinto distinctregionsandtheregionsaresubsequentlylabeledasbeinghealthytissueor tumorous.
Methodswhichdelineateastructureor structuresin animage,includingbothclassicalsegmentationandpixel classificationmethods,areconsideredin this review. Althoughwe do not discussspecificlabeling methods,we will discussseveral techniquesthatperformbothsegmentationandlabelingsimultaneously.
Two fields closely relatedto segmentationthat we do not discusshereare featuredetectionandmotion estimation.The distinctionwe make betweensegmentationandfeaturedetectionis thatfeaturedetectionis concernedwith determiningthepresenceofsomeimagepropertywhile segmentationgenerallyassumesthatthepropertyis alreadypresentandattemptsto preciselylocalizeareasthatpossesstheproperty. For example,edgedetectionmethodscandeterminethe locationof edgesin an imagebut withoutfurtherprocessing,do not necessarilyextractany region of interest.Motion estimationmethodsoftenconsistof applyingsegmentationalgorithmsto timesequencesof images.Weconsiderthis applicationof segmentationto bea separatebranchof researchanddonot includeit in this review.
2.2 Dimensionality
Dimensionalityreferstowhetherasegmentationmethodoperatesin a2-D imagedomainor a 3-D imagedomain.Methodsthat rely solelyon imageintensitiesareindependentof the imagedomain. However, certainmethodssuchasdeformablemodels,Markovrandomfields,andregiongrowing (describedin Section3), incorporatespatialinforma-tion andmaythereforeoperatedifferentlydependingonthedimensionalityof theimage.Generally, 2-D methodsareappliedto 2-D imagesand3-D methodsareappliedto 3-Dimages.In somecases,however, 2-D methodsareappliedsequentiallyto theslicesof a3-D image[7, 52,103, 141]. Thismayarisebecauseof practicalreasonssuchaseaseofimplementation,lower computationalcomplexity, andreducedmemoryrequirements.In addition,certainstructuresaremoreeasilydefinedalong2-D slices.
A uniquesituationthat occursin medicalimagesegmentationis the delineationofregionsonanon-Euclideandomain,suchasin braincortex parcellation[148, 156]. Thisis essentiallysegmentationon a surfaceof measurements.Becausea surfaceis a 2-Dobjectfolded in 3-D space,segmentationon a surfacecannot be treatedasa standard2-D or 3-D problem. The modelingof spatialcharacteristicsalonga surfaceis muchmoredifficult thanin a standardimagingplanebecauseof the irregularsamplingusedby meshrepresentationsandbecauseof theneedto computegeodesics[89]. This is anemergingareaof researchandpreliminaryresultshave shown greatpromise.
ImageSegmentation 4
(a) (b)
Figure1: Illustrationof partialvolumeeffect: (a) Idealimage,(b) acquiredimage.
2.3 Softsegmentationandpartial volumeeffects
Segmentationsthat allow regions or classesto overlap are called soft segmentations.Soft segmentationsareimportantin medicalimagingbecauseof partial volumeeffects,wheremultiple tissuescontribute to a singlepixel or voxel resultingin a blurring ofintensityacrossboundaries.Figure1 illustrateshow thesamplingprocesscanresultinpartialvolumeeffects,leadingto ambiguitiesin structuraldefinitions.In Figure1b, it isdifficult to preciselydeterminetheboundariesof thetwo objects.A hard segmentationforcesa decisionof whethera pixel is insideor outsidetheobject. Soft segmentationson the other hand, retain more information from the original imageby allowing foruncertaintyin the locationof objectboundaries.Notethat thepoint spreadfunctionofanimagingdevice canbelarger thanthespatialextentof a singlepixel or voxel. Thus,partialvolumeeffectscancauseboundariesto beblurredacrosssignificantportionsofanimage.
In pixel classificationmethods,thenotionof asoftsegmentationstemsfromthegener-alizationof asetcharacteristicfunction. A characteristicfunctionis simplyanindicatorfunctionof whereapixel is insideor outsideits correspondingset.For a location
ý���í,
thecharacteristicfunction ��ï�� ý�� of theset î}ï is definedto be�Iï�� ý��Pñ�� ifý�� î�ï�
otherwise(2)
Characteristicfunctionscanbegeneralizedto membership functions[205] which neednotbebinaryvalued.Membershipfunctions ï�� ý�� satisfythefollowing constraints:��� ï�� ý�� � �������������� û � ý (3)
ò�ï%ôIõ ï�� ý���ñ �������������� ý (4)
The valueof a membershipfunction ï�� ý�� canbe interpretedas the contribution ofclassû to location
ý. Thus,wherever membershipvaluesaregreaterthanzerofor two
or moreclasses,thoseclassesareoverlapping.Conversely, if themembershipfunctionis unity for somevalueof
ýand û , thenclassû is theonly contributing classat locationý
. Membershipfunctionscanbederivedusingfuzzyclusteringandclassifieralgorithms[140, 71], statisticalalgorithmsin which casethemembershipfunctionsareprobabilityfunctions[106, 197], or they canbecomputedasestimatesof partial volumefractions
ImageSegmentation 5
[24]. Softsegmentationsbasedonmembershipfunctionscanbeeasilyconvertedto hardsegmentationsby assigningapixel to its classwith thehighestmembershipvalue.
2.4 Continuousor discretesegmentations
Nearlyall medicalimagesusedfor imagesegmentationarerepresentedasdiscretesam-plesonauniformgrid. Segmentationmethodstypicallyoperateonthesamediscretegridastheimage.However, certainmethodssuchasdeformablemodels(seeSection3.7)arecapableof operatingin the continuousspatialdomain,therebyproviding the potentialfor subpixel accuracy in delineatingstructures.Subpixel accuracy is desirableparticu-larly whentheresolutionof theimageis onthesameorderof magnitudeasthestructureof interest.
Segmentationonthecontinuousdomainis notequivalentto partialvolumeestimationor othersoft segmentationmethods.Partial volumeestimationmethodsmerelyprovidethefractionof astructurewhichis presentin avoxel. Thismaybesufficient for quantifi-cationpurposesbut not in situationswherepreciselocalizationis required,suchasfortumorsin surgical or radiotherapy planning.Continuoussegmentationmethodsactuallyreconstructhow a structurepassesthrougha voxel. Althoughcontinuoussegmentationmethodshave subpixel or subvoxel resolution,their precisionandaccuracy arestill de-pendenton theresolutionof theoriginal data. Furthermore,this level of precisioncanbedifficult to validateonrealdata.
2.5 Interaction
Thetradeoff betweenmanualinteractionandperformanceis animportantconsiderationin any segmentationapplication.Manualinteractioncanimprove accuracy by incorpo-ratingprior knowledgeof anoperator. However, for largepopulationstudies,thiscanbelaboriousandtimeconsuming.
Thetypeof interactionrequiredby segmentationmethodscanrangefrom completelymanualdelineationof ananatomicalstructure,to theselectionof a seedpoint for a re-gion growing algorithm(seeSection3.2). Thedifferencesin thesetypesof interactionarethe amountof time andeffort required,aswell asthe amountof training requiredby anoperator. Methodsthatrely onmanualinteractioncanalsobevulnerableto relia-bility issues.However, even“automated”segmentationmethodstypically requiresomeinteractionfor specifyinginitial parametersthatcansignificantlyaffect performance.
2.6 Validation
In orderto quantifytheperformanceof a segmentationmethod,validationexperimentsarenecessary. Validationis typically performedusingoneof two differenttypesof truthmodels.Themoststraightforwardapproachto validationis by comparingtheautomatedsegmentationswith manuallyobtainedsegmentations(cf. [199, 186]). This approach,besidessuffering from thedrawbacksoutlinedin theprevioussection,doesnot guaran-teea perfecttruth modelsinceanoperator’s performancecanalsobeflawed. Theothercommonapproachto validatingsegmentationmethodsis throughthe useof physicalphantoms[102] or computationalphantoms[36]. Physicalphantomsprovide anaccu-ratedepictionof the imageacquisitionprocessbut typically do not presenta realisticrepresentationof anatomy. Computationalphantomscanbemorerealisticin this latterregard,but simulatetheimageacquisitionprocessusingonly simplifiedmodels.
ImageSegmentation 6
Oncea truth model is available, a figure of merit must be definedfor quantifyingaccuracy or precision(cf. [20]). The choiceof the figure of merit is dependentonthe applicationandcanbe basedon region informationsuchasthe numberof pixelsmisclassified,or boundaryinformationsuchasdistanceto thetrueboundary. A surveyon this topic is providedin [206].
3 Methods
In this section,we briefly describeseveral commonapproachesthat have appearedintherecentliteratureonmedicalimagesegmentation.Wedefineeachmethod,provideanoverview of how themethodis implemented,anddiscussits advantagesanddisadvan-tages. Although eachtechniqueis describedseparately, multiple techniquesareoftenusedin conjunctionwith oneanotherfor solvingdifferentsegmentationproblems.
We divide segmentationmethodsinto eightcategories: (1) thresholdingapproaches,(2) region growing approaches,(3) classifiers,(4) clusteringapproaches,(5) Markovrandomfield models,(6) artificial neuralnetworks,(7) deformablemodels,and(8) atlas-guidedapproaches.Othernotablemethodsthatdonotbelongto any of thesecategoriesaredescribedat theendof thissection.Of themethodsdiscussedin thissection,thresh-olding, classifier, clustering,andMarkov randomfield approachescanbe consideredpixel classificationmethods.
Most of theimagesegmentationmethodsthatwe will describecanbeposedasopti-mizationproblemswherethedesiredsegmentationminimizessomeenergy or costfunc-tion definedby theparticularapplication.In probabilisticmethods,this is equivalenttomaximizinga likelihoodor a posterioriprobability. Given the image � , we desirethesegmentation ! suchthat ! ñ ���#"%$�&�'(*) � ! � � � (5)
where ) , theenergy function,dependson theobserved image � anda segmentation! .Defininganappropriate) is amajordifficulty in designingsegmentationalgorithmsbe-causeof thewide varietyof imagepropertiesthatcanbeused,suchasintensity, edges,andtexture. In additionto informationderived from the image,prior knowledgecanalsobe incorporatedto further improve performance.The advantageof posinga seg-mentationasanoptimizationproblemis thatit preciselydefineswhatis desirablein thesegmentation. It is clear that for differentapplications,differentenergy functionsarenecessary.
Severalgeneralsurveys on imagesegmentationexist in theliterature[66, 132]. Addi-tionalsurveysonimagesegmentationspecificallyfor medicalimageshavealsoappeared[21, 11, 172, 208, 29, 6].
3.1 Thresholding
Thresholdingapproachessegmentscalarimagesby creatinga binarypartitioningof theimageintensities.Figure2ashows thehistogramof a scalarimagethatpossessesthreeapparentclassescorrespondingto the threemodes.A thresholdingprocedureattemptsto determineanintensityvalue,calledthethreshold, whichseparatesthedesiredclasses.Thesegmentationis thenachievedby groupingall pixelswith intensitygreaterthanthethresholdinto oneclass,andall otherpixelsinto anotherclass.Two potentialthresholdsareshown in Figure2aat thevalleys of thehistogram.Determinationof morethanonethresholdvalueis aprocesscalledmultithresholding[155].
ImageSegmentation 7
intensity
occu
renc
e +�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�++�+�+�+�+�+�+�+�+�+SEED
y1
y2
(a) (b) (c)
Figure2: Featurespacemethodsandregion growing: (a) a histogramshowing threeapparentclasses,(b) a2-D featurespace,(c) exampleof regiongrowing.
Thresholdingis a simpleyet often effective meansfor obtaininga segmentationinimageswheredifferentstructureshave contrastingintensitiesor otherquantifiablefea-tures. Thepartition is usuallygeneratedinteractively, althoughautomatedmethodsdoexist [155]. For scalarimages,interactive methodscanbe basedon an operator’s vi-sualassessmentof theresultingsegmentationsincethethresholdingoperationis imple-mentablein real-time.
Thresholdingis oftenusedasaninitial stepin asequenceof imageprocessingopera-tions.Its mainlimitationsarethatin its simplestform only two classesaregeneratedandit cannot beappliedto multi-channelimages.In addition,thresholdingtypically doesnottake into accountthespatialcharacteristicsof animage.Thiscausesit to besensitiveto noiseandintensityinhomogeneities,which canoccurin magneticresonanceimages(seeSection4.2). Both theseartifactsessentiallycorrupt the histogramof the image,makingseparationmoredifficult. For thesereasons,variationsonclassicalthresholdinghave beenproposedfor medicalimagesegmentationthatincorporateinformationbasedon local intensities[104] andconnectivity [99]. A survey on thresholdingtechniquesisprovidedin [155].
3.2 Regiongrowing
Region growing is a techniquefor extractinga region of the imagethat is connectedbasedon somepredefinedcriteria. This criteriacanbebasedon intensityinformationand/oredgesin theimage[66]. In its simplestform, regiongrowing requiresaseedpointthat is manuallyselectedby anoperator, andextractsall pixelsconnectedto the initialseedwith thesameintensityvalue.This is depictedin Figure2b,whereregiongrowinghasbeenusedto isolateoneof thestructuresfrom Figure1a.
Like thresholding,region growing is not often usedalonebut within a setof imageprocessingoperations,particularlyfor the delineationof small, simplestructuressuchastumorsandlesions[57, 143]. Its primarydisadvantageis that it requiresmanualin-teractionto obtainthe seedpoint. Thus, for eachregion that needsto be extracted,aseedmustbeplanted.Split andmergealgorithmsarerelatedto region growing but donot requirea seedpoint [115]. Region growing canalsobesensitive to noise,causingextractedregionsto have holesor even becomedisconnected.Conversely, partial vol-umeeffectscancauseseparateregions to becomeconnected.To help alleviate theseproblems,a homotopicregion growing algorithmhasbeenproposedthatpreservesthetopologybetweenan initial region andan extractedregion [114]. Fuzzyanalogiestoregiongrowing have alsobeendeveloped[183].
ImageSegmentation 8
3.3 Classifiers
Classifiermethodsare patternrecognitiontechniquesthat seekto partition a featurespacederivedfrom theimageusingdatawith known labels[159, 11]. A featurespaceistherangespaceof any functionof theimage,with themostcommonfeaturespacebeingthe imageintensitiesthemselves. A histogram,asshown in Figure2a, is an exampleof a 1-D featurespace.Figure2c shows anexampleof a partitioned2-D featurespacewith two apparentclasses.All pixelswith theirassociatedfeaturesontheleft sideof thepartitionwould begroupedinto oneclass.Althoughthefeaturesusedcanberelatedtotextureor otherproperties,weassumefor simplicity thatthefeaturesaresimplyintensityvalues.
Classifiersareknown assupervisedmethodssincethey requiretrainingdatathataremanuallysegmentedandthenusedasreferencesfor automaticallysegmentingnew data.Thereareanumberof waysin whichtrainingdatacanbeappliedin classifiermethods.Asimpleclassifieris thenearest-neighborclassifier, whereeachpixel or voxel is classifiedin thesameclassasthetrainingdatumwith theclosestintensity. The û -nearest-neighbor(kNN) classifieris ageneralizationof thisapproach,wherethepixel is classifiedaccord-ing to themajority voteof the û closesttrainingdata.ThekNN classifieris considereda nonparametricclassifiersinceit makesno underlyingassumptionaboutthestatisticalstructureof thedata.Anothernonparametricclassifieris theParzenwindow, wheretheclassificationis madeaccordingto themajority votewithin a predefinedwindow of thefeaturespacecenteredat theunlabeledpixel intensity.
A commonly-usedparametricclassifieris the maximumlikelihood (ML) or Bayesclassifier. It assumesthatthepixel intensitiesareindependentsamplesfrom amixtureofprobabilitydistributions,usuallyGaussian.This mixture,calleda finite mixturemodel,is givenby theprobabilitydensityfunction, ��- ø�.#/ �#0 ��ñ ò�
ï%ôIõ 0 ï , ï���- ø1.#/ ï � (6)
where -Nø is the intensityof pixelý,, ï is a componentprobabilitydensityfunctionpa-
rameterizedby / ï , and / ñ32 /8õ �5454546� / ò87 . Thevariables0 ï aremixing coefficientsthatweight the contribution of eachdensityfunctionand 0 ñ92 0 õ �5454546�#0 ò87 . Trainingdatais collectedby obtainingrepresentative samplesfrom eachcomponentof the mixturemodel and then estimatingeach / ï accordingly. For Gaussianmixtures, this meansestimatingÿ means,covariances,andmixing coefficients. Classificationof new datais obtainedby assigningeachpixel to the classwith the highestposteriorprobability.Whenthedatatruly follows afinite Gaussianmixturedistribution, theML classifiercanperformwell and is capableof providing a soft segmentationcomposedof the poste-rior probabilities.Additional parametricandnonparametricclassifiersaredescribedin[208].
Standardclassifiersrequirethatthestructuresto besegmentedpossessdistinctquan-tifiablefeatures.Becausetrainingdatacanbelabeled,classifierscantransfertheselabelsto new dataaslongasthefeaturespacesufficiently distinguisheseachlabelaswell. Be-ing non-iterative, they arerelatively computationallyefficient andunlike thresholdingmethods,they canbe appliedto multi-channelimages. A disadvantageof classifiersis that they generallydo not performany spatialmodeling. This weaknesshasbeenaddressedin recentwork extendingclassifiermethodsto segmentingimagesthat arecorruptedby intensity inhomogeneities[197]. Neighborhoodandgeometricinforma-tion werealsoincorporatedinto a classifierapproachin [85]. Anotherdisadvantageistherequirementof manualinteractionfor obtainingtrainingdata. Trainingsetscanbe
ImageSegmentation 9
acquiredfor eachimagethat requiressegmenting,but this canbe time consumingandlaborious.On theotherhand,useof thesametrainingsetfor a large numberof scanscanleadto biasedresultswhich do not take into accountanatomicalandphysiologicalvariability betweendifferentsubjects.
3.4 Clustering
Clusteringalgorithmsessentiallyperformthesamefunctionasclassifiermethodswith-out theuseof trainingdata. Thus,they aretermedunsupervisedmethods.In ordertocompensatefor the lack of training data,clusteringmethodsiteratebetweensegment-ing the imageandcharacterizingthepropertiesof theeachclass.In a sense,clusteringmethodstrain themselvesusingtheavailabledata.
Threecommonlyusedclusteringalgorithmsarethe ÿ -meansor ISODATA algorithm[34], the fuzzy : -meansalgorithm [46, 11], and the expectation-maximization(EM)algorithm [102, 107]. The ÿ -meansclusteringalgorithm clustersdataby iterativelycomputingameanintensityfor eachclassandsegmentingtheimageby classifyingeachpixel in theclasswith theclosestmean[75]. Figure3b shows theresultof applyingtheÿ -meansalgorithmto asliceof a MR brainimagein Figure3a.Thenumberof classeswas assumedto be three,representing(from dark gray to white) cerebrospinalfluid,graymatter, andwhite matter. The fuzzy : -meansalgorithmgeneralizesthe ÿ -meansalgorithm[11], allowing for softsegmentationsbasedonfuzzysettheory[205]. TheEMalgorithmappliesthesameclusteringprincipleswith theunderlyingassumptionthatthedatafollows a Gaussianmixture model (seeEq. (6)). It iteratesbetweencomputingtheposteriorprobabilitiesandcomputingmaximumlikelihoodestimatesof themeans,covariances,andmixing coefficientsof themixturemodel.
Althoughclusteringalgorithmsdonot requiretrainingdata,they do requireaninitialsegmentation(or equivalently, initial parameters).TheEM algorithmhasdemonstratedgreatersensitivity to initialization thanthe ÿ -meansor fuzzy : -meansalgorithms[42].Likeclassifiermethods,clusteringalgorithmsdonotdirectly incorporatespatialmodel-ing andcanthereforebesensitive to noiseandintensityinhomogeneities.This lack ofspatialmodeling,however, canprovidesignificantadvantagesfor fastcomputation[69].Work on improving therobustnessof clusteringalgorithmsto intensityinhomogeneitiesin MR imageshasdemonstratedexcellentsuccess[58, 140]. Robustnessto noisecanbeincorporatedusingMarkov randomfield modelingasdescribedin thenext section.
3.5 Markov randomfieldmodels
Markov randomfield (MRF) modelingitself is not a segmentationmethodbut a sta-tistical modelwhich canbe usedwithin segmentationmethods.MRFs modelspatialinteractionsbetweenneighboringor nearbypixels. Theselocal correlationsprovide amechanismfor modelinga varietyof imageproperties[105]. In medicalimaging,theyaretypically usedto take into accountthefactthatmostpixelsbelongto thesameclassastheirneighboringpixels. In physicalterms,this impliesthatany anatomicalstructurethat consistsof only onepixel hasa very low probability of occurringundera MRFassumption.
MRFsareoftenincorporatedinto clusteringsegmentationalgorithmssuchasthe ÿ -meansalgorithmundera Bayesianprior model[133, 149, 70,58]. Thesegmentationisthenobtainedby maximizingthea posterioriprobabilityof thesegmentationgiventheimagedatausingiterative methodssuchasiteratedconditionalmodes[10] or simulatedannealing[54]. Figure3c, shows the robustnessto noisein a segmentationresulting
ImageSegmentation 10
(a) (b) (c)
Figure3: Segmentationof aMR brainimage:(a)original image,(b) segmentationusingthe ÿ -meansalgorithm,(c) segmentationusingthe ÿ -meansalgorithmwith a Markovrandomfield prior.
from an MRF prior. The segmentationis muchsmootherthanthe non-MRFresultofFigure3b.
A difficulty associatedwith MRF modelsis properselectionof theparameterscon-trolling the strengthof spatialinteractions[105]. Too high a settingcanresult in anexcessively smoothsegmentationanda lossof importantstructuraldetails.In addition,MRF methodsusuallyrequirecomputationallyintensive algorithms.Despitethesedis-advantages,MRFsarewidely usednot only to modelsegmentationclasses,but alsotomodelintensityinhomogeneitiesthatcanoccurin MR images[70] andtextureproperties[153].
3.6 Artificial neural networks
Artificial neuralnetworks (ANNs) aremassively parallelnetworks of processingele-mentsor nodesthat simulatebiological learning. Eachnodein an ANN is capableofperformingelementarycomputations.Learningis achieved throughthe adaptationofweightsassignedto the connectionsbetweennodes. A thoroughtreatmenton neuralnetworkscanbefoundin [27, 68].
ANNs representa paradigmfor machinelearningand can be usedin a variety ofwaysfor imagesegmentation.Themostwidely appliedusein medicalimagingis asaclassifier[64, 53], wheretheweightsaredeterminedusingtrainingdata,andtheANNis thenusedto segmentnew data.ANNs canalsobeusedin anunsupervisedfashionasaclusteringmethod[11, 152], aswell asfor deformablemodels[191].
Becauseof the many interconnectionsusedin a neuralnetwork, spatialinformationcaneasilybeincorporatedinto its classificationprocedures.AlthoughANNs areinher-ently parallel,their processingis usuallysimulatedon a standardserialcomputer, thusreducingthispotentialcomputationaladvantage.
3.7 Deformablemodels
Deformablemodelsarephysicallymotivated,model-basedtechniquesfor delineatingregion boundariesusingclosedparametriccurvesor surfacesthatdeformunderthe in-
ImageSegmentation 11
(a) (b)
Figure4: (a) A 2-D exampleof usinga deformablecontourto extract theinnerwall ofthe left ventricleof a humanheartfrom anMR image. The initial deformablecontour(plottedin gray) andthe final convergedresult(plottedin white). (b) A 3-D exampleof usinga deformablesurfaceto reconstructthebraincorticalsurfacefrom a 3-D MRimage.
fluenceof internalandexternalforces.To delineateanobjectboundaryin an image,aclosedcurve or surfacemustfirst beplacednearthedesiredboundaryandthenallowedto undergo an iterative relaxationprocess. Internal forcesare computedfrom withinthecurve or surfaceto keepit smooththroughoutthedeformation.Externalforcesareusuallyderivedfrom theimageto drive thecurve or surfacetowardsthedesiredfeatureof interest.Figure4ashows anexampleof applyinga 2-D deformablemodelor activecontourto aMR heartimage.Theactive contourwasinitializedasacircle,andthenal-lowedto deformto theinnerboundaryof theleft ventricle.Figure4bshowsanexampleof a3-D deformablesurfacethatwasusedto extractthecerebralcortex from aMR headscan.
Mathematically, a deformablemodelmovesaccordingto its dynamicequationsandseekstheminimumof agivenenergy functional[87, 180]. Thedeformationof a typical2-D deformablemodelcanbecharacterizedby thefollowing dynamicequation:; �=< ��>@? ! �=< �BA �> A ? CED �=< ��> ! �=< �BA �> A ñGFIHKJML C FINPOML (7)
where ! �=< �BA � ñ ��Q��=< �BA � � -R�=< �BA �B� is a parametricrepresentationof the positionof themodelat a given time A , and ; �=< � and D �=< � areparametersrepresentingthemassden-sity anddampingdensityof themodel,respectively. Eq. (7) causesthemodelto moveaccordingto thedirectionandmagnitudeof theforceson theright handside.ThemostcommonlyusedinternalforcesareFIHKJMLÇñ >> <TS1U �=< � > ! �=< �BA �> < VXW >@?> < ?ZY�[ �=< � >@? !> < ?R\ (8)
whichrepresentinternalstretchingandbendingforces.Themostcommonlyusedexter-nal forcesarecomputedasthegradientof anedgemap(asshown in Figure4b).
Themainadvantagesof deformablemodelsaretheirability to directlygenerateclosedparametriccurvesor surfacesfrom imagesandtheir incorporationof asmoothnesscon-straintthatprovidesrobustnessto noiseandspuriousedges.A disadvantageis thatthey
ImageSegmentation 12
(a) (b) (c)
Figure 5: Demonstrationof atlas warping: (a) templateimage, (b) target image,(c) warpedtemplate(Imagesprovidedcourtesyof G.E.ChristensenandM.I. Miller).
requiremanualinteractionto placeaninitial modelandchooseappropriateparameters.Reducingsensitivity to initializationhasbeena topic of researchthathasdemonstratedexcellentsuccess[33, 18,112, 201]. Standarddeformablemodelscanalsoexhibit poorconvergenceto concave boundaries.This difficulty canbealleviatedsomewhatthroughtheuseof pressureforces[33] andothermodifiedexternalforcemodels[201]. Anotherimportantextensionof deformablemodelsis theadaptivity of modeltopologyusinganimplicit representationratherthananexplicit parameterization[18, 112, 118]. A generalreview ondeformablemodelsin medicalimageanalysiscanbefoundin [119].
3.8 Atlas-guidedapproaches
Atlas-guidedapproachesarea powerful tool for medicalimagesegmentationwhenastandardatlasor templateis available.Theatlasis generatedby compilinginformationontheanatomythatrequiressegmenting.Thisatlasis thenusedasareferenceframeforsegmentingnew images.Conceptually, atlas-guidedapproachesaresimilar to classifiersexceptthey areimplementedin thespatialdomainof the imageratherthanin a featurespace.
Thestandardatlas-guidedapproachtreatssegmentationasaregistrationproblem(see[111] for adetailedsurvey onregistrationtechniques).It first findsaone-to-onetransfor-mationthatmapsapre-segmentedatlasimageto thetargetimagethatrequiressegment-ing. This processis oftenreferredto asatlaswarping. Thewarpingcanbeperformedusinglinear [175, 96, 151] transformationsbut becauseof anatomicalvariability, a se-quentialapplicationof linearandnon-linear[35, 39, 26, 156] transformationsis oftenused.An exampleof atlaswarpingfor a MR headscanis shown in Figure5 [26]. Be-causetheatlasis alreadysegmented,all structuralinformationis transferredto thetargetimage.This is shown in Figure6, wheretheTalairachbrainatlas[175] hasbeenmappedto anMR image[39].
Atlas-guidedapproacheshave beenappliedmainly in MR brainimaging.An advan-tageof atlas-guidedapproachesis thatlabelsaretransferredaswell asthesegmentation.They alsoprovideastandardsystemfor studyingmorphometricproperties[41, 181, 79].Evenwith non-linearregistrationmethodshowever, accuratesegmentationsof complexstructuresis difficult dueto anatomicalvariability. This is shown in Figure6 wherethecerebralcortex is not segmentedasaccuratelyasshown in Figure3. Thus,atlas-guided
ImageSegmentation 13
Figure6: Threeslicesfrom a MR brain volumeoverlaid with a warpedatlas(Imagesprovidedcourtesyof C.A. Davatzikos).
approachesaregenerallybetter-suitedfor segmentationof structuresthatarestableoverthepopulationof study. Onemethodthathelpsmodelanatomicalvariability is theuseofprobabilisticatlases[181] but theserequireadditionaltimeandinteractionto accumulatedata.
3.9 Otherapproaches
Model-fitting is asegmentationmethodthattypically fits asimplegeometricshapesuchasanellipseor parabolato thelocationsof extractedimagefeaturesin animage[137].It is a techniquewhich is specializedto thestructurebeingsegmentedbut is easilyim-plementedandcanprovidegoodresultswhenthemodelis appropriate.A moregeneralapproachis to fit splinecurvesor surfaces[7] to the features.Themaindifficulty withmodel-fitting is that imagefeaturesmustfirst be extractedbeforethe fitting can takeplace.
Thewatershedalgorithmusesconceptsfrom mathematicalmorphology[59] to parti-tion imagesinto homogeneousregions[192]. Thismethodcansuffer from oversegmen-tation,which occurswhenthe imageis segmentedinto anunnecessarilylarge numberof regions. Thus,watershedalgorithmsin medicalimagingareusuallyfollowed by apostprocessingstepto mergeseparateregionsthatbelongto thesamestructure[161].
4 Modalities
In this section,we review the applicationof segmentationto variousmedicalimagingmodalities.Wedescribethespecificissuesrelevantto eachmodalityandtheanatomicalregionsfor which segmentationmethodshave beenapplied.For informationaboutthephysicsbehindtheimageacquisitionprocessin thesemodalities,see[110, 170].
4.1 Magneticresonanceimaging
Themajority of researchin medicalimagesegmentationpertainsto its usefor MR im-ages,especiallyin brain imaging. This is becauseof MR’s ability to provide a com-binationof high resolution(on the order of 1mm cubic voxels), excellent soft tissuecontrast,anda high signal-to-noiseratio. Furthermore,multi-channelMR imageswithvarying contrastcharacteristicscan be acquired,providing additionalinformation for
ImageSegmentation 14
distinguishingbetweendifferentstructures.For generalreviews on thesegmentationofMR images,see[11, 139, 106, 208, 29]. Direct comparisonsof differentmethodsforsegmentingMR imagesarealsoavailable[187, 30, 64].
Becauseof its ability to derive contrastfrom a numberof tissueparameters,manydifferentpulsesequencesexist for acquiringMR images.Determiningtheoptimalpulsesequencefor obtainingaccuratesegmentations[147] is thereforeanimportantproblemthat requiresknowledgeof the underlyingtissuepropertiesof the anatomyto be seg-mented[141, 50]. Furthermore,becauseof theanatomicalandphysiologicalvariabilitybetweendifferentsubjects,differentpopulationsmayrequiredifferentpulsesequences[141].
Much of theliteratureon segmentationin MRI focusesspecificallyon thesegmenta-tion of headscansin normalsubjects.Therearethreegeneralgoalsin this application:1) extractthebrainvolume,2) segmentbrain tissueinto graymatter, white matter, andcerebrospinalfluid, and3) delineatespecificbrainstructuressuchasthecerebralcortexor thehippocampus.An exceptionto thiscategorizationis theuseof atlas-guidedmeth-ods[35], which arecapableof fully segmentingandlabelingall structuresof thebrainsimultaneously, but alsohave certaindisadvantages(seeSection3.8). Overviews on thesegmentationof neuroanatomyareprovidedin [32, 198].
Brain volumeextractionis a difficult problemin MR headscans,particularlyin T1-weightedimages. However, it is often a necessarystepbeforesegmentationof otherstructurescan take place. Problemsin brain volumeextractionarisebecausethereisa greatdealof overlapin intensityvaluesbetweenthe non-brainandbrain tissuesandbecausethetwo canoftenappearconnected.Onemethodto dealwith thesedifficultiesis to allow for somelossof brain tissuein a preliminarysegmentationstepand thento recover the tissueusingmorphologicalfilters [16, 156]. Several methodshave alsoapplieddeformablemodelsasa final stepin a sequenceof imageprocessingoperations[84, 1, 5]. Atlas-guidedapproacheshave alsobeenapplied[1].
Methodsthatattemptto segmentbrain tissueasgraymatter, white matter, andcere-brospinalfluid useeitherT1-weightedscalardata[77, 126, 72, 122, 149, 194] or mul-tispectraldata[189, 108, 24, 91, 55, 64, 30, 107, 67, 88, 182, 152]. The trendin theliteraturehasbeenfavoring theuseof T1-weighteddatawhich is capableof providinghigherresolutiondatawithout increasingacquisitiontimeandstill maintaininggoodtis-suecontrastandlow noise. Classifierapproaches[17, 197, 85], clusteringapproaches[64, 107, 140], neuralnetworkapproaches[64, 152], andMarkov randomfields[70, 149]have all beenusedfor brainsegmentation.Becausemostof thesemethodsarebasedonintensity information,a major concernis the presenceof intensityinhomogeneities,atopic discussedin the next section. Becausethe gray matterin the brain is thin andhighly convoluted,partialvolumeeffectsareanotherimportantconsideration.Efforts inmodelingpartialvolumeeffectshaveusedstatisticalmethods[24, 157, 158, 17,76, 95],soft segmentationderived throughfuzzy settheory[28, 13, 154, 140], andlinearfilters[166].
The automatedsegmentationof specificstructuresin brainsis an importantareaofresearchfor morphometricanalysis.Segmentationof the cerebralcortex hasreceivedmuch attentionwith most methodsemploying deformablemodels[52, 40, 120, 178,200]. Deformablemodelshave alsobeenusedfor segmentinga varietyof otherstruc-turessuchastheventricles[116, 195], thecorpuscallosum[41, 195], thehippocampus[4, 56], andothers[173, 190, 177]. Although not often employed for segmentingthecortex, atlas-guidedmethodsalsoappearwell-suitedfor segmentingsubcorticalbrainstructuressuchasthe ventricles[2, 142] andthe hippocampus[79]. Segmentationoftumorsandlesionsin the brain hasbeenappliedto magneticresonanceimagesusing
ImageSegmentation 15
neuralnetworks [207], atlas-guidedapproaches[83], linear filters [166], fuzzy regiongrowing [185], anddeformablemodels[19]. Becauseof its complexity, this problemtypically requiresa sequenceof operators[196, 57].
Besidesheadscans,segmentationhasalsobeenusedfor extractinga varietyof otherstructures.Segmentationin cardiacimaginghasbeenusedfor delineatingthecavitiesof theleft ventricleusingregiongrowing andthresholdingapproaches[163, 44], aswellasdeformablemodels[12, 145, 9]. Deformablemodelsin cardiacimaging,however,are more often proposedfor tracking motion in the heart [8]. Markov randomfieldmodelshave beenusedfor segmentingkneeimages[25] aswell asmagneticresonanceangiograms(MRAs) [188]. Othermethodsfor segmentingMRAs includedeformablemodels[109] andthresholding[31]. Although MRA doesnot requirecatheterization,segmentationin standardangiographyis morecommonbecauseof its generallysuperiorcontrastandspatialandtemporalresolution[168, 48, 65, 47].
4.2 Intensityinhomogeneitiesin MRI
A major difficulty in the segmentationof MR imagesis the intensity inhomogeneityartifact[162, 37, 164], whichcausesashadingeffect to appearover theimage.Thisarti-factcansignificantlydegradetheperformanceof methodsthatassumethattheintensityvalueof a tissueclassis constantover the image.Figure7ashows anaxially acquiredMR imageof a femaleheartwith myocardialinfarction. Intensityinhomogeneitiesarenoticeableparticularnearthe breastareas.Numerousapproacheshave beenproposedin theliteraturefor performingtissueclassificationin thepresenceof intensityinhomo-geneityartifacts.Somemethodssuggestaprefilteringoperationthatattemptsto removethe inhomogeneityprior to actualsegmentation[108, 43, 123, 76, 100, 92, 14, 165].Methodsthat simultaneouslysegmentthe imagewhile estimatingthe inhomogeneityhowever, offer theadvantageof beingableto useintermediateinformationgainedfromthesegmentation.
Therearetwo prevailing approachesfor modelinginhomogeneitiesin methodsthatperform simultaneoussegmentation. The first approachassumesthat the meantis-sueintensityfor eachtissueclassis spatiallyvarying andindependentof oneanother[133, 202, 149, 130]. Thesecondapproachmodelstheinhomogeneitiesasamultiplica-tivegainfield [150, 140] or additivebiasfieldof theimagelogarithm[197, 62, 70, 85]. Itisunclearwhichof thesetwoprovidesmoreaccuratemodelingof inhomogeneityeffects,althoughthe secondapproachhasthe advantageof beingcomputationallylessexpen-sive. The secondapproachcanalsobe usedfor removing inhomogeneitiesby simplemultiplicationof theacquiredimageby thereciprocalof theestimatedgainfield. Fig-ure7 shows theresultsof applyingtheadaptive fuzzy : -meansalgorithmthatperformsa soft segmentationwhile compensatingfor intensityinhomogeneities[140]. Theheartimagewassegmentedinto threeclassesandFigure7d-f correspondto themembershipfunctionsfor thosethreeclasses.Figure7bshowsthegainfield estimatedfrom theorig-inal image.Thehardsegmentationin Figure7cwasobtainedasoutlinedin Section2.3.Notethatthering artifactpresentin Figure7eresultsfrom partialvolumeeffectscausingtheboundarybetweenfat,skin,andair to haveanintensitysimilarto thatof muscle.Thiseffect is commonandadisadvantageof intensity-basedpixel classificationmethods.
4.3 Chestradiography
Chestradiographshavenotreceivedmuchrecentattentionin thesegmentationliteraturepartlybecausetheprojectionnatureof theimagesmakesquantificationandlocalization
ImageSegmentation 16
(a) (b) (c)
(d) (e) (f)
Figure7: Exampleof simultaneousinhomogeneitycorrectionandsoft segmentation:(a)MR heartimageacquiredusingafastspinechosequencein atrueaxialprescription,(b) estimatedgain field, (c) hardsegmentationinto threeclasses,(d)-(f) membershipfunctionsof thethreeclasses(Dataprovidedcourtesyof C. Constantinides).
a difficult taskand alsobecausetheir analysisoften doesnot requirea segmentation. Despitetheseissues,efforts have beenmadefor segmentingchestradiographsintoanatomicalregions using classifiers[121, 193] and Markov randomfields [193]. Inaddition, an algorithm hasbeenproposedfor delineatingposteriorrib bordersusingactive contourmodels[204].
4.4 Computedtomography
X-ray computedtomography(CT) alleviatessomeof the difficulties associatedwithprojectionradiographyandallows for 3-D imagingat resolutionsequalto or betterthanMRI. Soft tissuecontrastin CT is not asgoodasin MRI, but CT remainsthemodalityof choicefor imagingboneandbonetumors. Segmentationof bonecanbe achievedusing thresholdingand region growing operations[60] aswell as moresophisticatedmethodssuchasMarkov randomfields[135], deformablemodels[134, 177, 145, 129],andfuzzy region growing [183]. Oncesegmented,imagerenderingsareoftenusedtoprovidedetailedvisualizationof skeletalstructure[184].
Segmentationin CT hasalsobeenappliedto thoracicscansusingstatisticalclustering[102], a combinationof region growing and watershedalgorithms[199], a combina-tion of region growing and fuzzy logic [15], and deformablemodels[174, 78, 145].Somemethodshave beenappliedspecificallyfor the reconstructionof bronchialtrees[167, 136]. CT imageshave alsobeenusedin brainsegmentation[103], althoughMRimagingis presentlymorecommonin neuroimagingsegmentationapplications.In ad-
ImageSegmentation 17
(a) (b) (c)
Figure8: Segmentationin digital mammography:(a)digitizedmammogramandradiol-ogist’s boundaryfor biopsy-proven malignanttumor, (b) resultof watershedalgorithm,(c) suspiciousregionsdeterminedby automatedmethod(Imagesprovided courtesyofC.E.Priebe).
dition, liver segmentationhasbeenperformedusingmodel-fitting[7], anddeformablemodels[116, 49, 127, 56]. Deformablemodelshave alsobeenappliedin otherCT seg-mentationapplications,including the delineationof abdominalaortic aneurysms[80],segmentationof thestomach[113], andsegmentationof theheart[117, 78,160].
4.5 Digital mammography
Segmentationin digital mammographyis typically performedfor localizationof tumors[143, 103], microcalcificationclusters[23, 74, 171], or other indicatorsof pathology[82]. In delineatingsuspiciousmassesfor mammography, segmentationmethodsaretypically employed in oneof two ways. In the first approach,the mammogramis ini-tially segmentedinto candidateregionswhich arethen labeledasbeingsuspiciousornormal[144, 104, 74, 86]. In thesecondapproach,theimageis first processedto detectfor thepresenceof pathologyanda segmentationis performedasa final stepto deter-mine its preciselocation[23, 94, 63, 22]. Thresholdingandits variationsarethemostoften usedsegmentationtechniquein mammography[144, 171, 23, 63, 74], althoughextensionsof region growing methodshave alsobeenproposed[94, 143]. A compar-ison of thresholdingandregion growing waspresentedin [82]. Becausepathologicalareasoftenpossessdifferenttextural propertiesin mammograms,Markov randomfieldmethodshave alsobeensuccessfullyemployed[104, 22].
Figure8 shows anexamplewherethemammogramis initially oversegmentedusinga watershedalgorithm.A statisticalclassifier[146] is thenusedto determinewhich re-gionscontainmicrocalcifications.This classificationstepis typically performedusingtextural properties.As illustratedin thefigure,falsepositivescanbea significantprob-lem in thedetectionof suspiciousmassesin mammograms(althoughin this case,theyfall outsidethebreastarea).For thesereasons,computerautomateddetectionin mam-mographyhasbeenusedonly asanaidto increasethereliability of aphysician’sdiagno-sis. Improvedinitial segmentationsmayleadto a reductionin false-positives.Notealsothataperfectdelineationof massesis difficult but notoftennecessaryin mammographysincedetectionis theprimarygoal.
ImageSegmentation 18
4.6 Ultrasound
Segmentationalgorithmshavehadfairly limitedapplicationin ultrasoundimaging.Highlevelsof specklingpresentin ultrasoundimagesmake accuratesegmentationsdifficult.Furthermore,the real-timeacquisitionin ultrasoundmakes it bettersuitedfor motionestimationtasks(cf. [45, 124]) whereactive contours,becauseof their dynamicnature,areoftenused.Ultrasoundis alsooftenemployed in detectingpathologyusingtexturalclassifiers(cf. [125, 81]) but regionsof interestaretypically obtainedthroughmanualinteraction.
Nevertheless,someautomatedsegmentationwork hasbeenperformedin ultrasoundfor extractinga variety of structures.In [179], a thresholdingof intensityandtexturestatisticswasusedto segmentovariancysts.Deformablemodelshave hadgoodsuccessin ultrasoundapplicationssuchasin thesegmentationof echocardiograms[38, 160, 78,93]. In [101], anactive contourwasusedto determinetheboundaryof thecalcaneusinbroadbandultrasonicattenuationparameterimages,which arelessnoisy thanstandardultrasoundimages.In [19, 138], deformablemodelswereusedto determinethebound-aryof thefetusandthefetusheadrespectively. Deformablemodelshavealsobeenusedto segmentcystsin ultrasoundbreastimages[203]. Othermethodshave beenappliedfor thesegmentationof coronaryarteriesin intravascularultrasoundimages[169] andfor segmentingthepubicarchin transrectalultrasound[137].
4.7 Multimodal
Multimodal imagesegmentationattemptsto take advantageof the different kinds ofanatomicalinformationprovidedby differentimagingmodalities.For example,multi-modalimagingcantake advantageof theboneimagingcapabilitiesin CT andthesofttissueimagingcapabilitiesin MRI. In brain imaging, functional imagingdatacanbeusedto helpdelineatetumors[29]. Therearetwo majordifficulties in multimodalim-agesegmentation,however. First, multimodal datais not always available. Second,whenthe datais available,they aretypically not in the samealignment,andthereforerequireregistration[111]. Recentmethodshave beenproposedfor simultaneouslyreg-isteringandsegmentingmultimodalimages[3]. Oncetheimageshave beenregistered,standardmulti-channelsegmentationtechniquescanbeapplied.Segmentationof mul-timodal imageswastargetedspecificallyin [131] usingneuralnetworks, and in [73],whichpresentedaBayesianframework for simultaneousrestorationandsegmentation.
5 Conclusion
Futureresearchin thesegmentationof medicalimageswill strive towardsimproving theaccuracy, precision,andcomputationalspeedof segmentationmethods,aswell asreduc-ing theamountof manualinteraction.Accuracy andprecisioncanbeimprovedby incor-poratingprior informationfrom atlasesandby combiningdiscreteandcontinuous-basedsegmentationmethods.For increasingcomputationalefficiency, multiscaleprocessing(cf. [51]) andparallelizablemethodssuchasneuralnetworks appearto be promisingapproaches.Computationalefficiency will be particularly importantin real-timepro-cessingapplications.
Possiblythe most importantquestionsurroundingthe useof imagesegmentationisits applicationin clinical settings. Computerizedsegmentationmethodshave alreadydemonstratedtheir utility in researchapplicationsandarenow garneringincreasedusefor computeraideddiagnosisandradiotherapy planning. It is unlikely that automated
ImageSegmentation 19
segmentationmethodswill ever replacephysiciansbut they will likely becomecrucialelementsof medicalimageanalysis.Segmentationmethodswill beparticularlyvaluablein areassuchascomputerintegratedsurgery, wherevisualizationof the anatomyis acritical component.
LiteratureCited
1. G.B.AboutanosandB.M. Dawant.Automaticbrainsegmentationandvalidation:image-basedversusatlas-baseddeformablemodels.In MedicalImaging, SPIEProc., volume3034,pages299–310,1997.
2. L.K. Arata,A.P. Dhawan,J.P. Broderick,M.F. Gaskil-Shipley, A.V. Levy, andNoraD. Volkow. Three-dimensionalanatomicalmodel-basedsegmentationof MR brainimagesthroughprincipalaxesregis-tration. IEEET. Biomed.Eng., 42:1069–1078,1995.
3. J.AshburnerandK. Friston.Multimodal imagecoregistrationandpartitioning–aunifiedframework.Neuroimage, 6:209–217,1997.
4. E.A. Ashton,M.J. Berg, K.J. Parker, J. Weisberg, C.W. Chen,andL. Ketonen. Segmentationandfeatureextractiontechniques,with applicationsto MRI headstudies.Mag. Res.Med., 33:670–677,1995.
5. M.S. Atkins andB.T. Mackiewich. Fully automaticsegmentationof thebrainin MRI. IEEET. Med.Imag., 17:98–109,1998.
6. N. Ayache,P. Cinquin,I. Cohen,L. Cohen,F. Leitner, andO.Monga.Segmentationof complex three-dimensionalmedicalobjects:a challengeanda requirementfor computer-assistedsurgeryplanningand performance. In R.H. Taylor, S. Lavallee, G.C. Burdea,and R. Mosges,editors,Computer-integratedsurgery: technology andclinical applications, pages59–74.MIT Press,1996.
7. K.T. Bae,M.L. Giger, C. Chen,andC.E. Kahn. Automaticsegmentationof liver structurein CTimages.Med.Phys., 20:71–78,1993.
8. E. Bardinet,L.D. Cohen,andN. Ayache. Trackingandmotion analysisof the left ventriclewithdeformablesuperquadrics.Med.Im. Anal., 1:129–149,1996.
9. E. Bardinet,L.D. Cohen,andN. Ayache.A parametricdeformablemodelto fit unstructured3D data.Comp.Vis. Im. Understand., 71:39–54,1998.
10. J.Besag.On thestatisticalanalysisof dirty pictures.CVGIP: Im. Understand., 57:359–372,1986.11. J.C.Bezdek,L.O. Hall, andL.P. Clarke. Review of MR imagesegmentationtechniquesusingpattern
recognition.Med.Phys., 20:1033–1048,1993.12. D.C. Bloomgarden,Z.A. Fayad,V.A. Ferrari,B. Chin,M.G.S.J.Sutton,andL. Axel. Globalcardiac
functionusingfastbreath-holdMRI: Validationof new acquisitionandanalysistechniques.MagneticResonancein Medicine, 37:683–692,1997.
13. M.E. Brandt,T.P. Bohan,L.A. Kramer, andJ.M. Fletcher. Estimationof CSF,whiteandgraymattervolumesin hydrocephalicchildren using fuzzy clusteringof MR images. ComputerizedMedicalImagingandGraphics, 18:25–34,1994.
14. B.H. Brinkmann,A. Manduca,andR.A. Robb. Optimizedhomomorphicunsharpmaskingfor MRgrayscaleinhomogeneitycorrection.IEEET. Med.Imag., 17:161–171,1998.
15. M.S.Brown, M.F. McNitt-Gray, N.J.Mankovich, J.G.Goldin,J.Hiller, etal. Methodfor segmentingchestCT imagedatausingananatomicalmodel: preliminaryresults. IEEE T. Med.Imag., 16:828–839,1997.
16. M.E. Brummer, R.M. Merseerau,R.L. Eisner, and R.R.J.Lewine. Automatic detectionof braincontoursin MRI datasets.IEEET. Med.Imag., 12:153–166,1993.
17. E. Bullmore, M. Brammer, G. Rouleau,B. Everitt, A. Simmons,et al. Computerizedbrain tissueclassificationof magneticresonanceimages:anew approachto theproblemof partialvolumeartifact.Neuroimage, 2:133–147,1995.
18. V. Caselles,F. Catte,T. Coll, andF. Dibos. A geometricmodel for active contours. NumerischeMathematik, 66:1–31,1993.
19. V. Caselles,R. Kimmel, andG. Sapiro. Geodesicactive contours. Int. J. Comp.Vision, 22:61–79,1997.
20. V. ChalanaandY. Kim. A methodologyfor evaluationof boundarydetectionalgorithmson medicalimages.IEEET. Med.Imag., 16:642–652,1997.
21. E.L. Chaney and S.M. Pizer. Defining anatomicalstructuresfrom medical images. Seminars inRadiationOncology, 2:215–225,1992.
22. C.H. ChenandG.G. Lee. On digital mammogramsegmentationand microcalcificationdetectionusingmultiresolutionwaveletanalysis.Graph.Mod.Im. Proc., 59:349–364,1997.
ImageSegmentation 20
23. H. Cheng,Y.M. Lui, andR.I. Freimanis.A novel approachto microcalcificationdetectionusingfuzzylogic technique.IEEET. Med.Imag., 17:442–450,1998.
24. H.S.Choi,D.R. Hanynor, andY. Kim. Partial volumetissueclassificationof multichannelmagneticresonanceimages—amixel model. IEEET. Med.Imag., 10:395–407,1991.
25. S.M. Choi,J.E.Lee,J.Kim, andM.H. Kim. Volumetricobjectionreconstructionusingthe3D-MRFmodel-basedsegmentation.IEEET. Med.Imag., 16:887–892,1997.
26. G.E.Christensen,S.C.Joshi,andM.I. Miller. Volumetrictransformationof brainanatomy. IEEE T.Med.Imag., 16:864–877,1997.
27. J.W. Clark. Neuralnetwork modelling.Phys.Med.Biol., 36:1259–1317,1991.28. M.C. Clark, L.O. Hall, D.B. Goldgof,L.P. Clarke andR.P. Velthuizen,andM.S. Silbiger. MRI seg-
mentationusingfuzzyclusteringtechniques.IEEEEng. Med.Biol., pages730–742,Nov/Dec1994.29. L.P. Clarke,R.P. Velthuizen,M.A. Camacho,J.J.Heine,M. Vaidyanathan,et al. MRI segmentation:
methodsandapplications.Mag. Res.Imag., 13:343–368,1995.30. L.P. Clarke,R.P. Velthuizen,S.Phuphanich,J.D.Schellenberg, J.A.Arrington,andM. Silbiger. MRI:
stabilityof threesupervisedsegmentationtechniques.Mag. Res.Imag., 11:95–106,1993.31. H.E. Cline, D.R. Thedens,P. Irarazaval, C.H. Meyer, B.S.Hu, D.G. Nishimura,andS. Ludke. 3-D
MR coronaryarterysegmentation.Mag. Res.Med., 40:697–702,1998.32. G. Cohen,N.C. Andreasen,R. Alliger, S. Arndt, J. Kuan, W.T.C. Yuh, and J. Er. Segmentation
techniquesfor theclassificationof brain tissueusingmagneticresonanceimaging. Psychiat.. Res.:Neuroimaging, 45:33–51,1992.
33. L.D. Cohen.Onactivecontourmodelsandballoons.CVGIP:ImageUnderstand., 53:211–218,1991.34. G.B.ColemanandH.C.Andrews. Imagesegmentationby clustering.Proc.IEEE, 5:773–785,1979.35. D.L. Collins,C.J.Holmes,T.M. Peters,andA.C. Evans.Automatic3-D model-basedneuroanatomi-
cal segmentation.HumanBrain Mapping, 3:190–208,1995.36. D.L. Collins,A.P. Zijdenbos,V. Kollokian,J.G.Sled,N.J.Kabani,et al. Designandconstructionof
a realisticdigital brainphantom.IEEET. Med.Imag., 17:463–468,1998.37. B.R.Condon,J.Patterson,etal. Imagenon-uniformityin magneticresonanceimaging:its magnitude
andmethodsfor its correction.TheBritish Journalof Radiology, 60:83–87,1989.38. G. Coppini,R. Poli, andG. Valli. Recovery of the3-D shapeof the left ventriclefrom echocardio-
graphicimages.IEEET. Med.Imag., 14:301–317,1995.39. C. Davatzikos. Spatialnormalizationof 3D imagesusingdeformablemodels.J. Comp.Assist.Tom.,
20:656–665,1996.40. C. DavatzikosandR.N.Bryan.Usingadeformablesurfacemodelto obtainashaperepresentationof
thecortex. IEEET. Med.Imag., 15:785–795,1996.41. C. Davatzikos,M. Vaillant,S. Resnick,J. L. Prince,S. Letovsky, andR. N. Bryan. A computerized
methodfor morphologicalanalysisof thecorpuscallosum.J. Comp.Assist.Tom., 20:88–97,1996.42. J.W. Davenport,J.C.Bezdek,andR.J.Hathaway. Parameterestimationfor finitemixturedistributions.
Comput.Math.Applic., 15:810–828,1988.43. B.M. Dawant,A.P. Zijidenbos,andR.A. Margolin. Correctionof intensityvariationsin MR images
for computer-aidedtissueclassification.IEEET. Med.Imag., 12:770–781,1993.44. R. Deklerck,J. Cornelis,andM. Bister. Segmentationof medicalimages.Im. Vis. Comp., 11:486–
503,1993.45. J.M.B. DiasandJ.M.N. Leitao. Wall positionandthicknessestimationfrom sequencesof echocar-
diographicimages.IEEET. Med.Imag., 15:25–38,1996.46. J.C.Dunn. A fuzzy relative of theISODATA processandits usein detectingcompactwell-sparated
clusters.Journalof Cybernetics, 3:32–57,1973.47. N. Ezquerra,S.Capell,L. Klein, andP. Duijves.Model-guidedlabelingof coronarystructure.IEEE
T. Med.Imag., 17:429–441,1998.48. M.A.T. FigueiredoandJ.M.N.Leitao.A nonsmoothingapproachto theestimationof vesselcontours
in angiograms.IEEET. Med.Imag., 14:162–172,1995.49. E.K. Fishman,B.S.Kuszyk,D.G.Heath,L.M. Gao,andB. Cabral.Surgicalplanningfor liver resec-
tion. Computer, 29:64–73,1996.50. L.M. Fletcher, J.B.Barsotti,andJ.P. Hornak.A multispectralanalysisof braintissues.Magn.Reson.
Med., 29:623–630,1993.51. C.H. Fosgate,H. Krim, W.W. Irving, W.C. Karl, and A.S. Willsky. Multiscalesegmentationand
anomalyenhancementof SARimagery. IEEET. ImageProcess., 6:7–20,1997.52. Y. Ge,J.M. Fitzpatrick,B.M. Dawant,J.Bao,R.M. Kessler, andR. Margolin. Accuratelocalization
of corticalconvolutionsin MR brainimages.IEEET. Med.Imag., 15:418–428,1996.53. E. Gelenbe,Y. Feng,andK.R.R. Krishnan. Neuralnetwork methodsfor volumetricmagneticreso-
ImageSegmentation 21
nanceimagingof thehumanbrain. Proc.IEEE, 84:1488–1496,1996.54. S. GemanandD. Geman. Stochasticrelaxation,Gibbsdistrutions,andthe Bayesianrestorationof
images.IEEET. Patt. Anal.Mach. Intel., PAMI-6:721–741,1984.55. G. Gerig, J. Martin, R. Kikinis, O. Kubler, M. Shenton,andF.A. Jolesz. Unsupervisedtissuetype
segmentationof 3D dual-echoMR headdata.Im. Vis. Comp., 29:100–132,1985.56. A. Ghanei,H. Soltanian-Zadeh,andJ.P. Windham.A 3D deformablesurfacemodelfor segmentation
of objectsfrom volumetricdatain medicalimages.Computers in BiologyandMedicine, 28:239–253,1998.
57. P. Gibbs,D.L. Buckley, S.J.Blackband,andA. Horsman.Tumourvolumedetectionfrom MR imagesby morphologicalsegmentation.Phys.Med.Biol., 41:2437–2446,1996.
58. A.F. Goldszal,C. Davatzikos, D.L. Pham,M.X.H. Yan,R.N. Bryan,andS.M. Resnick. An imageprocessingsystemfor qualitative andquantitative volumetricanalysisof brain images. Journal ofComputerAssistedTomography, 22:827–837,1998.
59. R.C.GonzalezandR.E.Woods.Digital Image Processing. Addison-Wesley, 1992.60. C.L. Gordon,C.E.Webber, J.D.Adachi,andN. Christoforou.In vivo assessmentof trabecularbone
structureat the distal radiusfrom high-resolutioncomputedtomographyimages.Phys.Med.Biol.,41:495–508,1996.
61. W.E.L.Grimson,G.J.Ettinger, T. Kapur, M.E. Leventon,W.M. Wells,etal. Utilizing segmentedMRIdatain image-guidedsurgery. Int. J. Patt. Rec.Art. Intel., 11:1367–1397,1997.
62. R. GuillemaudandM. Brady. Estimatingthebiasfield of MR images.IEEET. Med.Imag., 16:238–251,1997.
63. R.GuptaandP.E.Undrill. Theuseof textureanalysisto delineatesuspiciousmassesin mammograhy.Phys.Med.Biol., 40:835–855,1995.
64. L.O. Hall, A.M. Bensaid,L.P. Clarke,R.P. Velthuizen,M.S.Silbiger, andJ.C.Bezdek.A comparisonof neuralnetwork andfuzzy clusteringtechniquesin segmentingmagneticresonanceimagesof thebrain. IEEET. Neural Networks, 3:672–682,1992.
65. P. Hall, M. Ngan, and P. Andreae. Reconstructionof vascularnetworks using three-dimensionalmodels.IEEET. Med.Imag., 16:919–929,1997.
66. R.M. Haralick andL.G. Shapiro. Imagesegmentationtechniques.Comput.Vis. Graph. Im. Proc.,29:100–132,1985.
67. G.J.Harris,P.E. Barta,L.W. Peng,et al. MR volumesegmentationof graymatterandwhite matterusingmanualthresholding:dependenceonimagebrightness.Am.J. Neuroradiol., 15:225–230,1994.
68. S.Haykin. Neural networks:a comprehensivefoundation. MacmillanCollege,New York, 1994.69. T.J. Hebert. Fast iterative segmentationof high resolutionmedical images. IEEE T. Nucl. Sci.,
44:1363–1367,1997.70. K. Held, E.R.Kops,B.J.Krause,W.M. Wells, R. Kikinis, et al. Markov randomfield segmentation
of brainMR images.IEEET. Med.Imag., 16(6),1997.71. R.C. Herndon,J.L. Lancaster, A.W. Toga,and P.T. Fox. Quantificationof white matterandgray
mattervolumesfrom T1 parametricimagesusingfuzzy classifiers.J. Mag. Res.Imag., 6:425–435,1996.
72. K.H. HohneandW.A. Hanson.Interactive3-D segmentationof MRI andCT volumesusingmorpho-logicaloperations.J. Comp.Assist.Tom., 16:285–294,1992.
73. M.A. Hurn, K.V. Mardia,T.J.Hainsworth, J. Kirkbride, andE. Berry. Bayesianfusedclassificationof medicalimages.IEEET. Med.Imag., 15:850–858,1996.
74. N. Ibrahim,H. Fujita,T. Hara,andT. Endo.Automateddetectionof clusteredmicrocalcificationsonmammograms:CAD systemapplicationto MIAS database.Phys.Med.Biol., 42:2577–2589,1997.
75. A.K. JainandR.C.Dubes.Algorithmsfor clusteringdata. PrenticeHall, 1988.76. B. Johnston,M.S. Atkins, B. Mackiewich, andM. Anderson. Segmentationof multiple sclerosis
lesionsin intensitycorrectedmultispectralMRI. IEEET. Med.Imag., 15:154–169,1996.77. M. Joliot andB.M. Mazoyer. Three-dimensionalsegmentationandinterpolationof magneticreso-
nancebrainimages.IEEET. Med.Imag., 12:269–277,1993.78. T.N. JonesandD.N. Metaxas.Segmentationusingdeformablemodelswith affinity-basedlocaliza-
tion. LectureNotesin ComputerScience, 1205:53–52,1997.79. S.C.Joshi,M.I. Miller, andU. Grenander. On thegeometryandshapeof brainsub-manifolds.Int. J.
Patt. Rec.Art. Intel., 11:1317–1343,1997.80. V. Juhan,B. Nazarian,K. Malkani,R. Bulot, J.M.Bartoli, andJ.Sequeira.Geometricalmodellingof
abdominalaorticaneurysms.Lecture Notesin ComputerScience, 1205:243–242,1997.81. Y.M. Kadah,A.A. Farag,J.M. Zurada,A.M. Badawi, andA.M. Youssef.Classificationalgorithms
for quantitative tissuecharacterizationof diffuseliverdiseasefrom ultrasoundimages.IEEET. Med.
ImageSegmentation 22
Imag., 15:466–478,1996.82. M. Kallergi, K. Woods,L.P. Clarke, W. Qian,andR.A. Clark. Imagesegmentationin digital mam-
mography: comparisonof local thresholdingand region growing algorithms. Comput.Med. Im.Graph., 16:323–331,1992.
83. M. Kamber, R.Shinghal,D.L. Collins,G.S.Francis,andA.C. Evans.Model-based3-D segmentationof multiple sclerosislesionsin magneticresonancebrain images.IEEE T. Med.Imag., 14:442–453,1995.
84. T. Kapur, E. Grimson,W. Wells, andR. Kikinis. Segmentationof brain tissuefrom magneticreso-nanceimages.Med.Im. Anal., 1:109–127,1996.
85. T. Kapur, W.E.L. Grimson,R. Kikinis, andW.M. Wells. Enhancedspatialpriors for segmentationof magneticresonanceimagery. In Proc. 1st Int. Conf. Med. Im. Comput.Comp.Assist.Interven.(MICCAI98), pages457–468,1998.
86. N. Karssemeijer. Automatedclassificationof parenchymalpatternsin mammograms.Phys.Med.Biol., 43:365–389,1998.
87. M. Kass,A. Witkin, andD. Terzopoulos. Snakes: Active contourmodels. Int. J. Comp.Vision,1:321–331,1988.
88. J.Kaufhold,M. Schneider, A.S. Willsky, andW.C.Karl. A statisticalmethodfor efficient segmenta-tion of MR imagery. Int. J. Patt. Rec.Art. Intel., 11:1213–1231,1997.
89. N. Khaneja,M.I. Miller, andU. Grenander. Dynamicprogramminggenerationof curveson brainsurfaces.IEEET. Patt. Anal.Mach. Intel., 20:1260–1265,1998.
90. V.S.Khoo, D.P. Dearnaley, D.J.Finnigan,A. Padhani,S.F. Tanner, andM.O. Leach. Magneticres-onanceimaging(MRI): considerationsandapplicationsin radiotheraphytreatmentplanning.Radio-ther. Oncol., 42:1–15,1997.
91. M.I. Kohn,N.K. Tanna,G.T. Herman,S.M. Resnick,et al. Analysisof brainandcerebrospinalfluidvolumeswith MR imaging.Radiology, 178:115–122,1991.
92. A. Koivula, J. Alakuijala, and O. Tervonen. Image featurebasedautomaticcorrectionof low-frequency spatialintensityvariationsin MR images.Mag. Res.Imag., 15:1167–1175,1997.
93. D. KuceraandR.W. Martin. Segmentationof sequencesof echocardiographicimagesusingasimpli-fied 3D active contourmodelwith region basedexternalforces.Comput.Med.Im. Graph., 21:1–21,1997.
94. M.A. Kupinski andM.L. Giger. Automatedseededlesionsegmentationon digital mammograms.IEEET. Med.Imag., 17:510–517,1998.
95. D.H. Laidlaw, K.W. Fleischer, and A.H. Barr. Partial-volume bayesianclassificationof materialmixturesin MR volumedatausingvoxel histograms.IEEET. Med.Imag., 17:98–107,1998.
96. J.L. Lancaster, L.H. Rainey, J.L.Summerlin,C.S.Freitas,P.T. Fox, A.C. Evans,A.W. Toga,andJ.C.Mazziotta. Automatedlabelingof the humanbrain: A preliminaryreporton the developmentandevaluationof a forward-transformmethod.HumanBrain Mapping, 5:238–242,1997.
97. D.A. Langan,J.W. Modestino,andJ. Zhang. Clustervalidationfor unsupervisedstochasticmodel-basedimagesegmentation.IEEET. Im. Process., 7:180–195,1998.
98. S.M. Larie andS.S.Abukmeil. Brain abnormalityin schizophrenia:a systematicandquantitativereview of volumetricmagneticresonanceimagingstudies.J. Psych., 172:110–120,1998.
99. C. Lee,S.Hun,T.A. Ketter, andM. Unser. Unsupervisedconnectivity-basedthresholdingsegmenta-tion of midsaggitalbrainMR images.Comput.Biol. Med., 28:309–338,1998.
100. S.K. LeeandM.W. Vannier. Post-acquisitioncorrectionof MR inhomogeneities.Mag. Res.Med.,36:276–286,1996.
101. F. Lefebvre, G.Berger, andP. Laugier. Automaticdetectionof the boundaryof the calcaneusfromultrasoundparametricimagesusing an active contourmodel: clinical assessment.IEEE T. Med.Imag., 17:45–52,1998.
102. TianhuLei andWilfred Sewchand.Statisticalapproachto X-Ray CT imagingandits applicationsinimageanalysis– partII: A new stochasticmodel-basedimagesegmentationtechniquefor X-RayCTimage.IEEET. Med.Imag., 11(1):62–69,1992.
103. H. Li, R. Deklerck,B. De Cuyper, A. Hermanus,E. Nyssen,andJ. Cornelis. Object recognitionin brainCT-scans:knowledge-basedfusionof datafrom multiple featureextractors. IEEE T. Med.Imag., 14:212–229,1995.
104. H.D. Li, M. Kallergi, L.P. Clarke,V.K. Jain,andR.A. Clark.Markov randomfield for tumordetectionin digital mammagraphy. IEEET. Med.Imag., 14:565–576,1995.
105. S.Z.Li. Markov randomfieldmodelingin computervision. Springer, 1995.106. Z. Liang. Tissueclassificationandsegmentationof MR images.IEEEEng. Med.Biol., pages81–85,
1993.
ImageSegmentation 23
107. Z. Liang, J.R. MacFall, and D.P. Harrington. Parameterestimationand tissuesegmentationfrommultispectralMR images.IEEET. Med.Imag., 13:441–449,1994.
108. K.O. Lim andA. Pfefferbaum.Segmentationof MR brainimagesinto cerebrospinalfluid andwhiteandgraymatter. J. Comp.Assist.Tom., 13:588–593,1989.
109. Q.Long,X.Y. Xu, M.W. Collins,M. Bourne,andT.M. Griffith. Magneticresonanceimageprocessingandstructuredgrid generationof a humanabdominalbifurcation.ComputerMethodsandProgramsin Biomedicine, 56:249–259,1998.
110. A. Macovski. Medicalimagingsystems. Prentice-Hall,1983.111. J.B.A.Maintz andM.A. Viergever. A survey of medicalimageregistration.Med.Im. Anal., 2:1–36,
1998.112. R. Malladi, J.A. Sethian,and B.C. Vemuri. Shapemodelingwith front propagation:A level set
approach.IEEET. Patt. Anal.Mach. Intel., 17:158–175,1995.113. R. Malladi, J.A.Sethian,andB.C.Vemuri.A fastlevel setbasedalgorithmfor topology-independent
shapemodeling.Journalof MathematicalImagingandVision, 6:269–289,1996.114. J.F. Mangin,V. Frouin,I. Bloch,J.Regis,andJ.Lopez-Krahe.From3D magneticresonanceimages
to structuralrepresentationsof the cortex topographyusing topology preservingdeformations. J.Math.Imag. Vis., 5:297–318,1995.
115. I.N. Manousakas,P.E. Undrill, G.G. Cameron,and T.W. Redpath. Split-and-merge segmentationof magneticresonancemedicalimages:performanceevaluationandextensionto threedimensions.Comput.Biomed.Res., 31:393–412,1998.
116. M.J.McAulif fe,D. Eberly, D.S.Fritsch,E.L. Chaney, andS.M.Pizer. Scale-spaceboundaryevolutioninitializedby cores.Lecture Notesin ComputerScience, 1131:173–172,1996.
117. T. McInerney andD. Terzopoulos.A dynamicfinite elementsurfacemodel for segmentationandtrackingin multidimensionalmedicalimageswith applicationto cardiac4D imageanalysis.Comput.Med.Im. Graph., 19:69–83,1995.
118. T. McInerney andD. Terzopoulos.Topologicallyadaptablesnakes. In Proc. Fifth Int. Conf. Comp.Vis., pages840–845,1995.
119. T. McInerney andD. Terzopoulos.Deformablemodelsin medicalimageanalysis:asurvey. Med.Im.Anal., 1:91–108,1996.
120. T. McInerney andD. Terzopoulos.Medical imagesegmentationusingtopologicallyadaptablesur-faces.LectureNotesin ComputerScience, 1205:23–22,1997.
121. M.F. McNitt-Gray, H.K. Huang,andJ.W. Sayre.Featureselectionin thepatternclassificationproblemof digital chestradiographsegmentation.IEEET. Med.Imag., 14:537–547,1995.
122. W. Menhardtand K. Schmidt. Computervision on magneticresonanceimages. Patt. Rec.Let.,8:73–85,1988.
123. C.R.Meyer, H.B. Peyton,andJ.Pipe.Retrospectivecorrectionof intensityinhomogeneitiesin MRI.IEEET. Med.Imag., 14:36–41,1995.
124. I. Mikic, S.Krucinski,andJ.D.Thomas.Segmentationandtrackingin echocardiographicsequences:activecontoursguidedby opticalflow estimates.IEEET. Med.Imag., 17:274–284,1998.
125. A. Mojsilovic, M.V. Popovic, A.N. Neskovic, and A.D. Popovicq. Wavelet imageextensionforanalysisandclassifcationof infarctedmyocardialtissue.IEEET. Biomed.Eng., 44:856–866,1997.
126. R. Momenan,D. Hommer, R.Rawlings,U. Rutimann,M. Kerich,andD. Rio. Intensity-adaptiveseg-mentationof single-echoT1-weightedmagneticresonanceimages.HumanBrain Mapping, 5:194–205,1997.
127. J. MontagnatandH. Delingette. Volumetricmedicalimagessegmentationusingshapeconstraineddeformablemodels.LectureNotesin ComputerScience, 1205:13–12,1997.
128. H.W. Muller-Gartner, J.M.Links,etal. Measurementof radiotracerconcentrationin braingraymatterusingpositronemissiontomography:MRI-basedcorrectionfor partialvolumeeffects.J. Cereb. BloodFlow Metab., 12:571–583,1992.
129. A. NeumannandC. Lorenz.Statisticalshapemodelbasedsegmentationof medicalimages.Comput.Med.Im. Graph., 22:133–143,1998.
130. L. NoceraandJ.C.Gee. Robustpartialvolumetissueclassificationof cerebralMRI scans.In Proc.of theSPIEMedicalImaging ’97: Image Processing, pages550–560,1997.
131. M. Ozkan,B.M. Dawant, and R.J. Micunas. Neural-network basedsegmentationof multi-modalmedicalimages:acomparative andprospective study. IEEET. Med.Imag., 12:534–544,1993.
132. N.R.Pal andS.K.Pal. A review on imagesegmentationtechniques.Patt. Rec., 26:1277–1294,1993.133. T.N. Pappas. An adaptive clusteringalgorithmfor imagesegmentation. IEEE T. SignalProcess.,
40:901–914,1992.134. J.M. Pardo,D.Cabello,andJ.Heras.A snake for model-basedsegmentationof biomedicalimages.
ImageSegmentation 24
Patt. Rec.Let., 18:1529–1538,1997.135. J.M. Pardo-Lopez,D. Cabello,J. Heras,andJ. Couceiro. A Markov randomfield modelfor bony
tissueclassification.Comput.Med.Im. Graph., 22:169–178,1998.136. W. Park, E.A. Hoffman, andM. Sonka. Segmentationof intrathoracicairway trees: a fuzzy logic
approach.IEEET. Med.Imag., 17:489–497,1998.137. S.D. Pathak,P.D. Grimm, V. Chalana,andY. Kim. Pubicarchdetectionin transrectalultrasound
guidedprostatecancertherapy. IEEET. Med.Imag., 17:762–771,1998.138. S.D. Pathak,V.Chalana,andY.M. Kim. Interactive automaticfetal headmeasurementsfrom ultra-
soundimagesusingmultimediacomputertechnology. Ultrasoundin MedicineandBiology, 23:665–673,1997.
139. T.M. Peters,D.L Collins,andA.C. Evans.Imagesegmentationand3-D applications.In ThePhysicsof MRI: 1992AAPMSummerSchoolProceedings, pages607–646,1993.
140. D.L. PhamandJ.L. Prince. An adaptive fuzzy c-meansalgorithmfor imagesegmentationin thepresenceof intensityinhomogeneities.Patt. Rec.Let., pages57–68,1999.
141. D.L. Pham,J.L. Prince,A.P. Dagher, andC. Xu. An automatedtechniquefor statisticalcharacteri-zationof braintissuesin magneticresonanceimaging. Int. J. Patt. Rec.Art. Intel., 11(8):1189–1211,1997.
142. H.H. Pien, M. Desai,and J. Shah. Segmentationof MR imagesusing curve evolution and priorinformation. Int. J. Patt. Rec.Art. Intel., 11:1233–1245,1997.
143. S.Pohlman,K.A. Powell, N.A. Obuchowski, W.A. Chilcote,andS.Grundfest-Broniatowski. Quan-titativeclassificationof breasttumoresin digitzedmamograms.Med.Phys., 23:1337–1345,1996.
144. W.E. Polakowski, D.A. Cournoyer, SK. Rogers,M.P. DeSimio,D.W. Ruck, J.W. Hoffmeister, andR.A. Raines. Computer-aidedbreastcancerdetectionanddaignosisof massesusingdifferenceofGaussiansandderivative-basedfeaturesaliency. IEEET. Med.Imag., 16:811–819,1997.
145. C.S.PoonandM. Braun. Imagesegmentationby a deformablecontourmodelincorporatingregionanalysis.Physicsin MedicineandBiology, 42:1833–1841,1997.
146. C.E.Priebe,D.J.Marchette,andG.W. Rogers.Segmentationof randomfieldsvia borrowedstrengthdensityestimation.IEEET. Patt. Anal.Mach. Intel., 19:494–499,1997.
147. J.L.Prince,Q. Tan,andD. Pham.Optimizationof MR pulsesequencesfor Bayesianimagesegmen-tation. Med.Phys., 22:1651–1656,1995.
148. J. Rademacher, A.M Galaburda,D.N. Kennedy, P.A. Filipek, andV.S. Caviness. Humancerebralcortex: localization,parcellationandmorphometrywith magneticresonanceimaging.J. Cog. Neuro.,4:352–374,1992.
149. J.C.Rajapakse,J.N.Giedd,andJ.L.Rapoport.Statisticalapproachto segmentationof single-channelcerebralMR images.IEEET. Med.Imag., 16:176–186,1997.
150. J.C.RajapakseandF. Kruggel. Segmentationof MR imageswith intensityinhomogeneities.Im. Vis.Comp., 16:165–180,1998.
151. N.C. AndreasenR. Rajarethinam,T. Cizadlo, et al. Automatic atlas-basedvolume estimationofhumanbrainregionsfrom MR images.J. Comp.Assist.Tom., 20:98–106,1996.
152. W.E. Reddick,J.O.Glass,E.N. Cook, T.D. Elkin, andR.J.Deaton. Automatedsegmentationandclassificationof multispectralmagneticresonanceimagesof brain usingartificail neuralnetworks.IEEET. Med.Imag., 16:911–918,1997.
153. T.R. ReedandJ.M. HansDu Buf. A review of recenttexture segmentationandfeatureextractiontecniques.CVGIP: Im. Understand., 57:359–372,1993.
154. A.L. Reiss,J.G.Hennessey, M. Rubin,L. Beach,M.T. Abrams,et al. Reliability andvalidity of analgorithmfor fuzzy tissuesegmentationof MRI. J. Comp.Assist.Tom., 22:471–479,1998.
155. P.K. Sahoo,S.Soltani,andA.K.C. Wong. A survey of thresholdingtechniques.Comput.Vis. Graph.Im. Proc., 41:233–260,1988.
156. S.SandorandR. Leahy. Surface-basedlabelingof corticalanatomyusinga deformableatlas. IEEET. Med.Imag., 16:41–54,1997.
157. P. SantagoandH.D. Gage.Quantificationof MR brainimagesby mixturedensityandpartialvolumemodeling.IEEET. Med.Imag., 12:566–574,1993.
158. P. Santagoand H.D. Gage. Statisticalmodelsof partial volume effect. IEEE T. Image Process.,4:1531–1540,1995.
159. R.J.Schalkoff. Pattern recognition: statistical,structural and neural approaches. JohnWiley andSons,1992.
160. A. Sebbahi,A. Herment,A. deCesare,andE. Mousseaux.Multimodality cardiovascularimageseg-mentationusingadeformablecontourmodel.Comput.Med.Im. Graph., 21:79–89,1997.
161. J. Sijbers,P. Scheunders,M. Verhoye, A. Van Der Linden, D. Van Dyck, et al. Watershed-based
ImageSegmentation 25
segmentationof 3D MR datafor volumequantization.Mag. Res.Imag., 15:679–688,1997.162. A. Simmons,P.S.Tofts, G.J.Barker, andS.R.Arridge. Sourcesof intensitynonuniformityin spin
echoimagesat 1.5T. Mag. Res.Med., 32:121–128,1994.163. H.R. SingletonandG.M. Pohost.AutomaticcardiacMR imagesegmentationusingedgedetection
by tissueclassificationin pixel neighborhoods.Mag. Res.Med., 37:418–424,1997.164. J.G.SledandG.B.Pike. Standing-wave andRF penetrationartifactscausedby elliptic geometry:an
electrodynamicanalysisof MRI. IEEET. Med.Imag., 17:653–662,1998.165. J.G. Sled,A.P. Zijdenbos,and A.C. Evans. A nonparametricmethodfor automaticcorrectionof
intensitynonuniformityin MRI data.IEEET. Med.Imag., 17:87–97,1998.166. H. Soltanian-Zadeh,J.P. Windham,andD.J. Peck. Optimal linear transformationfor MRI feature
extraction. IEEET. Med.Imag., 15:749–767,1996.167. M. Sonka,W. Park,andE.A. Hoffman. Rule-baseddetectionof intrathoracicairway trees. IEEE T.
Med.Imag., 15:314–326,1996.168. M. Sonka,M.D. Winniford, andS.M. Collins. Robustsimultaneousdetectionof coronarybordersin
complex images.IEEET. Med.Imag., 14:151–161,1995.169. M. Sonka,X. Zhang,M. Siebes,M.S. Bissing,S.C.DeJong,S.M Collins, andC.R. McKay. Seg-
mentationof intravascularultrasoundimages:a knowledge-basedapproach. IEEE T. Med. Imag.,14:719–732,1995.
170. P. Sprawls. Physicalprinciplesof medicalimaging. AspenPublishers,1993.171. R.N.StricklandandH.I. Hahn.Wavelettransformsfor detectingmicrocalcifcationsin mammograms.
IEEET. Med.Imag., 15:218–229,1996.172. P. Suetens,E. Bellon,D. Vandermeulen,M. Smet,G. Marchal,J.Nuyts,andL. Mortelmans.Image
segmentation:methodsand applicationsin diagnosticradiologyand nuclearmedicine. Eur. J. ofRadiology, 17:14–21,1993.
173. G. Szekely, A. Kelemen,C. Brechbuhler, andG. Gerig. Segmentationof 2-D and3-D objectsfromMRI volumedatausingconstrainedelasticdeformationsof flexible Fouriercontourandsurfacemod-els. Med.Im. Anal., 1:19–34,1996.
174. Y.C. Tai, K.P. Lin, M. Dahlbom,andE.J.Hoffman. A hybrid attenuationcorrectiontechniquetocompensatefor lung densityin 3-D total bodyPET. IEEE Trans.on NuclearScience, 43:323–330,1996.
175. J. TalairachandP. Tournoux.Co-PlanarStereotaxicAtlasof theHumanBrain. 3-DimensionalPro-portionalSystem:AnApproach to Cerebral Imaging. ThiemeMedicalPublisher, Inc.,Stuttgart,NY,1988.
176. P. Taylor. Invited review: computeraidsfor decision-makingin diagnosticradiology—a literaturereview. Brit. J. Radiol.., 68:945–957,1995.
177. H. Tek andB.B. Kimia. Volumetricsegmentationof medicalimagesby three-dimensionalbubbles.Comp.Vis. Im. Understand., 65:246–258,1997.
178. P.C.Teo,G. Sapiro,andB.A. Wandell.Creatingconnectedrepresentationsof corticalgraymatterforfunctionalMRI visualization.IEEET. Med.Imag., 16:852–863,1997.
179. Y. ZimmerandR. TepperandS. Akselrod. A two-dimensionalextensionof minimumcrossentropythresholdingfor thesegmentationof ultrasoundimages.UltrasoundMed.Biol., 22:1183–1190,1996.
180. D. TerzopoulosandR. Szeliski. Trackingwith Kalmansnakes. In A. Blake andA. Yuille, editors,ActiveVision, Artificial Intelligence,pages3–20.TheMIT Press,Cambridge,Massachusetts,1992.
181. P. ThompsonandA.W. Toga.Detection,visualizationandanimationof abnormalanatomicstructurewith aprobabilisticbrainatlasbasedon randomvectorfield transformations.Med.Im. Anal., 1:271–294,1997.
182. C. Tsai, B.S. Manjunath,andR. Jagadeesan.Automatedsegmentationof brain MR images. Patt.Rec., 28:1825–1837,1995.
183. J.K. UdupaandS.Samarasekera.Fuzzyconnectednessandobjectdefinition:Theory, algorithmsandapplicationsin imagesegmentation.Graph.Mod. Im. Proc., 58(3):246–261,1996.
184. J.K.UdupaandG.T. Herman,editors.3-D Imaging in Medicine. CRCPress,1991.185. J.K. Udupa,L. Wei, S. Samarasekera, Y. Miki, M.A. van Buchem,and R.I. Grossman.Multiple
sclerosislesionquantificationusingfuzzy-connectednessprinciples. IEEE T. Med. Imag., 16:598–609,1997.
186. M. Vaidyanathan,L.P. Clarke, L.O. Hall, C. Heidtman,R. Velthuizen,et al. Monitoring braintumorresponseto therapy usingMRI segmentation.Mag. Res.Imag., 15:323–334,1997.
187. M. Vaidyanathan,L.P. Clarke, R.P. Velthuizen,S. Phuphanich,A.M. Bensaid,et al. ComparisonofsupervisedMRI segmentationmethodsfor tumor volumedeterminationduring therapy. Mag. Res.Imag., 13:719–728,1995.
ImageSegmentation 26
188. D. Vandermeulen,R.Verbeeck,L. Berben,D. Delaere,P. Suetens,andG. Marchal.Continuousvoxelclassificationby stochasticrelaxation:theoryandapplicationto MR imagingandMR angiography.Im. Vis. Comp., 12:559–572,1994.
189. M.W. Vannier, R.L. Butterfield,et al. Multispectralanalysisof magneticresonanceimages.Radiol-ogy, 154:221–224,1985.
190. B.C.Vemuri,Y. Guo,C.M. Leonard,andS.Lai. Fastnumericalalgorithmsfor fitting multiresolutionhybridshapemodelsto brainMRI. Med.Im. Anal., 1:343–362,1997.
191. D.L. Vilarino,V.M. Brea,D. Cabello,andJ.M.Pardo.Discrete-timeCNN for imagesegmentationbyactivecontours.Patt. Rec.Let., 19:721–734,1998.
192. L. VincentandP. Soille. Watershedsin digital spaces:an efficient algorithmbasedon immersionsimulation.IEEET. Patt. Anal.Mach. Intel., 13:583–598,1991.
193. N.F. Vittitoe, R. Vargas-Voracek,andC.E.Floyd. Identificationof lung regionsin chestradiographsusingMarkov randomfield modeling.Med.Phys., 25:976–985,1998.
194. Y. Wang,T. Adah,andS.KungadZ. Szabo.Quantificationandsegmentationof braintissuesfromMR images:aprobabilisticneuralnetwork approach.IEEET. Im. Process., 7:1165–1181,1998.
195. Y. WangandL.H. Staib. Boundaryfinding with correspondenceusingstatisticalshapemodels. InProc. IEEEConf. Comp.Vis. Patt. Rec., pages338–345,1998.
196. S. Warfield,J. Dengler, J. Zaers,C.R.G.Guttmann,W.M. Wells, et al. Automaticidentificationofgrey matterstructuresfrom MRI to improve the segmentationof white matterlesions. Journal ofImage GuidedSurgery, 1(6):326–338,1995.
197. W.M. Wells,W.E.L. Grimson,R. Kikins, andF.A. Jolesz.Adaptivesegmentationof MRI data.IEEET. Med.Imag., 15:429–442,1996.
198. A.J. Worth, N. Makris, V.S. Caviness,andD.N. Kennedy. Neuroanatomicalsegmentationin MRI:technologicalobjectives. Int. J. Patt. Rec.Art. Intel., 11:1161–1187,1997.
199. P. Wust,J.Gellermann,J.Beier, S.Wegner, W. Tilly , etal. Evaluationof segmentationalgorithmsforgenerationof patientmodelsin radiofrequency hyperthermia.Phys.Med.Biol., 43:3295–3307,1998.
200. C. Xu, D.L. Pham,J.L. Prince,M.E. Etemad,andD. Yu. Reconstructionof thecentrallayerof thehumancerebralcortex from MR images. In Proc. 1st Int. Conf. Med. Im. Comput.Comp.Assist.Intervent., pages482–488,1998.
201. C. Xu andJ.L. Prince. Snakes,shapes,andgradientvectorflow. IEEE T. Im. Process., 7:359–369,1998.
202. M.X.H. YanandJ.S.Karp. An adaptive Bayesianapproachto three-dimensionalMR brainsegmen-tation. In Proc. of XIVth InternationalConferenceon InformationProcessingin Medical Imaging,pages201–213,1995.
203. A. Yezzi,S.Kichenassamy, A. Kumar, P. Olver, andA. Tannenbaum.A geometricsnake modelforsegmentationof medicalimagery. IEEET. Med.Imag., 16:199–209,1997.
204. Z. Yue,A. Goshtasby, andL.V. Ackerman.Automaticdetectionof rib bordersin chestradiographs.IEEET. Med.Imag., 14:525–536,1995.
205. L.A. Zadeh.Fuzzysets.InformationandControl, 8:338–353,1965.206. Y.J.Zhang.A survey on evaluationmethodsfor imagesegmentation.Patt. Rec.Let., 29:1335–1346,
1996.207. Y. Zhu andH. Yan. Computerizedtumorboundarydetectionusinga hopfieldneuralnetwork. IEEE
T. Med.Imag., 16:55–67,1997.208. A.P. ZijdenbosandB.M. Dawant. Brain segmentationandwhite matterlesiondetectionin MR im-
ages.Critical Reviewsin BiomedicalEngineering, 22:401–465,1994.
Recommended