Content-based image retrieval color and edges

整理文档很辛苦,赏杯茶钱您下走!

免费阅读已结束,点击下载阅读编辑剩下 ...

阅读已结束,您可以下载文档离线阅读编辑

资源描述

Content-basedImageRetrieval:ColorandEdgesRobertS.GrayDepartmentofComputerScienceDartmouthCollegeHanover,NH03755E-mail:robert.s.gray@dartmouth.eduAbstractOneofthetoolsthatwillbeessentialforfutureelectronicpublishingisapowerfulimageretrievalsystem.Theauthorshouldbeabletosearchanimagedatabaseforimagesthatconveythedesiredinformationormood;areadershouldbeabletosearchacorpusofpublishedworkforimagesthatarerelevanttohisorherneeds.Mostcommercialimageretrievalsystemsassociatekeywordsortextwitheachimageandrequiretheusertoenterakeywordortextualdescriptionofthedesiredimage.Thistext-basedapproachhasnumerousdrawbacks{associatingkeywordsortextwitheachimageisatedioustask;someimagefeaturesmaynotbementionedinthetextualdescription;somefeaturesare\nearlyimpossibletodescribewithtext;andsomefeaturescanbedescribedinwidelydierentways[Na93a].Inaneorttoovercometheseproblemsandimproveretrievalperformance,researchershavefocusedmoreandmoreoncontent-basedimageretrievalinwhichretrievalisaccomplishedbycomparingimagefeaturesdirectlyratherthantextualdescriptionsoftheimagefeatures.Featuresthatarecommonlyusedincontent-basedretrievalincludecolor,shape,textureandedges.Inthispaperwedescribeasimplecontent-basedsystemthatretrievescolorimagesonthebasisoftheircolordistributionsandedgecharacteristics.Thesystemusestworetrievaltechniquesthathavebeendescribedintheliterature{i.e.histogramintersectiontocomparecolordistributionsandsketchcomparisontocompareedgecharacteristics.Theperformanceofthesystemisevaluatedandvariousextensionstotheexistingtechniquesareproposed.1IntroductionOneofthetoolsthatwillbeessentialforfutureelectronicpublishingisapowerfulimageretrievalsystem.Theauthorshouldbeabletosearchanimagedatabaseforimagesthatconveythedesiredinformationormood;thereadershouldbeabletosearchacorpusofpublishedworkforimagesthatarerelevanttohisorherneeds.Mostcommercialimageretrievalsystemsassociatekeywordsortextwitheachimageinthecorpusandrequiretheusertoenterakeywordortextualdescriptionofthedesiredimage.Standardtextretrievaltechniquesarethenusedtoidentifytherelevantimages.Unfortunatelythistext-basedapproachtoimageretrievalhasnumerousdrawbacks[Na93a].Associatingkeywordsortextwitheachimageisatediousandtime-consumingtasksinceitmustbedonemanuallyoratbestsemi-automatically;imageprocessingtechnologyisnotadvancedenoughtoallowtheautomaticconstructionoftextualimagedescriptionsexceptinwell-denedandtightlyfocuseddomains.Someimagefeaturesmaynotbementionedinthetextualdescriptionduetodesigndecisionorindexererror;theseimagefeaturesdonotexistfromthestandpointoftheretrievalsystemandanyquerythatmentionsthemwillfail.Somefeaturesare\nearlyimpossibletodescribewithtext[Na93a];forexamplemanytexturesandshapesdefyeasydescription.Finallydierentindexers{oreventhesameindexer{maydescribethesamefeaturewithdierenttermsordierentfeatureswiththesameterm;thesearethestandardtextretrievalproblemsofsynonymyandpolysemy.Inaneorttoovercometheproblemsofthetext-basedapproachandimproveretrievalperformance,re-searchershavefocusedmoreandmoreoncontent-basedimageretrievalinwhichretrievalisaccomplishedbycomparingimagefeaturesdirectlyratherthantextualdescriptionsoftheimagefeatures.Itishopedthatcontent-basedtechniquescanprovidethebasisforpowerful\querybyexampleretrievalsystems.Forexampletheusermightprovideasamplepictureandrequestsimilarpictures,apictureofanobjectandrequestpicturesthatcontaintheobject,asetofcolorsandrequestimagesthatcontainthosecolors,andsoon.Featuresthatarecommonlyusedincontent-basedimageretrievalincludecolor,shape,textureandedges.1PartiallysupportedbyAFOSRcontractF49620-93-1-0266andAFOSR/DARPA89-05361ImagesColorextractionQueryprocessingformulationGUIforqueryedgemapsEdgeextractionHistogramsandFigure1:Thearchitectureoftheimageretrievalsystem{themainmodulesareedgeextraction,colorextraction,queryprocessinganduserinterface.Inthispaperwedescribeasimplecontent-basedsystemthatretrievescolorimagesonthebasisoftheircolordistributionsandedgecharacteristics.Thesystemisfullyautomaticasnomanualinterventionisrequiredduringtheindexingprocess.Fullautomation{alongwitheectiveretrievalperformance{istheprimarygoalofthesystemsinceamanualorsemi-automaticindexingprocessiserror-proneandtime-intensive.Thesystemdoesnotdevelopanynovelretrievaltechniquesbutinsteadusesexistingtechniquesthathavebeendescribedintheliterature{i.ehistogramintersection[SB91,Swa93]isusedtocomparecolordistributionsandsketchcomparison[HK92,KKOH92]isusedtocompareedgecharacteristics.Itishopedthatthesystemwillhighlightpotentialavenuesofresearchandserveasatestbedforfuturework.Tothisend,theperformanceofthesystemisevaluatedandvariousextensionstotheexistingretrievaltechniquesareproposed.Thenextsectiondescribestheimplementationofthesystem.Theremainingsectionsdiscusstheweaknessesofthecurrentimplementationandmethodsforaddressingtheseweaknesses.2ImplementationThesystemisimplementedasfourmodules{edgeextraction,colorextraction,queryprocessinganduserinterface.Thecolorandedgeextractionmodulesconstructasetofhistogramsandanedgemapforeachimage.Nomanualinterventio

1 / 19
下载文档,编辑使用

©2015-2020 m.777doc.com 三七文档.

备案号:鲁ICP备2024069028号-1 客服联系 QQ:2149211541

×
保存成功