A Survey of Visual Preprocessing and Shape Represe

I.-ASurveyofVisualPreprocessingandShapeRepresentationTechniquesBrunoA.OlshausenNovember1988ResearchInstituteforAdvancedComputerScienceNASAAmesKzsearchCenterWACSTechnicalReport88.35NASACooperativeAgreementNumberNCC2-408ResearchInstituteforAdvancedComputerScience(NASA-CR-185418)ASURVEYOFVISUAL189-28309PBEPEOCESSIl4GAIDSHAPEREPRESENTATIOHTECHPIQUES[Researchfnst..forAdvancedComputerScience)64pCSCL09BUnclas\/63/610217809~~.......~..~....-..--ASurveyofVisualPreprocessingandShapeRepresentationTechniquesBrunoA.OlshausenResearchInstituteforAdvancedComputerScienceNASAAmesResearchCenterRIACSTechnicalReport88.35November1988Abstract.Thissurveysummarizesmanyrecenttheoriesandmethodsproposedforvisualpreprocessingandshaperepresentation.Thesurveybringstogetherresearchfromthefieldsofbiology,psychology,computerscience,electricalengineering,andmostrecently,neuralnetworks.Thisreportwasmotivatedbytheneedtopreprocessimagesforasparsedistributedmemory(SDM),butthetechniquespresentedhereinmayalsoproveusefulforapplyingotherassociativememoriestovisualpatternrecognition.Thematerialofthissurveyisdividedintothreesections1)anoverviewofbiologicalvisualprocessing.2)methodsofpreprocessing(extractingpartsofshape,texture,motion,anddepth),and3)shaperepresentationandrecognition(forminvariance,primitivesandstructuraldescriptions,andtheoriesofattention).~WorkreportedhereinwassupportedinpartbyCooperativeAgreementNCC2-408betweentheNationalAeronauticsandSpaceAdministration(NASA)andtheUniversitiesSpaceResearchAssociation(USRA).TableofContents.1.Introduction...............................................................................................................................11.1.Theproblemsofvision................................................................................................11.2.Scopeofthissurvey.....................................................................................................2Prerequisites.........................................................................................................2Othersurveys.books.andcollections..................................................................21.3.Organizationofthissurvey..........................................................................................31.4.Acknowledgments........................................................................................................32.1.Retina...........................................................................................................................42.2.Lateralgeniculatenucleus(LGN)................................................................................62.3.Visualcortex................................................................................................................6V1(area17,orstriatecortex)..............................................................................7MT(middletemporalarea)andMST(medialsuperiortemporalarea)..............82.AnOverviewofBiologicalVisualProcessing.........................................................................4V4.......................................................................................................................8IT(inferotemporalcortex)...................................................................................83.PreprocessingtheImage...........................................................................................................93.1.Edgedetection..............................................................................................................9TheMarr-Hildrethedgedetector.........................................................................9TheGaborfilter..................................................................................................11Cooperativeprocesses........................................................................................11Self-organizingprocesses..................................................................................123.2.Extractingmorecomplicatedshapes.........................................................................14Curvaturedetection............................................................................................14TheNeocognitron..............................................................................................15CooperativeProcesses.......................................................................................15Non-accidentalpatterns.....................................................................................163.3Texture........................................................................................................................163.4.Motion........................................................................................................................173.5.Depth..........................................................................................................................183.6.Otherfeatures............................................................................