搜索
外文翻译系别信息工程系专业自动化/测控技术与仪器班级学号姓名指导教师崔建国负责教师崔建国2015年6月沈阳航空航天大学北方科技学院毕业设计（外文翻译）1NeuralNetworkIntroduction1.ObjectivesAsyoureadthesewordsyouareusingacomplexbiologicalneuralnetwork.Youhaveahighlyinterconnectedsetofsome1011neuronstofacilitateyourreading,breathing,motionandthinking.Eachofyourbiologicalneurons，arichassemblyoftissueandchemistry,hasthecomplexity,ifnotthespeed,ofamicroprocessor.Someofyourneuralstructurewaswithyouatbirth.Otherpartshavebeenestablishedbyexperience.Scientistshaveonlyjustbeguntounderstandhowbiologicalneuralnetworksoperate.Itisgenerallyunderstoodthatallbiologicalneuralfunctions,includingmemory,arestoredintheneuronsandintheconnectionsbetweenthem.Learningisviewedastheestablishmentofnewconnectionsbetweenneuronsorthemodificationofexistingconnections.Thisleadstothefollowingquestion:Althoughwehaveonlyarudimentaryunderstandingofbiologicalneuralnetworks,isitpossibletoconstructasmallsetofsimpleartificial“neurons”andperhapstrainthemtoserveausefulfunction?Theansweris“yes.”Thisbook,then,isaboutartificialneuralnetworks.Theneuronsthatweconsiderherearenotbiological.Theyareextremelysimpleabstractionsofbiologicalneurons,realizedaselementsinaprogramorperhapsascircuitsmadeofsilicon.Networksoftheseartificialneuronsdonothaveafractionofthepowerofthehumanbrain,buttheycanbetrainedtoperformusefulfunctions.Thisbookisaboutsuchneurons,thenetworksthatcontainthemandtheirtraining.2.HistoryThehistoryofartificialneuralnetworksisfilledwithcolorful,creativeindividualsfrommanydifferentfields,manyofwhomstruggledfordecadestodevelopconceptsthatwenowtakeforgranted.Thishistoryhasbeendocumentedbyvariousauthors.OneparticularlyinterestingbookisNeurocomputing:FoundationsofResearchbyJohnAndersonandEdwardRosenfeld.Theyhavecollectedandeditedasetofsome43papersofspecialhistoricalinterest.Eachpaperisprecededbyanintroductionthatputsthepaper沈阳航空航天大学北方科技学院毕业设计（外文翻译）2inhistoricalperspective.Historiesofsomeofthemainneuralnetworkcontributorsareincludedatthebeginningofvariouschaptersthroughoutthistextandwillnotberepeatedhere.However,itseemsappropriatetogiveabriefoverview,asampleofthemajordevelopments.Atleasttwoingredientsarenecessaryfortheadvancementofatechnology:conceptandimplementation.First,onemusthaveaconcept,awayofthinkingaboutatopic,someviewofitthatgivesclaritynottherebefore.Thismayinvolveasimpleidea,oritmaybemorespecificandincludeamathematicaldescription.Toillustratethispoint,considerthehistoryoftheheart.Itwasthoughttobe,atvarioustimes,thecenterofthesoulorasourceofheat.Inthe17thcenturymedicalpractitionersfinallybegantoviewtheheartasapump,andtheydesignedexperimentstostudyitspumpingaction.Theseexperimentsrevolutionizedourviewofthecirculatorysystem.Withoutthepumpconcept,anunderstandingoftheheartwasoutofgrasp.Conceptsandtheiraccompanyingmathematicsarenotsufficientforatechnologytomatureunlessthereissomewaytoimplementthesystem.Forinstance,themathematicsnecessaryforthereconstructionofimagesfromcomputer-aidedtopography(CAT)scanswasknownmanyyearsbeforetheavailabilityofhigh-speedcomputersandefficientalgorithmsfinallymadeitpracticaltoimplementausefulCATsystem.Thehistoryofneuralnetworkshasprogressedthroughbothconceptualinnovationsandimplementationdevelopments.Theseadvancements,however,seemtohaveoccurredinfitsandstartsratherthanbysteadyevolution.Someofthebackgroundworkforthefieldofneuralnetworksoccurredinthelate19thandearly20thcenturies.Thisconsistedprimarilyofinterdisciplinaryworkinphysics,psychologyandneurophysiologybysuchscientistsasHermannvonHelmholtz,ErnstMuchandIvanPavlov.Thisearlyworkemphasizedgeneraltheoriesoflearning,vision,conditioning,etc.,anddidnotincludespecificmathematicalmodelsofneuronoperation.Themodernviewofneuralnetworksbeganinthe1940swiththeworkofWarrenMcCullochandWalterPitts[McPi43],whoshowedthatnetworksofartificialneurons沈阳航空航天大学北方科技学院毕业设计（外文翻译）3could,inprinciple,computeanyarithmeticorlogicalfunction.Theirworkisoftenacknowledgedastheoriginoftheneuralnetworkfield.McCullochandPittswerefollowedbyDonaldHebb[Hebb49],whoproposedthatclassicalconditioning(asdiscoveredbyPavlov)ispresentbecauseofthepropertiesofindividualneurons.Heproposedamechanismforlearninginbiologicalneurons.Thefirstpracticalapplicationofartificialneuralnetworkscameinthelate1950s,withtheinventionoftheperceptionnetworkandassociatedlearningrulebyFrankRosenblatt[Rose58].Rosenblattandhiscolleaguesbuiltaperceptionnetworkanddemonstrateditsabilitytoperformpatternrecognition.Thisearlysuccessgeneratedagreatdealofinterestinneuralnetworkresearch.Unfortunately,itwaslatershownthatthebasicperceptionnetworkcouldsolveonlyalimitedclassofproblems.(SeeChapter4formoreonRosenblattandtheperceptionlearningrule.)Ataboutthesametime,BernardWidrowandTedHoff[WiHo60]introducedanewlearningalgorithmandusedittotrainadaptivelinearneuralnetworks,whichweresimilarinstructureandcapabilitytoRosenblatt’sperception.TheWidrowHofflearningruleisstillinusetoday.(SeeChapter10formoreonWidrow-Hofflearning.)Unfortunately,bothRosenblatt'sandWidrow'snetworkssufferedfromthesameinherentlimitations,whichwerewidelypublicizedin