雷鸣 一个大规模、高性能的搜索引擎系统及索引和检索子系统的实现

:distributedandparallelcrawling,heuristiccrawlingstrategy,replicatedpageserasing,ChineseandEnglishfeaturesextracting,efficientindexingtechnology,dictionaryupdating,link-structureanalysis,fastsearchingtechnology,relevancerankingstrategy,hashsortingalgorithm,cachingstrategy,Chinesekeywordlearning,anduserbehavioranalyzingtechnology.Finally,webrieflyintroducetheimplementationandperformanceofthesystemandconcludewithsomefutureworksforWebGather.Keywords:SearchEngine,§...........................................................................................5§..........................................................................6.............................................................................................8§...................................................................................8§IR.......................................................................................10§....................................................................................11§....................................................................................14...........................................................................16§............................................................................16§.............................................................................................16§.....................................................................17§.............................................................................................18§.....................................................................18§....................................................19.......................................................................................................22§....................................................................................................22§Web..........................................22§.................................................................................................23§.....................................................................................24§.....................................................................263§.....................................................................................27§....................................................................................................28§IR.......................................................................................28§.....................................................................................29§.........................................................................29§.........................................................................................30§.............................................................................32§....................................................................................................33§.............................................................................................33§.....................................................................................35§.................................................................................36§.....................................................................................37§...........................