ContentDeliveryNetworks:OverlayNetworksforScalingandEnhancingtheWebRajkumarBuyyaandMukaddimPathanGridComputingandDistributedSystems(GRIDS)LaboratoryDept.ofComputerScienceandSoftwareEngineeringTheUniversityofMelbourne,Australia@ADCOM2008,Chennai,India2CDN:OverlayNetworksforScalingandEnhancingtheWebOutlinePartI:CDNFundamentalsCDNinsightsCDNtaxonomyContentdistributionandmanagementContentreplicationCachingtechniquesRequest-redirectionPartII:CDNModelingandPerformanceEconomics-informeddesignCDNpricingMathematicalmodelingCDNperformancePartIII:AdvancedCDNPlatformsandApplicationsDynamicCDNsforadaptivecontentdeliveryCollaborativemediastreamingLiveandon-demandvideoservicesoverIPMobiledynamicCDNsContentdeliveryforcommunitynetworksCDNinternetworkingContentDeliveryNetworks:Designs,ModelsandPerformancePartII4CDN:OverlayNetworksforScalingandEnhancingtheWebOutlinePartI:CDNFundamentalsCDNinsightsCDNtaxonomyContentdistributionandmanagementContentreplicationCachingtechniquesRequest-redirectionPartII:CDNModelingandPerformanceEconomics-informeddesignCDNpricingMathematicalmodelingCDNperformancePartIII:AdvancedCDNPlatformsandApplicationsDynamicCDNsforadaptivecontentdeliveryCollaborativemediastreamingLiveandon-demandvideoservicesoverIPMobiledynamicCDNsContentdeliveryforcommunitynetworksCDNinternetworking5CDN:OverlayNetworksforScalingandEnhancingtheWebIndividualIncentivesandCDNs“Tragedyofthecommons”isobservedintheP2PnetworkMisalignmentbetweeneachindividual’sownincentivesandasituationdesirablefromasocietalpointofviewStudyingperceiveduserrationality,incentives,orselfishnesshasseverallevelsofinteresttoaCDNdesignerUsingend-usersashelpersforcontentdistribution(e.g.YouTube),inordertoincreaseuserQoS,whilereducinginfrastructurecostCDNinternetworkingcanbenefitfromparticipants’incentivestodeviseameaningful,enforceableServiceLevelAgreement(SLA)EveninasingleCDNdomain,characterizingtheamountofresourcesfromeachparticipantisnecessaryforproperoperationsUnderstandingcostandbenefitsassociatedwithparticipationhelpstogainvaluableinsightsintoviablecustomerpricingschemesResearchonincentive-basedstrategicinteractionCommoninappliedmathematics,economicstomodelcompetitivemarketsRelativelynewinnetworkresearch,focusingongametheory6CDN:OverlayNetworksforScalingandEnhancingtheWebGame-TheoreticBackgroundInvolvesstrategicinteractions(games)amongindividualdecision-makers(players)Eachuserobtainsautilitydependentonadoptedstrategy,i.e.getsarewardorapenalty,basedonheractionsandthatofotherplayersCompetitiveequilibrium(ConceptofNashequilibrium)PredictuserbehaviorandinfertheoutcomeofacompetitivegamePlayersareinaNashequilibriumifachangeinstrategiesbyanywouldleadthatplayertoobtainalowerutilitythanhercurrentoneDefinitionsPurestrategies:deterministicMixedstrategies:non-deterministic(probability-based)Usefulforexogenousconditionsthatimpactuserbehavior,e.g.networkcongestionsSocialoptimum:ensurehighestaverageutilitySituationthatisthebestforallplayers,takenasanaggregate,i.e.tothesociety7CDN:OverlayNetworksforScalingandEnhancingtheWebCDNCostModelAimsatassessingtheamountofresourcesagivennodemustcontributetoparticipateinaCDNanditsperceivedbenefitsTotalcostCuimposedonnodeuis:Cu=Lu+Su+Ru+MuLuisthelatencycostexperiencedbynodeuSumofindividualcostmultipliedbytheprobabilityforaitemktoberequestedSuistheservicecostincurredbynodeuExpectednominalcostvalueoverallpossiblerequestsRuistheroutingcostsufferedbynodeuforforwardingarequestDenotesthecostforresourcesusedbyaserverwhichreceivesaqueryfork,cannotresolveitandhastoredirectthequerytoaDNSserverhigherupinthetree,averagedoverallpossiblequeriesMuisthemaintenancecostincurredbynodeuCostformaintainingalinkwithitsneighbor8CDN:OverlayNetworksforScalingandEnhancingtheWebSocialOptimaandNashEquilibriaStaticnetworktopologywithshortestpathroutingAllnodeshaveequalprobabilityforservingarequestl,s,r,mareconstantsFullmeshcost,C(fullmesh)=s+l(N-1)+mN(N-1)Thefullmeshisthesocialoptimumifthemaintenancecostis“smallenough”,m≤l/N+r/N2Starnetworkcost,C(star)=2m(N-1)+s+2l(N-1)2/N+r(N-1)(N-2)/N2Thestarisasocialoptimumif(i)conditionforfullmeshdoesnothold;and(ii)linksarebi-directionalNoguaranteeforstartobeauniquesocialoptimumPossibleNashequilibriaIfml/N,thefullmeshisaunique(pure)NashequilibriumIfm≥l/N,thestarnetworkisapureNashequilibriumIndividualincentivesandoverallresourceusageareconflictingSocialoptimumdeviatesbasedontheamountofforwardtrafficCDNdesignersshouldminimizeredirectionasmuchaspossible9CDN:OverlayNetworksforScalingandEnhancingtheWebAlternativeNetworkGeometriesDeBruijngraphAdirectedgraphofdiameterD,withshortaverageroutingdistanceandhighresiliencytonodefailuresMaintenancecostforanodeu,Mu=m∆,∆isafixedout-degreeUsedforoverlaynetworkmaintenancealgorithmsD-dimensionaltoriEachnodeisrepresentedbyDCartesiancoordinates,andhas2DneighborsMaintenancecostforanodeu,Mu=2mDUsedinCANPRRtreesNodesarerepresentedbyastringofDdigitsinbase∆,andhasD(∆-1)distinctconnected