Cisco ACI Architecture for BigData with Cloudera

CiscoApplicationCentricInfrastructureforBigDatawithClouderaHighlyScalableArchitectureforBigDataClustersLastUpdated:October28,2014BuildingArchitecturestoSolveBusinessProblemsCiscoValidatedDesign2AbouttheAuthors3RaghunathNambiarKarthikKulkarniRangaRaoSamuelKommuAbouttheAuthorsRaghunathNambiar,DistinguishedEngineer,CiscoSystemsRaghunathNambiarisaDistinguishedEngineeratCisco'sDataCenterBusinessGroup.Hiscurrentresponsibilitiesincludeemergingtechnologiesandbigdatastrategy.RangaRao,TechnicalMarketingEngineer,CiscoSystemsRangaRaoisaTechnicalMarketingEngineerworkingontheCiscoApplicationCentricInfrastructureandNexus9000SeriesSwitches.HeleadstheCiscoACIsolutionengineeringteam,focusingonbigdataandotherhighperformanceinfrastructurelikeSAPHANA.KarthikKulkarni,TechnicalMarketingEngineer,CiscoSystemsKarthikKulkarniisaTechnicalMarketingEngineerwithroleasabigdataSolutionsArchitectintheDataCenterSolutionsGroup.Hismainfocusisonarchitectingandbuildingsolutionsonbigdatarelatedtechnologies,infrastructureandperformance.SamuelKommu,TechnicalMarketingEngineer,CiscoSystemsSamuelKommuisaTechnicalMarketingEngineerandispartofCiscoApplicationCentricInfrastructuresolutionengineeringteamfocusingonbigdatainfrastructureandperformance.4AboutCiscoValidatedDesign(CVD)ProgramAboutCiscoValidatedDesign(CVD)ProgramTheCVDprogramconsistsofsystemsandsolutionsdesigned,tested,anddocumentedtofacilitatefaster,morereliable,andmorepredictablecustomerdeployments.Formoreinformationvisit:(COLLECTIVELY,DESIGNS)INTHISMANUALAREPRESENTEDASIS,WITHALLFAULTS.CISCOANDITSSUPPLIERSDISCLAIMALLWARRANTIES,INCLUDING,WITHOUTLIMITATION,THEWARRANTYOFMERCHANTABILITY,FITNESSFORAPARTICULARPURPOSEANDNONINFRINGEMENTORARISINGFROMACOURSEOFDEALING,USAGE,ORTRADEPRACTICE.INNOEVENTSHALLCISCOORITSSUPPLIERSBELIABLEFORANYINDIRECT,SPECIAL,CONSEQUENTIAL,ORINCIDENTALDAMAGES,INCLUDING,WITHOUTLIMITATION,LOSTPROFITSORLOSSORDAMAGETODATAARISINGOUTOFTHEUSEORINABILITYTOUSETHEDESIGNS,EVENIFCISCOORITSSUPPLIERSHAVEBEENADVISEDOFTHEPOSSIBILITYOFSUCHDAMAGES.THEDESIGNSARESUBJECTTOCHANGEWITHOUTNOTICE.USERSARESOLELYRESPONSIBLEFORTHEIRAPPLICATIONOFTHEDESIGNS.THEDESIGNSDONOTCONSTITUTETHETECHNICALOROTHERPROFESSIONALADVICEOFCISCO,ITSSUPPLIERSORPARTNERS.USERSSHOULDCONSULTTHEIROWNTECHNICALADVISORSBEFOREIMPLEMENTINGTHEDESIGNS.RESULTSMAYVARYDEPENDINGONFACTORSNOTTESTEDBYCISCO.TheCiscoimplementationofTCPheadercompressionisanadaptationofaprogramdevelopedbytheUniversityofCalifornia,Berkeley(UCB)aspartofUCB’spublicdomainversionoftheUNIXoperatingsystem.Allrightsreserved.Copyright©1981,RegentsoftheUniversityofCalifornia.CiscoandtheCiscologoaretrademarksorregisteredtrademarksofCiscoand/oritsaffiliatesintheU.S.andothercountries.ToviewalistofCiscotrademarks,gotothisURL:(1110R).AnyInternetProtocol(IP)addressesandphonenumbersusedinthisdocumentarenotintendedtobeactualaddressesandphonenumbers.Anyexamples,commanddisplayoutput,networktopologydiagrams,andotherfiguresincludedinthedocumentareshownforillustrativepurposesonly.AnyuseofactualIPaddressesorphonenumbersinillustrativecontentisunintentionalandcoincidental.CiscoApplicationCentricInfrastructureforBigDatawithCloudera©2014CiscoSystems,Inc.Allrightsreserved.AcknowledgmentTheauthorsacknowledgecontributionsofAmritKharel,ManankumarTrivedi,AshwinManjunatha,andSindhuSudhirfortheircontributionsindevelopingthisdocument.CorporateHeadquarters:Copyright©2014CiscoSystems,Inc.Allrightsreserved.CiscoSystems,Inc.,170WestTasmanDrive,SanJose,CA95134-1706USACiscoApplicationCentricInfrastructureforBigDatawithClouderaAudienceThisdocumentdescribesthearchitectureanddeploymentproceduresofClouderaonabigdataclusterbasedonCiscoApplicationCentricInfrastructure.Theintendedaudienceofthisdocumentincludes,butisnotlimitedto,salesengineers,fieldconsultants,professionalservices,ITmanagers,partnerengineeringandcustomerswhowanttodeployClouderaontheCiscoACIforbigdata.IntroductionHadoophasbecomeastrategicdataplatformembracedbymainstreamenterprisesasitoffersthefastestpathforbusinessestounlockvalueinbigdatawhilemaximizingexistinginvestments.Clouderaistheleadingproviderofenterprise-gradeHadoopinfrastructuresoftwareandservices,andtheleadingcontributortotheApacheHadoopprojectoverall.Clouderaprovidesanenterprise-readyHadoop-basedsolutionknownasClouderaEnterprise,whichincludestheirmarketleadingopensourceHadoopdistribution(CDH),theircomprehensivemanagementsystem(ClouderaManager),andtechnicalsupport.ThecombinationofCiscoApplicationCentricInfrastructure(ACI),ClouderaandCiscoUCSServersprovidesindustry-leadingplatformforHadoopbasedapplications.CiscoApplicationCentricInfrastructure(ACI)OverviewACIprovidesnetworktheabilitytodeployandrespondtotheneedsofapplications,bothinthedatacenterandinthecloud.Thenetworkmustbeabletodelivertherightlevelsofcon