SAP-HANA-SPS-09---Whats-New---SDI-and-SDQ

1©2014SAPAGoranSAPaffiliatecompany.Allrightsreserved.SAPHANASPS09-What’sNew?EIMServicesinHANA:SDIandSDQHANAEIMProductManagementOctober,2014©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.2PublicAgendaEIMServicesinHANA–overviewSmartDataIntegrationSmartDataQualitySummaryofvaluepropositionEIMServicesinHANA:Overview©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.4PublicEIMServicesinHANASimplifyingthelandscape,loweringdatalatency,openandextensibleframeworkSimplified:Simplifiedlandscape;onecommonmodellingenvironmenttoprovisionandconsumeRealtime:lowerlatencyduetorealtimereplicationandinmemoryperformanceOpenandExtensible:Supportsdataofanyshapeandsize;openframeworkfornewdatasourcesTraditionalMultipleDataSourcesSAPHANACurrentDataMixofPotentiallyStaleandCurrentDataAggregateETLReplicationTransactionsSAPHANAInMemoryPlatformHANAIMServicesSDIOnPremiseandCloudsourcesofDataOtherSourcesOpRDBMSIntegratedETL,ReplicationandSDASeparateETL,ReplicationandSDASDASDQ©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.5PublicEIMServicesinHANA–What’sNewinSPS09?SDI:smartdataintegrationExtendsHANAbyprovidingaarchitecturesupportingAllstylesofdatadelivery:real-time,batchandfederation(SDA)Allstylesofdeployment:onpremiseandcloudHANA’sSDIProvidesbothdatareplicationanddatatransformationservicesIsopenandextensible,worksonSAPandnon-SAPdataofanystyle,shapeandsizeItsmodelingenvironmentispartofHANAStudioandHANAWeb-basedDevelopmentWorkbenchExtendsHANA’stransformationcapabilitybyintegratingETL-typetransformationsnativelyinHANAAcceleratesperformancethroughanativeHANAimplementationSDQ:smartdataqualityProvidesadvancedtransformationstosupportDQfunctionality©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.6PublicBusinessvalueofEIMServicesinHANAToday,wehaveseveralEIMproductsavailableforspecificusecases:Replicationproducts(SybaseReplicationServer,SLT)tobuildonpremise,operationalBIplatformsIntegrationandDataQualityproductstobuildanalyticplatformsorsolutionsOnpremiseplatforms,withDataServicesInthecloudsolutions,withHCI/DSoDWithHANAIMserviceswenowhaveasingleproductthatIsabletoaddressalltheusecasesaboveAllowsdeveloperstoaddressnewusecases,wherewecanfreelycombineDatasources:SAPandnon-SAP(onDBMS,Hadoop,Hive,OData)Datasourcelocationandtargetdeployment:onpremise,cloudDatadeliverymodefromsourcetotarget:realtime,batch,federationE.g.,integrate,inarealtimeanalyticplatformdeployedinthecloud:(i)onpremise,ECCSAPdata,(ii)onpremiseDBMSdataand(iii)federateddatainthecloudexposedbyanODataserviceSDI:SmartDataIntegration©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.8PublicSmartDataIntegrationExtendingHANAbyintegratingrealtimedeliverymodeSDIprovidesrealtimepushmodetoreplicatesourcesOnselectedsourceswithchangedatacapture(CDC)capabilityLeveragesprovenSybaseReplicationServertechnologyProvidesbatchpullmodeforalltypesofsourcesInteractswellwithHANA’sfederationtechnology(SDA)LeveragesSDAanytimeremotedataisrequested(initialdataload,queries,etc).ExtendsSDAconnectivitybyprovidinganAdapterSDKProvidesTransactionalIntegrityforrealtimepushBylisteningtochangesintheDBMStransactionlogsandonlyreplicatingcommittedchangesProvidesGuaranteedDeliveryforrealtimepushSDIcanresumeprocessingifreplicationstreamishaltedordisruptedSDIcancontinuetooperateduringatemporaryabsenceoftheHANAtarget©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.9PublicSmartDataIntegrationTransformationsExtendsHANA’scapabilitybyintegratingETL-typetransformationsnativelyinHANATransformationinputsincludeHANAtablesVirtualHANAtablesViewsProvidesadvancedUItodefinetransformationflowsInHANAstudio’sApplicationFunctionModeler(AFM)ExecutionmodesBatchRealtime©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.10PublicSmartDataIntegrationAvailabletransformationsBasicSQL–orientedFilter,Join,Union,Sort,MapAdvancedSQL–orientedAggregation,lookup,sort,case,andpivot/unpivotAddressingthedatamovementlifecycleRowgeneration,dategeneration,tablecomparisonandhistorypreservingExecutingcodeScript,function,procedure©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.11PublicSmartDataIntegrationRealtimereplicationRealtimereplicationReplicationUI(inHANAWeb-basedDevelopmentWorkbench)Simple(onlyfilterandproject)transformationsRealtimepush©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.12PublicSmartDataIntegrationBatchdataintegrationBatchdataintegrationDataflowUI(inHANAStudio)ComplextransformationflowsSmartdataaccesspull©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.13PublicSmartDataIntegrationNewusecase:realtimedataintegrationRealtimedataintegrationDataflowUI(inHANAStudio)ComplextransformationflowsRealtimepushBenefitsTransformeddatanowflowsinrealtimeImprovedproductivity:noneedtowrite“deltaload”flows©2014SAPSEoranSAPaffiliatecompany.Allrightsreserved.14PublicSmartDataIntegrationNativeHANAImplementationofTransformationsasTasksAtaskisalongrunningprogramexecutingtransformsTaskhasaplanthatcompilestoaHANAcalculationscenarioOperationsinplanmaybeimplementedbyexistingcalculationnodesorbyIM-specificnativenodesRunsinthebac