OSIsoft-PI-时序数据库核心技术

OSIsoftOverviewDevelopmentsinthePISystemFamilyofProductsGreggLeBlancPISystemProductManagerWhyScalability?MoredatacanbetrackedeverydayPhoneshaveGPSlocationdataReal-timemonitoringinthehomeElectricalusageSecuritysystemsFire/FlooddetectionITApplicationsEverymachineonanetworkneedsmonitoringExample:700,000homesx10datapoints=7,000,000pointsBenefitsITMonitoringcandetectIntrusionsImpendinghardwareproblemsDiagnosesoftwareproblemsVirustrafficExample:BecauseWiredCitycoulddetectandrecordtheamountofinboundtrafficfromtheNimdaworm,theygotarefundfromMCIWorldcomWhereisPIToday?100,000+DataStreams100’sofsimultaneousclients300+Interfaces6,500+Customers1,000’sofeventsrecorded/secIssuesWithinScalabilityAscalablesystemhasseveralaspectsUsersservedCalculationsandanalysisIntegrationissuesDatacapacityDatathroughputSecurityInfrastructureUserLoad&IntegrationUsersneedfastaccesstothedataClient/ServerusersStatelessUsersClient/ServerusersconnectdirectlytoPIStatelessUsersBroaderaudiencePIICEWebservicesandintegrationServerManager(PISDK)SafelyexposesPIdataThePITrustTableretainspointbypointsecurityConnectionmanagementbalancesuserrequestsInternetInformationServer(IIS)BrowserSecurityinICEPIWebServicePISDKSOAPMessagesPIEnterpriseServerPIPointSecurityWindowsAuthentication(AggregatedQueries)PITrustTableConnectionsinICEElvispidemoNortonpiadminAlicepialiceRickypiadminPISystemLucypidemoICENorton,RickyAliceElvis,LucyPISDKServerObjects1peruniquePIuser1TCP/IPConnectionperserverPISDKSessionManagerUnderlyingWebServiceStructurePIICEWebServicesLayerICEWebPartsICEWebPartsICEWebPartsICEWebPartsPISDKPIServerOtherHistoriansRelationalDatabasesDCSSCADALIMS…LooselyCoupledApplicationsTightlyCoupledWebServicesLayerLooselyCoupledComputingTheideaofWebservicesAllowsforcomputinginanenvironmentthatis:AsynchronousStatelessPlatformindependentGeographicallyindependentWillreplacesome“tightlycoupled”computingTightlyCoupledComputingInfrastructure-leveltiesbetweensystemsUsesAPIcallsUsuallyproprietaryNotasflexibleExamples:PIInterfacestootherinformationsystemsOLEDB/ODBCconnectorsPoint-to-Point,Middleware,andotherintegrationWebServiceIntegrationLooselycoupledapplicationsbuiltonWebServiceIntegrationSpaceTraditionalTightlyCoupledIntegrationSpaceICEKPIReportsAuditingERPQualityWebServicesPIBatchWebservicesRelationalDBWebservicesPIAuditingWebservicesERPWebservicesPIICEWebservicesWebServicesIntegrationSpaceInfrastructureOSIsoftismovingto.NETOlderapplicationswillmigrateNewapplicationswillleveragethe.NETFrameworkManagementtoolswilluse.NETNewtoolscomingforSMT(SystemsManagementTools)PartsofthePISystemwillbeaccessiblethrough.NETDistributedAnalysisServerBasedPerformanceEquationsDesktopBasedSpreadsheetsbasedonDataLinkDistributedCalculationsPIACEServerloadreducedCalculationscanbereusedSecurityConcernsIsn’tMicrosoftavulnerability?Overthelastyear26vulnerabilitiesinApache22inMicrosoft’sIISKeyissue:systemmaintenanceWhataboutNimda?250,000systemsin9hoursAtleast$2.4BindamagesInfectionstartedJuly13,2001PatchwasavailableJune18,2001(MS01-033)SecurityResponseMoreaccountability:MicrosoftNIPC(NationalInfrastructureProtectionCenter)workswithNERCandMicrosofttodevelopsecurityproceduresandstandardsKeyprecautionsstillremainGuardagainstsocialengineeringSystemmaintenanceUnknownvulnerabilitiesWiFi,wardrivingUnprotectedmodemlinesusedforsupportOSIsoftSecurityPIPointSecurityTrustTableSingledirectionPItoPItransfersAuditingAnewdatabasethatrecordschangestoPIPointsValuesModulechangesWhat’sBeenCoveredHandlinguserloadCalculationsIntegrationdemandSecurityInfrastructureMillionpointPISystemsHistoryoftheHistorianPI11983HP-10001985Vax-VMS1988PINetClient/ServerArchitecturePI21992Vax-VMS1994Alpha-OpenVMSPI31993DesignWorkHistoryoftheHistorianPI3Big4UnixHP-UXIBM-AIXDec-OSF/1Sun-SolarisWindowsNT3.51DevelopmentLanguageC++HistoryoftheHistorianPI3KeyconceptsofPI2wereusedSnapshotCompressionArchivecacheArchivenavigationPINetHistoryoftheHistorianPI3KeynewconceptsMulti-processRPCBasedInter-processcommunication–PISDKHistorizationofmanydifferentdatatypes–Doubles–Strings–BLOBsCommoncodebaseforallplatforms–64bitsupportPI3OriginalReleasePI3.0ReleasedNovember19951,000to100,000+PointsUpto2000eventspersecondsPI3.0toPI3.3Howmuchcanyoudoin7years?ConcentratedonfeaturesAlarmACETotalizerPISDKBatchDatabaseModuleDatabaseAuditNTSecurityCOMConnectorsDevelopmentInfra-structure–AutomatedbuildsandtestingBugfixes–(justafew)Scaling1996Typicalsystem100KpointsDatarates2000Events/Second2002Manysystemsapproaching150KpointsUpto10,000Events/SecondScaling1995Intel®Pentium®ProProcessor2P200MHz2002Intel®Xeon™Processor4P1.6GHzScalingThePIdataratesreflectincreaseinprocessorspeed.PointCountdoesnot.Limitationisnotprocessorspeed.LimitationsinPI3.3Memory2GBofvirtualmemoryperprocessArchivecacheInter-processcommunicationCompressedeventsfromsnapshottoarchiveSerializationofRPCsArchivesub-systemhandlesonecallatatime