五矿集团进出口数据仓库架构与研究

华东交通大学硕士学位论文五矿集团进出口数据仓库架构与研究姓名：洪祥申请学位级别：硕士专业：计算机应用技术指导教师：丁振凡20070420IEDIOLAPCWMETLETLCWMETLabstractIIDesignandresearchofChinaMinmetalsCorporation’simportandexportdatawarehouseABSTRACTInrecentyearstheDatawarehouseisadevelopingpromptlytechnology.Itcanfullyutilizestoringinformationindatawarehouse,helpingenterpriseleadsthedecision-makingbeinginprogresscorrectly,makesenterprisecangrasppreemptiveopportunityinfiercemarketcompetition.Theheightqualityanalysisdatamakestheenterpriseleaderbeabletoknowenterprisebusinessperformance,revisesandworkingouttheenterprisemanagementtactic,makinglong-termpolicydecisionout.Sodatawarehousebuildingappearsespeciallyimportanttoenterprisedecision-making.ThepaperisneededspecificallyforChineseMinmetalsCorp.simportandexportdatamultidimensionalanalysisanddecision-making,thedatatocustomhouseandDepartmentofCommerceEDIorganizesanddisplaysthesystemhavingcarriedouttheenvironmentandhavingstudiedanddiscusseddetailedlythedesigningandprocessoftheChineseMinmetalsCorp.simportandexportofdatawareehouse.Accordingtoanalysingthedefinition,characteristicpropertyandsystemstructureofthedatawarehousefirst.Haveexpoundedthemodelthoughtandmethodowingtodatawarehouselifecyclebuilding,Haveanalysedthedatasource,datastorehousephysicaldesign,OLAPsystemstructurescheme,fore-endimplementchoice,havebroughtthecollectivestructureaboutChineseMinmetalsCorp.simportandexportdatawarehouse.Andthenanalysetheimportandexportdata,thesubjecthavingdividedcorrespondingbusiness,designdatawarehouseconcept,logicalandphysicsmodel,thendiscussarealizationmethodofETLimplementbaseonCWMmetadataandextract,translate,cleanallkindsofdatasourceofthecompany,andloadtothedatawarehousesystem.Concentrateonhavingdiscussedtheprocessthatanalyseanddesigntheimportandexportdatawarehousefinally.wedesignanalysisreportsandfixedreportsforthedataphysicalviews,supportmanydimensionsoperation.Accordingtoanalysesystematiclytheimportandexportcondition,providethebasistothedecision-making.Bythissystem,businessdataandtherelevancedatacancarryoutstableorganization,consistentstoreaccordingtothesubjectindatastorehouseenvironment;Bebasedonconsumer'sanalysisneed,realizetheETLsystemstructurethecorrespondingdatacube,delivertotheconsumer.Finallyexhibitandoperatethemuiltdemensiondatainthecustomerforanalysisreportsandfixedreports.andsowefinishthewholeprocessthatorganizaeandexhibitdatebaseonsubjects.Thissystemhelpscustomerusethedataefficiently,andpromotethenicety.Atthesametimethesystemhasexcellentexpansibility.Allthesevirtueshelpthecompanysinformationbuildingestablishexcellentbasis.KeyWords:Datawarehouse,CWM,ETL,Operationdatamemory____________________________________________________________11.1EDI20005EDI1.21)SybaseSybasequickStartDataMartSybaseIQ,Carleton,PASSPOR,BrioQuery,CongasPowerplay[1]DB2,MS,VSAM,Sybase,Oracle,InformixBitWise1002)HPHPHP9000(Simplicity)(Standards)(Skills)Internet/2HPHP(IntelligentWarehouse)3)IBMIBMBusinessObjectsBusinessObjects,LotusApproachIBMQueryManagementFacilityOLAPArborsoftwareEssayed,IBMDB20LAP(Arbor)SASSASIBM(IntelligentMiner)[2]WebLotusNotes4)OracleOracle:a)b)()c):(1)1998IBMIT(2)CIOCEO.3ERP(3)(4)SASIT1.3061.“DB-ODS-DW-DM2.ETLETLSERVERCLIENT3.ETL1)2)43)ETL4)BO1.4PowerDesingerCWMETLETLCWMETLBusinessObjectsBO52.1DataWarehouse2080W.H.InmonBuildingtheDataWarehouseSubjectOrientedIntegrateNon-VolatileTimeVariant[3]12342.2OLAP2-16OLAP2-1Fig2-1ThesystemstructureofDatawarehouse1[4]234OLAPROLAPMOLAPHOLAP[5]ROLAPRDBMSMOLAF7HOLAPRDBMS5[6]OLAP2.3[7]1)2)DBMS()3)[8]4)5)6)7)B/SOLAP88)9OLAP3-13-1Fig3-1ThedatacollectivitystructureEDI3.1[9][10]10[11]3.2[12][13]3-211wk_mon_factwd_comdorganizationwd_deptwd_countrywd_custwd_tradewd_time3-2Fig3-2TheexampleofstarmodelPowerDesinger3-3()123-3Fig3-3Thelogicalstructuremodel3.3[14][15]1213I/O345/6[16]SybaseSybaseASE143-1wd_timewd_monwd_yearwd_comdorganizationwd_comdchangewd_tradeWd_rb_tradewd_codeheadwd_custwd_dptypewd_deptwd_countrywd_districtwd_organizationwd_corpattrwd_iewd_unitwd_yb_unitwd_dz_unitwd_source153-2hgwkdataihgwkdataehgalldataihgalldataehz_yb_wkyfhz_yb_wkndhz_yb_qgwkyfhz_yb_qgyf()hz_yb_wkyf_dq()hz_yb_wknd_dqhz_yb_qgndbgddatahz_rb_wkrqhz_rb_wkrq3hz_rb_wkyfhz_rb_wkyf3[17](primarykey)(foreignkey)(referentialintegrity)comdorganization_iddept_idcountry_idcust_idtrade_idtime_idwd_comdorganizationwd_deptwd_countrywd_custwd_tradewd_timecomdorganization_iddept_idcountry_idcust_id16trade_idtime_idCWMETL17CWMETLETL[18]ETL(HTMLExcel)[19]4.14.1.1(1)(2)WindowsNTAIX(AdvancedInteractiveExecutiveIBMUNIX)Linux(3)SQLServerOracleSybaseTCP/IP[20]CWMETL184.1.2EDIETLEDIEDIEDISybaseASE4.2ETLETL(ExtractTransformLoad)()(Extract)(Transform)(Load)[21]ODBCSQLETLETLETLETLETL60%80%CWMETL194.3ETL4.3.1ETL(ODBC)ETLPULLPUSHPUSHETLPUSHPULLETLETL[22]1ODBCOLEDBJDBCODBCOLEDBJDBC(1)ODBCODBCAPI(2)OLEDBOLEDBCOMOLEDBEXCELDBASEISAMIBMDB2ADOActiveXDataObjectsOLEDBOLEDBOLEDBFOROLAPOLEDBcubeOLEDBODBCOLEDBFOROLAP(3)JDBCJDBCJavaDataBaseConnectivityXbaseOracleSybaseAccessParadoxJDBCJAVAJAVAJAVACWMETL20JDBCJDBCDBMSURLDriverURLJDBCJDBCSQL(1)ODBCOLEDBJDBC(2)FTPFTPInterne