自动化测试所面临的挑战及其解决方案

FromRequirementstoTestResults–UsingAutomationDeskinaseamlesswayChristineHaertl,PMHolgerKrumm,PMMarch,22nd20072Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement3Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement4UnlockpressedThedoorsareunlockedThedoorsareunlockedExample:Remotecontrol5RequirementsandTestsDoesatestexistforeachrequirement?Howmanyrequirementsaretestedsuccessfully?RequirementsEngineerTestDeveloperWherefromdoIgetthetestcases?WherecanIplacetheresults?6ConnectingRequirements&TestsRequirementsinDOORSTestspecificationinDOORSTestimplementationinAutomationDeskAutomationDeskDOORSConnect&SyncModuleƒConsistencybetweentestspecificationandtestimplementationƒstructureƒparametersƒtestresultsƒTriggeringoftestexecution7TestSpecificationinDOORS-ExampleExample:TestCasesfortheremotecontrolThesection“TestSteps”containsthestepstostimulatethesystemundertestandtheexpectedresults8ExportDatafromDOORStotheConnect&SyncServerdrag&drop9ExportDatafromDOORStotheConnect&SyncServerContentoftheConnect&SyncServerTheDOORSproject10Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement11AutomationDesk–Anemptyproject12ImportDatafromConnect&SyncServerContentoftheConnect&SyncServerTheAutomationDeskproject13TestSpecificationStructureinTestImplementationStructureandparametersofthetestspecificationcreatedinDOORS14SameStructure:TestSpecificationandTestImplementationTestspecification(e.g.DOORS)TestimplementationinAutomationDeskTest:UnlockacarTest:UnlockacarArichtextelementcontainingtheteststepsTestStepsfromthetestspecificationTestStepsfromthetestspecificationRemoteunlockcommandRemoteunlockcommand15Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement16Bestpractice:CreatingCustomBlocksCustomBlockconformtotheTestSpecificationTestStepsfromthetestspecificationImplementationoftheTestSteps17CustomBlockconformtotheTestSpecificationAlternativeExample:TestspecificationinExcelTestspecificationinExcel18Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement19TestDevelopmentusingtheTestFrameworkTestTestInitializationTestStepsandEvaluationTestCleanupTestStepsfromthetestspecificationTestImplementationImplementationofoneTestStep20Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestspecificationRequirementsmanagement21ExecutingTestsinAutomationDeskE.g.ExecutingaselectedTestSequenceƒSelectasequence,afolderorthewholeprojectƒExecutetestsusingthecontextmenuƒDefinesettingsforResultandReportgenerationCreatingareportCreatingaresultLevelofdetailforresultandreport22RunningOvernightTestsusingBatchScriptsƒRemotecontrolofAutomationDeskProjectManagerviaCOM/DCOMƒLanguage-independentinterfaceÎUsefromPython,VisualBasic,C++,…ƒDetailedAPIdocumentationserver=win32com.client.Dispatch(ADAutomationServer.TAM.1)ProjObj=server.Projects.Import(ReportLibraryDemo.zip,1)ResObj=ProjObj.Execute(Result,COMAPITest)RepsObj=ResObj.ReportsRepObj=RepsObj[RepsObj.Count-1]Path=RepObj.Pathwin32api.ShellExecute(0,open,Path,,,1)server=win32com.client.Dispatch(ADAutomationServer.TAM.1)ProjObj=server.Projects.Import(ReportLibraryDemo.zip,1)ResObj=ProjObj.Execute(Result,COMAPITest)RepsObj=ResObj.ReportsRepObj=RepsObj[RepsObj.Count-1]Path=RepObj.Pathwin32api.ShellExecute(0,open,Path,,,1)StartAutomationServerExecuteprojectCreateandshowreportImportprojectOnlyAutomationDeskAutomation-Serverrequired,nofulllicense!23UsingtheAutomationServerwithCustomGUIsFurthertestplanningandexecutionusingCOM-API:ƒHighlevelcontrolstructuresonproject,sequence,orfolderlayerƒResult-dependentreportgenerationNamesofTestSequencesProgressoftheExecutionSelectedSequenceswillbeexecuted24Test-AutomationReferenceProcessTestprojectmanagementCoreTest-AutomationProcessesDefectmanagementVersion&configurationmanagementReportingTestdevelopmentTestplanningandexecutionTestresultsTestautomationlibrariesExternalProcessesTestsp