SystemSimulationandVRChapter9VerificationandvalidationofsimulationmodelsoverviewModelbuilding,verification,andvalidationVerificationofsimulationmodelsCalibrationandvalidationofmodelsModelbuilding,verification,andvalidationVerificationbuildingthemodelrightTocomparetheconceptualmodeltothecomputerrepresentationthatIsthemodelimplementedcorrectlyinthecomputer?Aretheinputparametersandlogicalstructureofthemodelcorrectlyrepresented?ValidationBuildingtherightmodelTodetermineamodelisanaccuraterepresentationoftherealsystemModelbuilding,verification,andvalidationRealsystemOperationalmodelConceptualmodel1.Assumptionsonsystemcomponents2.Structuralassumptions3.InputparametersanddataassumptionsCalibration&validationConceptualvalidationModelverificationoverviewModelbuilding,verification,andvalidationVerificationofsimulationmodelsCalibrationandvalidationofmodelsThepurposeToassurethattheconceptualmodelisrepresentedaccuratelyinthecomputerizedrepresentation.Istheconceptualmodelaccuratelyrepresentedbytheoperationalmodel?VerificationofsimulationmodelVerificationofsimulationmodelAssumptionsonsystemcomponentssystemstructureparametervaluesabstractionssimplificationsSuggestionsMakeflowdiagramExaminethemodeloutputforreasonablenessunderavarietyofsettingsoftheinputparametersPrinttheinputparametersattheendofthesimulationInteractiveruncontroller(IRC)Thesimulationcanbemonitoredasitprogresses.Attentioncanbefocusedonaparticularlineoflogicormultiplelinesoflogicthatconstituteaprocedureoraparticularentity.Valuesofselectedmodelcomponentscanbeobserved.InputdatamodelingDatacollectionIdentifyingthedistributionwithdataHistogramsSelectingthefamilyofdistributionsQ-QplotsParameterestimationGoodness-of-fittestsoverviewModelbuilding,verification,andvalidationVerificationofsimulationmodelsCalibrationandvalidationofmodelsCalibrationandvalidationofmodelsValidationTheoverallprocessofcomparingthemodelanditsbehaviortotherealsystemanditsbehavior.CalibrationTheiterativeprocessofcomparingthemodeltotherealsystemNaylorandFingerapproachBuildamodelthathashighfacevalidityValidatemodelassumptionsComparethemodelinput-outputtransformationsfortherealsystemFacevalidityMakesurethemodelappearsreasonableonitsfacetomodelusersandotherswhoareknowledgeableabouttherealsystembeingsimulated.ValidationofmodelassumptionsStructuralassumptionsHowthesystemoperatesSimplificationsandabstractionsoftherealityDataassumptionsShouldbebasedonthecollectionofreliabledataandcorrectstatisticalanalysisValidatinginput-outputtransformationsThemodelisviewedasaninput-outputtransformation.Themodelacceptsvaluesoftheinputparametersandtransformstheseinputsintooutputmeasuresofperformance.Input-outputvalidationUsinghistoricalinputdataUsingaTuringtestSummaryValidationofsimulationmodelsisofgreatimportanceDecisionsaremadeonthebasisofsimulationresultsManytechniques,findtheappropriateone,bothtoassuremodelaccuracyandtoassuremodelcredibilityThankyou