EvaluatingQualitativeManagementResearch:aContingentCriteriology.WorkshopNumber7ESRCWorkshopsforQualitativeResearchinManagementIdentificationoftrainingneedInappropriateassessmentcriteriaisfrequentlyappliedtoqualitativeresearch.ConcernsexistabouthowtoassessqualitativeresearchAimsToillustratehowcompetingphilosophicalperspectivesunderpindifferentwaysofevaluatingmanagementresearchanddifferentresearchagendas;Toillustratethedangersofusingparticularevaluationcriteria,constitutedbyparticularphilosophicalconventions,toassessallmanagementresearch;Todevelopacontingentcriteriologywhereappropriateevaluationcriteriamightbeusedwhichvaryaccordingtothephilosophicalassumptionsinformingtheresearch.ObjectivesBytheendofthesessionyoushouldbeableto:Outlinetheproblemsassociatedwithcriteriologywithregardtocompetingprocessesofresearchevaluation;Explaintheconstitutiveandcontingentrelationshipbetweenphilosophicalassumptionsandthedevelopmentofdifferentevaluationcriteria;Describethekeyevaluationcriteriarelevanttofourdifferentapproachestomanagementresearch.Historicaldominanceofquantitativemethodologyinanglophonecountries;Neverthelessqualitativemanagementresearchhasalongestablishedpedigree;Qualitativeresearchmanagementresearchcharacterizedby:substantivediversity;competingphilosophicalassumptions.Confusionariseswhenevaluationcriteriaconstitutedbyparticularphilosophicalconventionsareuniversallyappliedtothisheterogeneousfield;Toavoidmisappropriationthereisaneedforacontingentcriteriology.ManagementSchoolsofThought:OntologicalStatusofHumanBehaviour/action:Epistemology:OntologicalStatusofSocialReality:MethodologicalCommitments:Keyresearchquestions:1.PositivismDeterminedObjectivistRealistQuantitativemethodstoenableerklarenWhatarethecausesofvariablex?2.Neo-empiricismMeaningfulObjectivistRealistQualitativemethodstoenableverstehenHowdopeoplesubjectivelyexperiencetheworld?3.CriticalTheoryMeaningfulSubjectivistRealistQualitativemethodstoenableastructuralphenomenologyHowdopeoplesubjectivelyexperiencetheworldandhowcantheyfreethemselvesfromdomination?4.Post-modernismDiscursiveSubjectivistSubjectivistQualitativemethodstoenabledeconstructionHowandwhyareparticulardiscoursesbeingvoicedwhileothersaren抰?FourKeyApproachestoManagementResearch:Knowledgeconstitutingassumptions(1).PositivismPopper’smodifiedpositivistmethodologyemphasizesobjectivityandunbiaseddatacollectioninordertotesthypothesesagainstanaccessibleindependentsocialrealityinordertoprotectagainst“fancifultheorizinginmanagementresearch”(Donaldson,1996:164).Hence4keyevaluationcriteria:Internalvalidity-whetherwhatareinterpretedasthe“causes”producethe“effects”inagivenpieceofresearch-necessitatescreating,orsimulating,conditionsofclosurewhichallowempiricaltesting;ConstitutingevaluationcriteriainmanagementresearchTestinghypothesesrequirestheoperationalizationofabstractconceptscausallyrelatedbythetheoryintoindicatorsthatmeasurewhattheyaresupposedtomeasure-constructvalidity.Akeyconcernisexternalpopulationvalidity-generalizingfindingstoadefinedpopulationbeyondthoserespondentsparticipatingintheresearch.Needtopreservedistancebetweentheresearcherandtheresearched-reliabilityoffindingsthroughreplication-thisreferstotheconsistencyofresearchfindingsandreferstotheextenttowhichitispossibleforanotherresearcherto(i)replicatetheresearchdesignwithequivalentpopulations;(ii)findthesameresults.Task:Evaluatethedifferentresearchmethodsintermsoftheirrelativestrengthsinregardtothe4criteriabelow:Criteria:Methods:InternalValidityPopulationValidityConstructValidityReliabilitye.gLaboratoryExperimente.g.Surveyse.g.ActionResearche.g.EthnographyEcologicalValidity“Doourinstrumentscapturethedailylifeconditions,opinions,values,attitudes,andknowledgebaseofthosewestudyasexpressedintheirnaturalhabitat?”(Cicourel,1982:15)Raisesquestionsaround:theextenttowhichthesocialsettinginwhichdatahasbeencollectedistypicalofinformants’normal“everyday”lives?areresearchfindingsartefactsofthesocialscientist’smethodsofdatacollectionandanalyticaltools?(2)Neo-EmpiricismThroughverstehen,andthecollectionofqualitativedata,aimstoinductivelydevelopthickdescriptionsofthepatternsactorsusetomakesenseoftheirworlds-sometimestoalsogenerategroundedtheory.Butretainspositivistcommitmenttoobjectivityexpressednowasasubject-subjectdualism:“thethird-personpointofview”(Schwandt,1996:62).Thequestionisarethephilosophicaldifferenceswithpositivismseenassignificantwhenitcomestoevaluationsresearch?-ForLecompteandGoetz(1982)no-hencecanuseunreconstructedpositivistcriteria.VS-ForLincolnandGuba(1985)yes-henceemphasizethefollowing.....Internalvaliditywithcredibility(authenticrepresentations);Externalvaliditywithtransferability(extentofapplicability);Reliabilitywithdependability(minimizationofresearcheridiosyncrasies);Objectivitywithconfirmability(researcherself-criticism).MeanwhileMorse(1994)focusesupontheanalysisofqualitativedata....Comprehension(learningaboutasetting);Synthesizing(identifyingpatternsinthedata);Theorizing(explanationsthatfitthedata);Recontextua