language testing (ma)-one

2020/3/6LanguageTestingLanChunshou2020/3/6SyllabusUnderstandthegeneralconsiderationsthatmustbeaddressedinthedevelopmentofnewtestsortheselectionofexistinglanguagetests;Maketheirownjudgementsanddecisionsabouteitherselectinganexistinglanguagetestordevelopinganewlanguagetest;Familiarisethemselveswiththefundamentalissues,approaches,andmethodsusedinmeasurementandevaluation;Design,develop,evaluateanduselanguagetestsinwaysthatareappropriateforagivenpurpose,context,andgroupoftesttakers;UnderstandthefuturedevelopmentoflanguagetestingandtheapplicationofITtocomputerizedlanguagetesting.Itisexpectedthat,bytheendofthismodule,participantsshouldbeabletodothefollowing:2020/3/6Inordertoachievetheseobjectives,thiscoursegivesparticipantstheopportunitytodevelopthefollowingskills:writingtestitemscollectingtestdataandconductingitemanalysisevaluatinglanguagetestswithregardtovalidityandreliabilityThisisdonebyconsideringawiderangeofissuesandtopicsrelatedtolanguagetesting.Theseincludethefollowing:GeneralconceptsinlanguagetestingandevaluationEvaluationofalanguagetest:reliabilityandvalidityCommunicativeapproachtolanguagetestingDesignofalanguagetestItemwritinganditemanalysisInterpretingtestresultsItemresponsetheoryanditsapplicationsSyllabus2020/3/6ClassScheduleWeekTopicReadingBasicconceptsinlanguagetestingMcNamara(2000),Brown(1996)TestspecificationsAldersonetal.(1995,Chaps.2)Testvalidation:reliabilityandvalidity(1)Brown(1996,Chaps.6,7,&8)Testvalidation:reliabilityandvalidity(2)Aldersonetal.(1995,Chaps.6&8)Washback;Testconstruction(1)StepstotestconstructionTestconstruction(2)TestPaperProduction；ItemWritingTestconstruction(3)TestingSkills;PerformanceTestRaschmodel(1)McNamara(1996)Raschmodel(2)McNamara(1996)2020/3/6RequirementsandGrading:1.Homeworkassignments:20%2.Finalteamwork(groupsof3to4):80%Homeworkassignments:Youwillhaveone“short”assignmentthroughoutthecourse.Thiswillinvolveworkingonthedatasetyouaregiven.Inthisassignmentyouwillbeaskedtocalculateastatisticorsetofstatisticsthatwehavecoveredinclassandgivecorrespondingcommentsontheresults.Theassignmentisworth20%ofthecoursegrade.Thetopicis:ReliabilityandvalidityFinalteamwork:You’llbedividedintogroupsof,say,threeorfour,tocollaborativelycompleteafinalproject.You’retochooseoneofthefollowingtopicstowriteatermpaperofnotlessthan3000words:1.Evaluatinganexistingtestpaper.2.Developatestpaper(oratestiteminaperformancetest)byyourselfandconductrelevantstatisticalevaluation.Assessment2020/3/6Gradingofthefinalteamworkisbasedonyour:TopicStructureLiteraturereviewMethodologyStatisticalapplicationDiscussionConclusionAssessment2020/3/6Bachman,L.F.&Palmer,A.(1996).LanguageTestinginPractice.Oxford:OxfordUniversityPress.Brown,J.D.(1996).TestinginLanguagePrograms.UpperSaddleRiver,NJ:PrenticeHallRegents.Henning,G.1987.Aguidetolanguagetesting:development,evaluationandresearch.Heinle&HeinlePublishers.Li,X.(1997).TheScienceandArtofLanguageTesting.Changsha:HunanEducationalPress.McNamara,T.(1996).Measuringsecondlanguageperformance.London;NewYork:Longman.Coursebooks2020/3/6Readinglist1.Alderson,J.C.,Clapham,C.,&Wall,D.(1995).Languagetestconstructionandevaluation.Cambridge:CambridgeUniversityPress.2.Bachman,L.F.,&Palmer,A.S.(1996).LanguageTestinginPractice.Oxford:OxfordUniversityPress.3.Bachman,L.F.(2000).Modernlanguagetestingattheturnofthecentury:assuringthatwhatwecountcounts.LanguageTesting,17(1),1-42.4.Baker,B.F.(2001).TheBasicsofItemResponseTheory(2nded.):ERICClearinghouseonAssessmentandEvaluation.5.Bond,T.G.,&Fox,C.M.(2001).ApplyingtheRaschmodel:Fundamentalmeasurementinthehumansciences.Mahwah,NJ:LawrenceErlbarmAssociates.6.Brown,J.D.(1996).TestinginLanguagePrograms.UpperSaddleRiver,NJ:PrenticeHallRegents.7.Brown,J.D.(1997).Computersinlanguagetesting:presentresearchandsomefuturedirections.LanguageLearning&Technology,1(1),44-59.8.Brown,J.D.,Hudson,T.,Norris,J.M.,&Bonk,W.J.(2002).Aninvestigationofsecondlanguagetask-basedperformanceassessments.Manoa:UniversityofHawaii.9.Chapelle,C.(2001).Computerapplicationsinsecondlanguageacquisition:foundationsforteaching,testingandresearch.NewYork:CambridgeUniversityPress.10.Clapham,C.&D.Corson(Eds.),EncyclopaediaofLanguageandEducation(Vol.7:Languagetestingandassessment).Dordrecht:KluwertAcademic.11.Heaton,J.B.(1988).WritingEnglishlanguagetests:apracticalguideforteachersofEnglishasasecondorforeignlanguage(2nded.).London:Longman.12.Henning,G.(1987).Aguidetolanguagetesting:development,evaluation,research.Cambridge:NewberryHousePublishers.13.Linacre,J.M.(2003a).Auser'sguidetoWINSTEPS:Rasch-modelcomputerprograms.Chicago:MESAPress.14.Linacre,J.M.(2003b).Auser'sguidetoFACETS:Rasch-modelcomputerprogram.Chicago:MESAPress.15.McNamara,T.(2000).Languagetesting.Oxford,Eng.NewYork:OxfordUniversityPress.16.Messick,S.(1996).Validityandwashbackinlanguagetesting.LanguageTesting,13(3),241-256.17.Norris,J.M.,Brown,J.D.,Hudson,T.,&Yoshioka,J.(1998).Designingsecondlanguageperformanceassessments.Honolulu:SecondLanguageTeaching&CurriculumCenterUniversityofHawai’i.18.Qi,L