Weka_a_tool_for_exploratory_data_mining

DepartmentofComputerScience,UniversityofWaikato,NewZealandBernhardPfahringer(basedonmaterialbyEibeFrank,MarkHall,andPeterReutemann)„WEKA:AMachineLearningToolkit„TheExplorer•ClassificationandRegression•Clustering•AssociationRules•AttributeSelection•DataVisualization„TheExperimenter„TheKnowledgeFlowGUI„OtherUtilities„ConclusionsMachineLearningwithWEKA2011-3-25UniversityofWaikato2WEKA:thebirdCopyright:MartinKramer([e-mail])TheWekaorwoodhen(Gallirallusaustralis)isanendemicbirdofNewZealand.(Source:WikiPedia)2011-3-25UniversityofWaikato3WEKA:thesoftware„Machinelearning/dataminingsoftwarewritteninJava(distributedundertheGNUPublicLicense)„Usedforresearch,education,andapplications„Complements“DataMining”byWitten&Frank„Mainfeatures:‹Comprehensivesetofdatapre-processingtools,learningalgorithmsandevaluationmethods‹Graphicaluserinterfaces(incl.datavisualization)‹Environmentforcomparinglearningalgorithms2011-3-25UniversityofWaikato4History„ProjectfundedbytheNZgovernmentsince1993‹Developstate-of-theartworkbenchofdataminingtools‹Explorefieldedapplications‹Developnewfundamentalmethods2011-3-25UniversityofWaikato5History(2)„Late1992-fundingwasappliedforbyIanWitten„1993-developmentoftheinterfaceandinfrastructure‹WEKAacronymcoinedbyGeoffHolmes‹WEKA’sfileformat“ARFF”wascreatedbyAndrewDonkinARFFwasrumoredtostandforAAndrew’sRRidiculousFFileFFormat„Sometimein1994-firstinternalreleaseofWEKA‹TCL/TKuserinterface+learningalgorithmswrittenmostlyinC‹Verymuchbetasoftware‹Changesfortheb1releaseincluded(amongothers):“AmbiguousandUnsupportedmenucommandsremoved.”“Crashingprocesseshandled(inmostcases:-)”„October1996-firstpublicrelease:WEKA2.12011-3-25UniversityofWaikato6History(3)„July1997-WEKA2.2‹Schemes:1R,T2,K*,M5,M5Class,IB1-4,FOIL,PEBLS,supportforC5‹Includedafacility(basedonUnixmakefiles)forconfiguringandrunninglargescaleexperiments„Early1997-decisionwasmadetorewriteWEKAinJava‹OriginatedfromcodewrittenbyEibeFrankforhisPhD‹OriginallycodenamedJAWS(JAJAvaWWekaSSystem)„May1998-WEKA2.3‹LastreleaseoftheTCL/TK-basedsystem„Mid1999-WEKA3(100%Java)released‹VersiontocomplementtheDataMiningbook‹Developmentversion(includingGUI)2011-3-25UniversityofWaikato7TheGUIbackthen…TCL/TKinterfaceofWeka2.12011-3-25UniversityofWaikato8WEKA:versions„ThereareseveralversionsofWEKA:‹WEKA3.4:“bookversion”compatiblewithdescriptionindataminingbook‹WEKA3.5.5:“developmentversion”withlotsofimprovements„ThistalkisbasedonanightlysnapshotofWEKA3.5.5(12-Feb-2007)2011-3-25UniversityofWaikato9@relationheart-disease-simplified@attributeagenumeric@attributesex{female,male}@attributechest_pain_type{typ_angina,asympt,non_anginal,atyp_angina}@attributecholesterolnumeric@attributeexercise_induced_angina{no,yes}@attributeclass{present,not_present}@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...WEKAonlydealswith“flat”files2011-3-25UniversityofWaikato10@relationheart-disease-simplified@attributeagenumeric@attributesex{female,male}@attributechest_pain_type{typ_angina,asympt,non_anginal,atyp_angina}@attributecholesterolnumeric@attributeexercise_induced_angina{no,yes}@attributeclass{present,not_present}@data63,male,typ_angina,233,no,not_present67,male,asympt,286,yes,present67,male,asympt,229,yes,present38,female,non_anginal,?,no,not_present...WEKAonlydealswith“flat”files2011-3-25UniversityofWaikato11javaweka.gui.GUIChooser2011-3-25UniversityofWaikato122011-3-25UniversityofWaikato132011-3-25UniversityofWaikato14java-jarweka.jar2011-3-25UniversityofWaikato15Explorer:pre-processingthedata„Datacanbeimportedfromafileinvariousformats:ARFF,CSV,C4.5,binary„DatacanalsobereadfromaURLorfromanSQLdatabase(usingJDBC)„Pre-processingtoolsinWEKAarecalled“filters”„WEKAcontainsfiltersfor:‹Discretization,normalization,resampling,attributeselection,transformingandcombiningattributes,…2011-3-25UniversityofWaikato162011-3-25UniversityofWaikato172011-3-25UniversityofWaikato182011-3-25UniversityofWaikato192011-3-25UniversityofWaikato202011-3-25UniversityofWaikato212011-3-25UniversityofWaikato222011-3-25UniversityofWaikato232011-3-25UniversityofWaikato242011-3-25UniversityofWaikato252011-3-25UniversityofWaikato262011-3-25UniversityofWaikato272011-3-25UniversityofWaikato282011-3-25UniversityofWaikato292011-3-25UniversityofWaikato302011-3-25UniversityofWaikato312011-3-25UniversityofWaikato322011-3-25UniversityofWaikato332011-3-25UniversityofWaikato342011-3-25UniversityofWaikato352011-3-25UniversityofWaikato362011-3-25UniversityofWaikato37Explorer:building“classifiers”„ClassifiersinWEKAaremodelsforpredictingnominalornumericquantities„Implementedlearningschemesinclude:‹Decisiontreesandlists,instance-basedclassifiers,supportvectormachines,multi-layerperceptrons,logisticregression,Bayes’nets,…„“Meta”-classifiersinclude:‹Bagging,boosting,stacking,error-correctingoutputcodes,locallyweightedlearning,…2011-3-25UniversityofWaikato382011-3-25UniversityofWaikato392011-3-25UniversityofWaikato402011-3-25UniversityofWaikato412011-3-