高级计算机体系结构 第一章

PCAL1Intro.1WuSpring10©USTCParallelComputerArchitecture并行计算机体系结构Lecture1March1,2010WuJunmin([e-mail])PCAL1Intro.2WuSpring10©USTCOverview°AdministrativeMatters°IntrotoParallelComputerArchitecture°Break°ApplicationTrends°TechnologyTrends°ArchitecturalTrendsPCAL1Intro.3WuSpring10©USTCCourseAdministration°Instructor:吴俊敏([e-mail])°Materials:°Text:并行计算机体系结构，陈国良等编著，高等教育出版社°ReferenceBook:ParallelComputerArchitecture:AHardware/SoftwareApproach,DavidE.Culleretc.MorganKaufmannPublishers中译本并行计算机系统结构李晓明等译InterconnectionNetworks:AnEngineeringApproach,JoseDuato,SudhakarYalamanchili,LionelM.Ni中译本并行计算机互连网络技术——一种工程方法ComputerArchitecture：AQuantitativeApproach，JohnL.Hennessy,DavidA.Patterson(FourthEdition)PCAL1Intro.4WuSpring10©USTCGrading°Gradebreakdown•FinalExam:50%(70%)•HomeworkAssignments20%•Project20%(0)•ClassParticipation:10%•体系结构专业的学生要求完成一个Project.PCAL1Intro.5WuSpring10©USTCAbouttheTextbook°Authors:•陈国良教授，中科院院士，国家高性能中心（合肥）主任•并行算法学科体系：并行算法的设计与分析、并行计算机体系结构、并行算法实践、并行计算°Organization:•第一章绪论•第二章性能评测•第三章互连网络•第四章SMP•第五章MPP•第六章Cluster•第七章DSM•第八章CommunicationandLatencyPCAL1Intro.6WuSpring10©USTCSchedule°3/1Lec1Introduction°3/8Lec2TrendsandTechissuesinPCA°3/15Lec3Evaluation°3/22Lec4Interconnect°3/29，4/12Lec5-6InterconnectContinued°4/19Lec7SMP°4/26,5/10Lec8-9SMPContinued°5/17Lec10CMP°5/24Lec11DSM°5/31Lec12MPP°6/7Lec13Cluster°6/14Lec14CloudComputing+Virtualization°6/21Lec15Presentation°6/28ExamPCAL1Intro.7WuSpring10©USTCAboutProject°要求：本校计算机体系结构专业学生必须完成一项。其他专业学生感兴趣的也可参加。°分组：每组1-2人°题目：可选提供的，也可以结合自己以后的研究方向自选，但必须经老师同意。不同的组尽量不选相同的课题，不要把其他课程的作业拿过来交差。°完成方式：阅读关于所选课题方面的文章（该领域经典的文章及最近的进展），形成一篇该领域的综述文章或研究论文（要求按照论文格式，结构完整，关键词、摘要、索引，参考文献都需要），希望能提出自己的见解。最后每组选一个同学参与答辩（PowerPoint,10分钟）。°时间安排：3月13号前完成分组选题，6月13号前上交paper，6月21号答辩。°提交方式：统一用电子版（[e-mail])PCAL1Intro.8WuSpring10©USTCToday’sGoal:°IntroduceyoutoParallelComputerArchitecture°Provideyouasenseofthetrendsthatshapethefield°Answeryourquestionsaboutthiscourse°统计：学过ComputerArchitecture,ParallelComputing的同学PCAL1Intro.9WuSpring10©USTCOverview°AdministrativeMatters°IntrotoParallelComputerArchitecture°Break°ApplicationTrends°TechnologyTrends°ArchitecturalTrendsPCAL1Intro.10WuSpring10©USTCWhatisParallelArchitecture?°Aparallelcomputerisacollectionofprocessingelementsthatcommunicateandcooperatetosolvelargeproblemsfast.°Somebroadissues:•ResourceAllocation:-howlargeacollection?-howpowerfularetheelements?-howmuchmemory?•Dataaccess,CommunicationandSynchronization-howdotheelementscooperateandcommunicate?-howaredatatransmittedbetweenprocessors?-whataretheabstractionsandprimitivesforcooperation?•PerformanceandScalability-howdoesitalltranslateintoperformance?-howdoesitscale?PCAL1Intro.11WuSpring10©USTCWhatwillyougetoutofPCA?°In-depthunderstandingofthedesignandengineeringofmodernparallelcomputers•Technologyforces•Fundamentalarchitecturalissues-naming,replication,communication,synchronization•Basicdesigntechniques-cachecoherence,protocols,networks,pipelining,…•Methodsofevaluation•Underlyingengineeringtrade-offs°Frommoderatetoverylargescale°Acrossthehardware/softwareboundaryPCAL1Intro.12WuSpring10©USTCWillitbeworthwhile?°Thefundamentalissuesandsolutionstranslateacrossawidespectrumofsystems.°Pioneeredatthethin-endoftheplatformpyramidonthemost-demandingapplications•migratedownwardwithtime°UnderstandimplicationsforsoftwareSuperServersDepartmenatalServersWorkstationsPersonalComputersWorkstationsPCAL1Intro.13WuSpring10©USTCRoleofacomputerarchitect:Todesignandengineerthevariouslevelsofacomputersystemtomaximizeperformanceandprogrammabilitywithinlimitsoftechnologyandcost.Parallelism:•Providesalternativetofasterclockforperformance•Appliesatalllevelsofsystemdesign•Isafascinatingperspectivefromwhichtoviewarchitecture•IsincreasinglycentralininformationprocessingWhyStudyParallelArchitecture?PCAL1Intro.14WuSpring10©USTCWhyStudyitToday?°History:diverseandinnovativeorganizationalstructures,oftentiedtonovelprogrammingmodels°Rapidlymaturingunderstrongtechnologicalconstraints•The“killermicro”isubiquitous•Laptopsandsupercomputersarefundamentallysimilar!•Technologicaltrendscausediverseapproachestoconverge°Technologicaltrendsmakeparallelcomputinginevitable°Needtounderstandfundamentalprinciplesanddesigntradeoffs,notjusttaxonomies•Naming,Ordering,Replication,CommunicationperformancePCAL1Intro.15WuSpring10©USTCOverview°AdministrativeMatters°IntrotoParallelComputerArchitecture°Break°ApplicationTrends°TechnologyTrends°ArchitecturalTrendsPCAL1Intro.16WuSpring10©USTCIsParallelComputingInevitable?°Applicationdemands:Ourinsatiableneedforcomputingcycles°TechnologyTrends°ArchitectureTrends°Economics°Currenttrends:•MicroprocessorsareCMP:Intel,AMD,IBM,•ServersandworkstationsareMP:IBM,SGI,HP...PCAL1Intro.17WuSpring10©USTCApplicationTrends°Applicationdemandforperformancefuelsadvancesinhardware,whichenablesnewappl’ns,which...•Cycledrivesexponentialincreaseinmicroprocessorperformance•Drivesparallelarchitectureharder-mostdemandingapplications°Rangeofperformancedemands•Needrangeofsystemperformancewithprogressi