EXADATA基础知识培训

单明祺[e-mail]数据库云服务器技术揭密提纲•Exadata架构设计原理•Exadata硬件体系架构•Exadata软件体系技术•新一代数据库云平台特点和案例问题1：随着系统规模增加，传统数据库架构瓶颈凸显•存储层：1）数据量不断增加，带来的IO瓶颈；2）随着数据长时间运行带来的数据分布不均匀，存在IO热点•网络层：传输带宽不足，无法快速传输大量数据到服务器•服务器层：接收过多数据进行处理，内存优势无法发挥解决思路：减轻负载、加宽通道、提高并行传统数据库架构解决思路：1.加宽通道、增加通道数量2.减少需要传送到服务器处理的数据量提高系统扩展能力3.增加系统并行处理Exadata设计原则：存储层智能化、数据预处理能力…ExadataCellDisk…DiskExadataCellExadatasoftwareExadatasoftwareOracleDatabaseServers问题2：多系统资源互相独立，无法共享有些资源过度，有些资源不足，由于生产环境动态变化，无法动态满足DatabaseServersStorageArraysExadata设计原则：资源共享和资源控制I/OResourceManagementOracleDatabaseServersSmartstorageoperationsStorageconsolidation(Transparenttodatabases)HighperformancestoragenetworkDatacompression问题3：复杂的数据库系统均衡化配置•“Theweakestlink”definesthethroughput•Eachbuildingblockisabalancedunit•Componentstoconsider:•CPU:Quantityandspeed•HBA(HostBusAdapter):Quantityandspeed•Switchspeed•Controller:Quantityandspeed•Disk:QuantityandspeedFC-Switch1FC-Switch2DiskArray1DiskArray2DiskArray3DiskArray4DiskArray5DiskArray6DiskArray7DiskArray8HBA1HBA2HBA1HBA2HBA1HBA2HBA1HBA2Eachmachinehas2GbHBAsAll8HBAscansustain8*200MB/s=1600MB/sEachswitchneedstosupport800MB/stoguaranteeatotalsystemthroughputof1600MB/sEachdiskarrayhasone2GbitcontrollerAll8diskarrayscansustain8*200MB/s=1600MB/sEachmachinehas2CPUsAllfourserversdriveabout2*200MB/s*4=1600MB/sExadata设计原则：平衡且优化配置•客户化系统无法达到最佳性能-组件不平衡,错误配置，瓶颈•Exadata端到端优化-从磁盘到数据库传输是两倍的GB/sec-磁盘，闪存，控制器，总线，HBA,网络，CPU等-数据库从固件，驱动，操作系统，网络的优化-多年的调优经验-没有瓶颈•将IT智慧转化成业务需求-而不要设计，调优，维护，硬件配置端到端优化问题4：系统的维护和扩容过程复杂均衡化配置方法论分区和HA规划网络互联配置规划数据库存储规划Exadata设计原则：简化部署•消除了数据库系统部署的复杂性-数月的配置、排错、调优•当天即可完成部署-预置的、经过测试的、可稳定运行的标准配置-连接网线、电源线、加电即可用-无需更改现有应用程序，youareExadatacertified•即可获得极限性能数月到数天SunOracleDatabaseMachine:SystemArchitectureHighBandwidthInterconnectMassivelyParallelStorageClusteredDatabaseServers…ComputeIntensiveProcessingSunOracleDatabaseServerComputeIntensiveProcessingSunOracleDatabaseServerComputeIntensiveProcessingSunOracleDatabaseServer…DataIntensiveProcessingSunOracleExadataStorageServerDataIntensiveProcessingSunOracleExadataStorageServerDataIntensiveProcessingSunOracleExadataStorageServerDataIntensiveProcessingSunOracleExadataStorageServerSunOracleDatabaseMachine:5.3TBSunFireFlashCacheHighBandwidthInterconnectMassivelyParallelStorageClusteredDatabaseServers…ComputeIntensiveProcessingSunOracleDatabaseServerComputeIntensiveProcessingSunOracleDatabaseServerComputeIntensiveProcessingSunOracleDatabaseServer…DataIntensiveProcessingSunOracleExadataStorageServerSunFireDataIntensiveProcessingSunOracleExadataStorageServerSunFireDataIntensiveProcessingSunOracleExadataStorageServerSunFireDataIntensiveProcessingSunOracleExadataStorageServerSunFire提纲•Exadata架构设计原理•Exadata硬件体系架构•Exadata软件体系技术•新一代数据库云平台特点和案例Exadata硬件架构Exadata智能存储网格•14x高性能低成本存储服务器(2U)•高性能,低成本,冗余,线性扩展•100TBHighSpeeddisk,或336TBHighCapacitydisk•112Intelcoresinstorage•5.3TBPCI闪存•跨存储服务器的数据镜像保护Datamirroredacrossstorageservers•超级性能&开箱即用MaximumPowerusageofaFullRackDatabaseMachineis14KW,typicalis9.8KW.AsinglehighendSMPplatformwithoutstorageorswitchescanconsumewellover20KW.数据库网格InfiniBandNetwork•Redundant40Gb/sswitches•Unifiedserver&storagenetwork•8台数据库服务器(X2-2)96CPUcores(12Coreperserver,2xSix-CoreIntelX5675Processors(3.06GHz)768GBmemory(可扩展至1152GB)•或2台数据库服务器(X2-8)128CPUcores(64Coreperserver)2TB(1TBperserver)Exadata低功耗2PowerDistributionUnits(PDUs)atrearDatabaseMachineX2-2FullRack8Intel-based2CPUSunFiredatabaseservers14ExadataStorageServers(allhighperformanceorallhighcapacity)3SunDatacenterInfiniBandSwitch36(36-portmanagedQDRswitch-40Gb/s)Keyboard,Video,Mouse(KVM)hardware1CiscoEthernetswitch(48-port)StartSmallandGrowX2-2FullRackX2-2QuarterRackX2-2HalfRackExadataX2-2FullRack•8Dual-procesorDatabaseServers(SunFireX4170M2)-96cores(12perserver)-768GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-16x10GbEports(2perserver)•14ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•3SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)Addmoreracksforadditionalscalability•4Dual-procesorDatabaseServers(SunFireX4170M2)-48cores(12perserver)-384GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-8x10GbEports(2perserver)•7ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•3SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)CanUpgradetoaFullRackExadataX2-2HalfRackCanUpgradetoanHalfRackExadataX2-2QuarterRack•2Dual-procesorDatabaseServers(SunFireX4170M2)-24cores(12perserver)-192GBmemory(96GBperserver)-10GigEconnectivitytoDataCenter-4x10GbEports(2perserver)•3ExadataStorageServersX2-2-AllwithHighPerformance600GBSASdisksOR-AllwithHighCapacity2TBSASdisks•2SunDatacenterInfiniBandSwitch36-36-portManagedQDR(40Gb/s)switch•1“Admin”CiscoEthernetswitch•Keyboard,Video,Mouse(KVM)hardware•2RedundantPowerDistributionsUnits(PDUs)提纲•