AIX平台上Oracle

AIX平台上Oracle10gRAC架构选型的最佳实践周硕基[e-mail]©2003IBMCorporationRACInterconnectConfiguration:10gƒHACMPNetworkTopologynolongerusedƒOracle“FaultTolerantIP”codehasbeenremovedƒPublicandPrivate(RACInterconnect)networknamesareƒspecifiedatclusterconfigurationtime–Publicinterfacenames(e.g.en0)MUSTbethesameonallnodes–Privateinterfacenames(e.g.en6)SHOULDbethesameonallnodes–Privatenetworksshouldbenon-routableƒFaultToleranceprovidedbyeither:–EtherChannelor802.3adLinkAggregationRequiresprotocolcapableswitchesSupportsbandwidthaggregationandloadbalancing©2003IBMCorporationRACInterconnect:10g(Primary/BackupConfiguration)©2003IBMCorporationRACInterconnect:10g(BandwidthAggregation)©2003IBMCorporationNetworkArchitecturewithVirtualI/OServer©2003IBMCorporationWhatSharedStorageisSupportedonAIX?ƒRawDevices–ConcurrentRawLogicalVolumes–RequiresHACMP(CLVMcomponent)ƒOracleAutomaticStorageManagement(ASM)--10gonly–AlternativetoexternalfilesystemandLVMƒClusterFileSystems–GPFS–VeritasStorageFoundationforRAC©2003IBMCorporationWhatSharedStorageisSupportedonAIXƒCanuse(continued)–NetworkAttachedStorage•NFS-based•Potentiallylowercost-nofibrechannelrequired•Easytoadminister©2003IBMCorporationASMBenefitsinaRACEnvironmentƒIncludedinOracle10gatnoextrachargeƒReduces3rdpartysoftwarestackcomponents–ReplacesFileSystemsandLogicalVolumeManagerƒAutomaticstripingofdataobjectstoimproveoverallI/ObalanceandperformanceƒProvidesDBAswithgreatercontroloverStorageManagementfunctions©2003IBMCorporation©2003IBMCorporationMulti-pathingandASM©2003IBMCorporationFordisksusedforASM(usempioasanexample)ƒThenfordiskstobeusedforASM,andonallnodes:1.InstallMPIOonallnodes,attachtheLUNtoeachnode,dicoverLUN’swith“cfgmgr“.2.Identifyhdisknamesoneachnodes,foragivenLUNID.3.removePVIDfromhdiskandchangethereservepolicytonoreserveusing:chdev-lhdisk…-apv=clearchdev-lhdisk…-areserve_policy=no_reserve4.setownerchiptooracle:dbatothe/dev/rhdisk…5.setread/writepermissionsto660tothe/dev/rhdisk…6.accessthediskthru/dev/rhdisk…forASMdiskgroupconfiguration©2003IBMCorporationIfyoudon’tusehacmp!!!ƒTheIBMAIXclusteringlayer,HACMPfilesets,MUSTNOTbeinstalledifyou’vechosenanimplementationwithoutHACMP.Ifthislayerisimplementedforotherpurpose,disksressourcesnecessarytoinstallandrunCRSdatawillhavetobepartofanHACMPvolumegroupresource.ƒIfyouhavepreviouslyinstalledHACMP,youmustremove:HACMPfilesets(cluster.es.*)rsct.hacmp.rtersct.compat.basic.hacmp.rtersct.compat.clients.hacmp.rteƒIfyoudidrunafirstinstallationoftheOracleClusterware(CRS)withHACMPinstalled,ƒCheckif/opt/ORCLclusterdirectorydoesexistandifso,removeitonallnodes.ƒTHENREBOOTALLNODES…©2003IBMCorporationCONSIDERATIONSFORRAC/ASMSETUPWITHHACMPƒHOWEVER,ifcustomerstillneedtohaveHACMP,OracleClusterwarecancohabitatewithHACMP.1.HACMPmustnottake-over/failovertheOracleClusterwareressources(VIP,database,etc…)2.HACMPVIPmustnotbeconfiguredonIPfromPublicnodenameusedbyRAC(hostname),orOracleClusterwareVIP3.With10g,it’snotnecessarytodeclaretheRACinterconnectinHACMP4.It’snotmandatorytodeclarehdisksusedforASMinHACMPaslogicalvolumes(LV)fromVolumeGroups(VG).5.IfthechoiceistodeclarehdisksusedbyASMinHACMPVolumeGroups,THENyou’llhavetopreparethedisksforOCR,Voting,ASMspfileandASMdisks©2003IBMCorporationConcurrentRawDeviceswithVolumesGroups(HACMP)©2003IBMCorporationƒYoucanusevirtualI/Odisksfor:•AIX5Loperatingsystem•Oracleclusterware($CRS_HOME)•RACSoftware($ORACLE_HOME)ƒBUTNOTtobeusedfor:•OCR(OracleClusterRegistry)disk,•Voting(Heartbeat)disk,and•databasefiles(datafiles,redologs,archivelogs,UNDO,TEMP,etc….)ƒHBAFiberChannelcardsMUSTNOTbesharedthruVirtualI/Oserver,asfortoday(checkcertificationstatusonOracleMetalink)SANandVirtualI/OServer©2003IBMCorporationIt’sok.©2003IBMCorporationWrong?Forasmit’salsooknow.©2003IBMCorporationGPFSBenefitsinaRACEnvironmentƒFilesystemadministrationflexibilityinaclusteredenvironmentƒDirectI/O(DIO)andConcurrentI/O(CIO)supportforclosetorawperformanceƒFilesystemlevelI/OstripingtoimproveoverallI/Obalance&performanceƒHigherdataavailabilityandfailuresurvivability–MetadataloggingandreplicationoptionsƒMature,Proventechnology(HPCandotherenvironments)ƒnote:StorageSubsystemsmustbeGPFStested/certified©2003IBMCorporationGpfscase1©2003IBMCorporationGpfscase2