无线视频通信中的错误恢复技术研究

华中科技大学硕士学位论文无线视频通信中的错误恢复技术研究姓名：周琴申请学位级别：硕士专业：通信与信息系统指导教师：喻莉20060427IQoS(QualityofService)H.264/AVCAdvancedVideoCodingAVSAudioVideocodingStandardH.264/AVCH.264/AVCIIAbstractRecently,withthedevelopmentofthewirelessnetwork,therequirementofmultimediaapplicationsisgrowingfast.Becauseofthehugedataofmultimediaandvideodata,videosignalisusuallycompressedhighlytoreducetheredundancyforthedemandofthenarrowbandwidth.Sothecompresseddatawillbemoresensitivetothetransmissionerror.Andthereconstructedpictureswillbebadlydamaged,evencan’tbedecoded.Thecharacteristicsofthewirelesschannelarehighbiterrorrateandpacketlossrate.Wirelessvideocommunicationneedsappropriateandeffectiveerrorresilienttechnologytoprovidetheguaranteedquality.Theworkintroducedinthisthesishasresearchedtheerrorresilienttechnologysuitforwirelessvideocommunication.Firstly,abriefintroductionofvideocompressiontechnologiesandstandardsisgiven.Then,thekeytechnologiesandcharacteristicsofsomeimportantvideocompressionstandardsareanalyzedindetail.Andthemainresearchofthisthesisisexplained.Afterthat,theerrordetectionmethodisintroduced.Then,adetailedanalysisofsomeerrorresilienttechnologiesandtheirprincipleisgiven.Thesetechnologiesaretypicalandhavematureresearchachievements.ManycharacteristicerrorresilienttoolsinH.264/AVCstandardaredeeplyresearched.Andtheintroductionofflexiblereferenceframe(FRF)inAVSstandard,thefullyintellectualpropertyofsecondgenerationsourcecoding-decodingstandardwhichisownedbyChina,isgiven.Temporalerrorconcealment,spatialerrorconcealment,frequencyerrorconcealmentandadaptivespatial/temporalerrorconcealmentmethodsareintroducedrespectively.Everykindofmethodshasitsownadvantagesanddisadvantages.Weneedtochoosethemaccordingtothespecificvideosequenceanderrorcondition.Consideringthecharacteristicofwirelesscommunication,anewadaptivespatial/temporalerrorconcealmentmethodisproposed.ExperimentresultsshowthatitcanobtainmuchbetterpictureperformancethantheerrorconcealmentalgorithmsinIIIH.264/AVCstandard.Thehigherbiterrorrateis,thebetterperformanceobtains.Changingthemacroblockorderisaneffectivemethodtocombatchannelerrors.Accordingtothat,amacroblockorderstrategy,whichissuitforreal-timecommunication,isproposed.Thisstrategyhasbetterresultsbyavoidingcontinuouserror.Thenacombinationoftheadaptivespatial/temporalerrorconcealmentmethodandthisstrategyisresearched.ExperimentresultsshowthatthiscombinederrorresilientmethodisbetterthantheerrorresilienttoolsinH.264/AVCstandard.Lastly,aconclusionofthisthesisandthediscussionoffutureresearchdirectionsaregiven.KeyWordsvideocommunication;errorresilient;errorconcealment;adaptivespatial/temporalerrorconcealment;macroblockordering…111.11948OliverPCM[1]50[2][3][4,5][6,7][8,9]1.22ITU-T16SG16VCEG,VideoCodingExpertsGroupH.26xISOJTC1MPEG,MovingPictureExpertsGroupMPEGMPEGH.26x1.2.11.11988CCITTP×64kit/sp=1234564H.261ITU-TISOH.2611988ISO/IECMPEG1991MPEG-11.5Mbit/sVCD199411MPEG-2DVBDVDHDTV4Mbit/s15Mbit/s100Mbit/s1995ITU-TH.26364Kbit/sPSTN19982000H.263H.263++199912ISO/IECMPEG-420033ITU-TISO/IECH.264/AVCIP[10]200263AVSAVSAVS-1.0AVS-MITU-TStandardH.261V1H.261V2H.263H.263+H.263++198819901992199419961998200020022004JointITU-T/MPEGMPEG-2/H.262H.264/MPEG-4AVCMPEGStandardMPEG-1MPEG-4ChinaAVSAVS1.11.2.2MPEGISO/IEC1988MPEGMPEG-l[11]MPEG-2[12]MPEG-4[13]MPFG-7[14]MPEG-21[15]MPEG-11.5MbpsMPEG-1SequenceMPEG-1IPBIPBMPEG-2ISO/IEC13818DVBHDTVDVD1.5MbpsMPEG-2MPEG-lMPFG-2MPEG-lMPFG-24MPEG-4MPEG-4MPEG-4MPEG-4MPEG-2MPEG-41.2.3H.26xH.26164kbps(ISDNIntegratedServicesDigitalNetwork)[16]CIFQCIF35228817614442017614488721994H.261704576H.261H.261H.261MPEG-1MPEG-2/H.262,5H.263H.264H.261zig-zagH.261161688H.26188Zig-zagH.26364kbps[17]H.261S-QCIFQCIFCIF4CIF16CIF420H.263H.261DCTVLCH.263PBH.263H.261H.261H.263+[18]QoSPBSNRVLCH.263+H.263H.263+H.263H263++H263+3[19]3U6V——DCTW——H263+IDCTH.26LITUH.263++H.263H.263H.26LH.263+50BFGSFineGranularityScalableH.264ITU-TVCEGISO/IECMPEGITU-TH.264ISO/IECAVCMPEG-4H.264/AVCH.264DPCMH.263++H.26444VLCH.264H.26350JVTH.26LH.2647(1)H.264VCLVideoCodingLayerVCLNetworkAbstractionLayerVCLVCLVCLNALNALVCLH.264NALNALInternetRTP/UDP/IPNALVCL(2)DCTH.2648×84×4H.263+MPEG-4H.264Intra4417017H.26494×4416×164(3)H.2641/41/86FIR1/21/21/41/888H.2647124816H.264(4)44H.26488H.26444H.2641644DCT44444DC4DC22H.264DCTDCTDCTDCTDCTDSP(5)H.264UVLCCABACH.263VLCH.2649UVLCH.264UVLC(6)H.264IPH.264sliceJVTH.264(FidelityRangeExtensionsFRExt)1012YUV4:2:2YUV4:4:444881.3863No.2002AA119010AVS10H.264FMOFBO1122.1/DCTVLC/DCTVLC,2.2DCTPixelBoundaryMatchingTechniquesRVLC,ReversibleVariableLengthCodeRVLC12DCT2.3FEC(ForwardErrorCorrection)ECC(ErrorControlCoding)ARQ(AutomaticRetransmissionRequest)2.3.113ATMATM[20][21]FECFEC[21]MPEG-22.1IPIPBBBIBPBP2.114[22]MPEG-2SNRMPEG-4FGS(FineGranularityScalable)FGSMPEG-4DCTVariableLengthCodingDCTDCTDCT88FGSFGSMPEG-423dB3dBFGS[23]-PFGSProgressiveFineGranularityScalableFGS1dB2.3.2(MDCMultipleDescriptionCoding)MultipleDescriptor1215SDSingleDescriptionMPEG-4V2NEWPREDH.263V2RPSH.264/AVCMultiplePathDiversityMDMDMDC[24]MDCMPTmultiplepathtransport[25]heterogeneityLayeredMultipl